-- Logs begin at Mon 2022-08-29 21:44:58 UTC, end at Mon 2022-08-29 22:46:58 UTC. -- Aug 29 22:12:46.015294 dv-cinder-854268-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 29 22:12:46.024586 dv-cinder-854268-3-smb devstack@keystone.service[81499]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 29 22:12:46.027648 dv-cinder-854268-3-smb devstack@keystone.service[81499]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 22:12:46 2022] *** Aug 29 22:12:46.027648 dv-cinder-854268-3-smb devstack@keystone.service[81499]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 22:12:46.027648 dv-cinder-854268-3-smb devstack@keystone.service[81499]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 22:12:46.027648 dv-cinder-854268-3-smb devstack@keystone.service[81499]: nodename: dv-cinder-854268-3-smb Aug 29 22:12:46.027648 dv-cinder-854268-3-smb devstack@keystone.service[81499]: machine: x86_64 Aug 29 22:12:46.027648 dv-cinder-854268-3-smb devstack@keystone.service[81499]: clock source: unix Aug 29 22:12:46.027648 dv-cinder-854268-3-smb devstack@keystone.service[81499]: pcre jit disabled Aug 29 22:12:46.027648 dv-cinder-854268-3-smb devstack@keystone.service[81499]: detected number of CPU cores: 4 Aug 29 22:12:46.027648 dv-cinder-854268-3-smb devstack@keystone.service[81499]: current working directory: / Aug 29 22:12:46.027648 dv-cinder-854268-3-smb devstack@keystone.service[81499]: detected binary path: /usr/bin/uwsgi-core Aug 29 22:12:46.027648 dv-cinder-854268-3-smb devstack@keystone.service[81499]: your processes number limit is 47680 Aug 29 22:12:46.027648 dv-cinder-854268-3-smb devstack@keystone.service[81499]: your memory page size is 4096 bytes Aug 29 22:12:46.027648 dv-cinder-854268-3-smb devstack@keystone.service[81499]: detected max file descriptor number: 2048 Aug 29 22:12:46.027648 dv-cinder-854268-3-smb devstack@keystone.service[81499]: lock engine: pthread robust mutexes Aug 29 22:12:46.027648 dv-cinder-854268-3-smb devstack@keystone.service[81499]: thunder lock: enabled Aug 29 22:12:46.027648 dv-cinder-854268-3-smb devstack@keystone.service[81499]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 29 22:12:46.027648 dv-cinder-854268-3-smb devstack@keystone.service[81499]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 22:12:46.065948 dv-cinder-854268-3-smb devstack@keystone.service[81499]: Python main interpreter initialized at 0x556eed4779c0 Aug 29 22:12:46.065948 dv-cinder-854268-3-smb devstack@keystone.service[81499]: python threads support enabled Aug 29 22:12:46.065948 dv-cinder-854268-3-smb devstack@keystone.service[81499]: your server socket listen backlog is limited to 100 connections Aug 29 22:12:46.065948 dv-cinder-854268-3-smb devstack@keystone.service[81499]: your mercy for graceful operations on workers is 90 seconds Aug 29 22:12:46.066380 dv-cinder-854268-3-smb devstack@keystone.service[81499]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 22:12:46.066380 dv-cinder-854268-3-smb devstack@keystone.service[81499]: *** Operational MODE: preforking *** Aug 29 22:12:46.066619 dv-cinder-854268-3-smb devstack@keystone.service[81499]: *** uWSGI is running in multiple interpreter mode *** Aug 29 22:12:46.066619 dv-cinder-854268-3-smb devstack@keystone.service[81499]: spawned uWSGI master process (pid: 81499) Aug 29 22:12:46.066805 dv-cinder-854268-3-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 29 22:12:46.072335 dv-cinder-854268-3-smb devstack@keystone.service[81499]: spawned uWSGI worker 1 (pid: 81514, cores: 1) Aug 29 22:12:46.072335 dv-cinder-854268-3-smb devstack@keystone.service[81499]: spawned uWSGI worker 2 (pid: 81515, cores: 1) Aug 29 22:12:46.072335 dv-cinder-854268-3-smb devstack@keystone.service[81499]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 22:12:50.352230 dv-cinder-854268-3-smb devstack@keystone.service[81514]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 22:12:50.352230 dv-cinder-854268-3-smb devstack@keystone.service[81514]: from cryptography.utils import int_from_bytes Aug 29 22:12:50.353076 dv-cinder-854268-3-smb devstack@keystone.service[81514]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 22:12:50.353076 dv-cinder-854268-3-smb devstack@keystone.service[81514]: from cryptography.utils import int_from_bytes Aug 29 22:12:50.353189 dv-cinder-854268-3-smb devstack@keystone.service[81515]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 22:12:50.353189 dv-cinder-854268-3-smb devstack@keystone.service[81515]: from cryptography.utils import int_from_bytes Aug 29 22:12:50.353189 dv-cinder-854268-3-smb devstack@keystone.service[81515]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 22:12:50.353189 dv-cinder-854268-3-smb devstack@keystone.service[81515]: from cryptography.utils import int_from_bytes Aug 29 22:12:50.402567 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 22:12:50.402567 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 22:12:50.402567 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] command line args: [] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 22:12:50.402913 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 22:12:50.403050 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ================================================================================ {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 22:12:50.403281 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 22:12:50.403420 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] admin_token = **** {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.403503 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 22:12:50.403566 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] config_dir = [] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.403630 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] command line args: [] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 22:12:50.403695 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.403845 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] config_source = [] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.403924 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 22:12:50.403992 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] debug = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.404052 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ================================================================================ {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 22:12:50.404197 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.404471 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] admin_token = **** {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.404553 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] config_dir = [] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.404619 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.404741 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.404846 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.404960 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] config_source = [] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.405065 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.405167 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] debug = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.405261 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.405367 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.405495 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] list_limit = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.405599 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.405694 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] log_config_append = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.405801 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.405902 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.406004 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.406105 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] log_dir = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.406105 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] log_file = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.406312 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.406407 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.406511 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] list_limit = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.406511 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] log_config_append = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.406740 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.406823 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.406940 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.407021 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] log_dir = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.407021 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] log_file = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.407201 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.407201 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.407428 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.407510 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.407632 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.407708 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.407822 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.407908 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.407983 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.408107 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.408189 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.408262 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.408383 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.408493 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.408575 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.408648 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.408768 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.408888 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.408972 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.409123 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.409247 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.409322 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.409446 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.409568 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.409836 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.409971 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.36/identity {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.410067 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] publish_errors = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.410157 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.410240 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.410321 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.410451 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.410634 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.410768 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.36/identity {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.410860 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.410945 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] publish_errors = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.411064 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.411158 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.411316 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] standard_threads = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.411468 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.411610 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.411694 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.411768 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.411898 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.411992 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.412071 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.412144 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] use_journal = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.412262 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] standard_threads = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.412337 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] use_json = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.412408 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] use_stderr = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.412563 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.412647 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] use_syslog = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.412726 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.412798 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.412874 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.413025 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] use_journal = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.413161 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.413243 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] use_json = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.413316 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.413395 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] use_stderr = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.413468 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.413538 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] use_syslog = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.413725 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.413849 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:12:50.413927 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.414015 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.414193 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.414316 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.414408 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.414492 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.414656 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.414780 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.414868 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.414932 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.415125 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.415260 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.415349 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.415422 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.415590 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.415724 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.415814 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.415888 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.416051 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.416184 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.416264 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.416364 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.416511 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.416667 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.416740 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.416800 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.417001 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.417147 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.417240 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.417316 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.417482 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.417617 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.418152 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.418246 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.418403 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.418479 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.418603 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.418720 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.418833 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.418953 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.419076 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.419190 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.419302 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.419302 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.419512 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.419634 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.419748 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.419866 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.419985 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.420104 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.420215 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.420336 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.420477 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.420592 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.420706 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.420829 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.420942 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.421065 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.421191 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.421305 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.421416 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.421526 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.421656 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.421779 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.421899 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.422011 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.422129 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.422241 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.422359 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.422479 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.422592 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.422703 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.422821 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.422933 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.423045 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.423170 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.423289 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.423401 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.423512 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.423622 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.423732 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.423921 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.424037 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.424149 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.424267 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.424381 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.424539 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.424669 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.424782 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.424895 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.425012 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.425123 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.425234 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.425354 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.425466 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.425577 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.425694 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.425806 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.425924 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.426048 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.426162 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.426273 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.426384 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.426494 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.426605 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.426724 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.426842 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.426940 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.427075 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.427185 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.427290 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.427394 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.427491 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.427587 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.427682 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.427779 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.427884 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.428009 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.428130 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.428242 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.428354 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.428480 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.428646 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.428764 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.428889 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.429009 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.429128 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.429250 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.429364 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.429477 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.429597 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.429717 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.429821 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.429932 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.430044 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.430157 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.430277 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.430391 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.430509 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.430622 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.430734 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.430846 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.430951 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.431096 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.431096 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.431311 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.431430 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.431557 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.431670 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.431784 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.431784 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.431994 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.431994 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.432194 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.432313 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.432427 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.432588 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.432701 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.432813 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.432925 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.433053 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.433278 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.433853 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.433974 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.434088 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.434202 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.434326 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.434448 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.434562 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.434676 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.434789 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.434901 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.435023 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.435023 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.435232 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.435346 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.435467 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.435582 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.435775 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.435892 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.436004 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.436117 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.436228 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.436350 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.436488 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.436618 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.436733 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.436853 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.436973 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.437087 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.437199 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.437324 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.437447 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.437560 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.437679 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.437792 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.437904 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.438024 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.438138 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.438251 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.438363 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.438484 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.438597 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.438717 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] auth.external = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.438831 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.438944 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.439057 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.439169 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.439283 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.439427 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.439551 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.439675 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] auth.password = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.439798 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.439913 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] auth.token = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.440039 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.440154 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.440268 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.440389 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.440552 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] auth.external = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.440667 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.440792 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.440908 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.441021 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.441144 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.441258 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.441372 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.441484 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] auth.password = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.441598 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.441710 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] auth.token = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.441836 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] credential.caching = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.441951 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.442064 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.442176 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.442295 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.442409 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.442530 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.442646 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.442767 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.442881 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.442994 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.443106 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.443228 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.443353 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.443466 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.443579 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] credential.caching = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.443693 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.443806 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.443927 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.444042 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.444156 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.444156 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.444366 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.444492 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.444618 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.444618 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.444833 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.444945 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.445058 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.445170 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.445291 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.445291 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] federation.caching = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.445503 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.445616 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.445728 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.445842 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.445966 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.446080 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.446193 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.446306 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.446418 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.446531 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.446652 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.446767 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.446881 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.446994 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.447107 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.447219 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.447341 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] federation.caching = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.447455 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.447568 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.447680 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.447793 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.447915 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.448030 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.448143 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] identity.caching = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.448255 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.448368 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.448527 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.448656 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.448828 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.449458 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.449585 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.449700 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.449814 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.450011 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.450131 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.450246 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.450360 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.450473 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.450586 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.450709 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.450825 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] identity.caching = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.450939 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.450939 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.451161 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.451276 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.451398 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.451513 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.451630 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.451744 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.451858 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.451972 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.452095 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.452210 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.452324 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.452436 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.452574 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.452687 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.452687 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.452917 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.453031 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.453145 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.453334 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.453451 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.453573 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.453692 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.453805 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.453918 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.454031 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.454144 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.454267 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.454381 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.454495 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.454599 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.454711 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.454825 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.454947 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.455061 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.455175 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.455289 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.455402 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.455514 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.455635 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.455749 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.455862 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.455974 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.456086 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.456198 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.456320 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.456435 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.456624 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.456738 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.456851 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.456964 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.457095 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.457211 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.457325 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.457438 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.457550 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.457663 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.457784 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.457898 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.458010 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.458122 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.458235 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.458348 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.458469 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.458583 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.458697 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.458809 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.458921 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.459042 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.459157 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.459269 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.459382 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.459495 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.459608 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.459729 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.459843 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.459956 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.460068 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.460181 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.460293 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.460414 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.460547 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.user = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.460660 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.460774 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.460886 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.460999 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.461124 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.461239 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.461353 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.461465 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.461579 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.461699 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.461821 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.461936 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.462048 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.462161 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.462274 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.462386 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.462507 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.462623 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.462736 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.462849 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.462961 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.user = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.463074 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.463194 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.463310 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.463429 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.463547 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.463662 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.463774 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.463895 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.464009 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.464122 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.464235 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.464620 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.464747 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.464878 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.465127 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.465245 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.465361 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.465474 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.465588 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.465717 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.465835 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.465950 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.466063 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.466177 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.466291 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.466414 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.466530 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.466644 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.466759 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.466872 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.466986 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.467108 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.467108 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.467325 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.467438 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.467552 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.467665 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.467792 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.467909 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.468025 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.468138 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.468251 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.468365 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.468507 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.468625 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.468625 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.468847 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.468961 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.468961 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.469194 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.469309 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.469309 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.469521 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.469633 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.469746 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.469868 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.469868 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.470083 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] resource.caching = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.470198 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.470198 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.470410 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.470531 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.470654 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.470811 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.470811 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.471087 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.471234 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] resource.caching = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.471388 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.471533 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.471533 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.471806 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.471949 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.471949 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.472222 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.472374 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.472604 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.472753 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.472896 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.473040 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.473290 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.473438 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.473584 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] role.caching = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.473732 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.473890 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] role.driver = sql {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.474038 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] role.caching = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.474165 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.474282 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] role.driver = sql {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.474396 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.474509 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.474509 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.474731 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.474847 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.474963 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.475113 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.475269 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.475415 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.475568 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.475714 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.475859 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.476002 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.476145 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.476298 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.476492 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.476645 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.476791 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.476935 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.476935 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.477207 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.477368 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.477516 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.477661 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.477818 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.477963 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.478079 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.478203 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.478320 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.478435 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.478548 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.478662 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.478776 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.478913 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.478913 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.479195 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.479338 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.479483 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.479628 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.479782 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.479782 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.480140 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.480303 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.480479 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.480479 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.480759 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.480902 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.481047 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.481189 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.481189 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.481472 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.481625 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.481790 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.481909 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.482031 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.482137 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.482259 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.482375 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.482496 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.482611 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.482724 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.482838 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.482961 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.483077 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] token.caching = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.483077 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.483290 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.483404 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.483522 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.483646 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.483761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] token.caching = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.483875 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.483988 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.484102 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.484215 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.484337 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.484505 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.484625 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.484740 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.484853 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.484853 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.485080 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.485197 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.485310 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.485424 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.485424 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.485638 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.485759 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.485874 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.485874 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.486085 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.486085 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.486306 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.486306 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.486536 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.486652 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.486766 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.486879 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.486992 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] database.connection = **** {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.487105 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.487226 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.487341 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.487464 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.487586 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.487701 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.487816 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.487929 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.487929 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.488149 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] database.connection = **** {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.488263 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.488378 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.488504 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.488619 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.488732 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.488859 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.488974 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.489088 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.489201 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.489314 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.489427 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.489548 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.489663 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.489776 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.489890 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.490003 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.490115 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.490237 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.490351 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.490465 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.490577 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.490690 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.490803 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.490926 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.491040 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.491161 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.491275 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 22:12:50.491389 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.491389 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.491389 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.491389 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.491389 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:12:50.491389 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 22:12:50.518829 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:12:50.519003 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:12:50.519138 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:12:50.519219 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:12:50.519284 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:12:50.519406 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:12:50.527693 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:12:50.528103 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:12:50.555479 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:12:50.555681 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:12:50.556062 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:12:50.556294 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:12:50.608774 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:12:50.608941 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:12:50.657248 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:12:50.657420 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:12:50.658757 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:12:50.658991 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:12:50.819259 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:12:50.819463 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:12:50.819666 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:12:50.819883 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:12:50.820099 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:12:50.820318 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:12:50.823800 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:12:50.824137 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:12:50.824482 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:12:50.824818 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:12:50.825133 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:12:50.825454 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:12:50.844650 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:12:50.844883 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:12:50.845113 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:12:50.845324 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:12:50.845581 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:12:50.845797 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:12:50.846015 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:12:50.846101 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:12:50.846299 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:12:50.846521 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:12:50.846742 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:12:50.846961 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:12:50.847178 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:12:50.847385 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:12:50.857869 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:12:50.863665 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:12:50.871160 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:12:50.871370 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:12:50.871597 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:12:50.871817 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:12:50.872067 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:12:50.872283 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:12:50.872511 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:12:50.875947 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:12:50.876156 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:12:50.876382 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:12:50.876632 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:12:50.876875 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:12:50.877086 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:12:50.877301 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:12:50.889821 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.889997 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 22:12:50.890367 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.890486 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.890562 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 22:12:50.890656 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 22:12:50.890794 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.890873 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.891054 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 22:12:50.891144 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.891323 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.891584 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.891675 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.891838 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.891926 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.892090 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.901656 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.902048 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.902204 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.902360 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.902487 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.902621 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.902756 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.902893 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.909869 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:12:50.910021 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:12:50.912780 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:12:50.912949 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:12:50.913086 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.913225 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.913339 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.913494 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.913634 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.913781 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.913933 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.914078 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.914243 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.914368 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.914502 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.914642 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.914797 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.914912 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.915182 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.915320 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.915453 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.915600 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.915738 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.915863 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.938733 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.939161 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.940219 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:12:50.940533 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.940669 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:12:50.940973 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.945035 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:12:50.945311 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.945592 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.945717 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:12:50.946026 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.946294 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.952161 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:12:50.952440 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.952733 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:12:50.953017 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.956374 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:12:50.956684 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.956966 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.957072 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:12:50.957244 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.957381 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.957517 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.957636 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.957931 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.958205 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.958482 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.958750 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.959017 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.959603 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.959885 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.960167 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.975622 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.975899 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.976422 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.976725 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.979739 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:12:50.980727 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:12:50.982935 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.983227 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.984022 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.984316 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.987530 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:12:50.988575 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:12:50.990669 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:12:50.991710 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:12:50.993753 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.994050 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.994971 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.995333 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.995549 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.995642 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.995765 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.995958 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.996086 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.996215 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.996430 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:50.996583 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.012136 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:12:51.012443 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.012609 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:12:51.012684 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.012748 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.012979 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.013106 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.013245 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.019962 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.020489 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.021649 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.022018 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.023164 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.023443 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.023583 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.023811 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.026090 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:12:51.026371 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.026497 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:12:51.026655 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.026830 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.026996 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.027230 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.027404 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.027628 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.027945 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.043758 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:12:51.043758 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.043758 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.044145 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:12:51.044234 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.044300 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.044419 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.044549 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.044629 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.044694 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.044769 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.044889 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.044889 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.044889 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.055341 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:12:51.056485 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:12:51.058516 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:12:51.059701 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:12:51.061423 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.062638 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.062868 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.064091 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.064317 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:12:51.064627 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.064916 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.065718 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:12:51.066008 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.066305 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.071369 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.072724 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.072853 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:12:51.074349 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:12:51.075838 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.076135 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.076415 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.076710 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.077354 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.077646 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.077934 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.078211 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.084558 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:12:51.084844 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.085123 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.086131 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:12:51.086417 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.086710 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.092115 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:12:51.092390 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.092691 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.092962 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.093228 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.093501 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.093766 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.093997 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:12:51.094125 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.094254 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.094353 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.094555 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.094697 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.094846 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.094978 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.095057 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.095132 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.095314 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.095442 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.095538 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.095617 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.095866 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.096141 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.096418 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.096711 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.096974 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.097237 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.097515 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:12:51.129730 dv-cinder-854268-3-smb devstack@keystone.service[81514]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556eed4779c0 pid: 81514 (default app) Aug 29 22:12:51.131866 dv-cinder-854268-3-smb devstack@keystone.service[81515]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556eed4779c0 pid: 81515 (default app) Aug 29 22:12:51.133166 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c4621-4327-4d68-ae4c-acba6a0c3245 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:12:51.133454 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c4621-4327-4d68-ae4c-acba6a0c3245 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:12:51.133730 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c4621-4327-4d68-ae4c-acba6a0c3245 None None] PATH_INFO: `/v3` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:12:51.138506 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 791 bytes} [Mon Aug 29 22:12:51 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:12:57.817217 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3170f-173b-4dd9-926b-3ac546f730bb None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:12:57.817842 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3170f-173b-4dd9-926b-3ac546f730bb None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:12:57.817842 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3170f-173b-4dd9-926b-3ac546f730bb None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:12:57.822196 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1/2] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:12:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:12:57.828992 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b51759-bc93-4d0e-b4d6-cc3d3e4bbb4a None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:12:57.829935 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b51759-bc93-4d0e-b4d6-cc3d3e4bbb4a None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:12:57.829935 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b51759-bc93-4d0e-b4d6-cc3d3e4bbb4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:12:57.904100 dv-cinder-854268-3-smb devstack@keystone.service[81514]: INFO dbcounter [None req-37b51759-bc93-4d0e-b4d6-cc3d3e4bbb4a None None] Registered counter for database keystone Aug 29 22:12:57.925993 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG oslo_db.sqlalchemy.engines [None req-37b51759-bc93-4d0e-b4d6-cc3d3e4bbb4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81514) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 22:12:57.936643 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writer thread running {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 22:12:58.131228 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG passlib.handlers.bcrypt [None req-37b51759-bc93-4d0e-b4d6-cc3d3e4bbb4a None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81514) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 29 22:12:58.131581 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG passlib.handlers.bcrypt [None req-37b51759-bc93-4d0e-b4d6-cc3d3e4bbb4a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81514) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 29 22:12:58.193950 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-37b51759-bc93-4d0e-b4d6-cc3d3e4bbb4a None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:12:58.195638 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-37b51759-bc93-4d0e-b4d6-cc3d3e4bbb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:12:58.353376 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 2/3] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:12:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 526 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 29 22:12:58.851064 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3170f-173b-4dd9-926b-3ac546f730bb None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:12:58.932403 dv-cinder-854268-3-smb devstack@keystone.service[81515]: INFO dbcounter [None req-7be3170f-173b-4dd9-926b-3ac546f730bb None None] Registered counter for database keystone Aug 29 22:12:58.958079 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG oslo_db.sqlalchemy.engines [None req-7be3170f-173b-4dd9-926b-3ac546f730bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81515) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 22:12:58.969794 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writer thread running {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 22:12:59.095769 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3170f-173b-4dd9-926b-3ac546f730bb None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:12:59.102106 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d490cbc2-1c64-4d71-9a90-f1dac1da6fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:12:59.102679 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490cbc2-1c64-4d71-9a90-f1dac1da6fdf admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:12:59.102968 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490cbc2-1c64-4d71-9a90-f1dac1da6fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:12:59.103227 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490cbc2-1c64-4d71-9a90-f1dac1da6fdf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:12:59.113082 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d490cbc2-1c64-4d71-9a90-f1dac1da6fdf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:12:59.165369 dv-cinder-854268-3-smb devstack@keystone.service[81515]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d490cbc2-1c64-4d71-9a90-f1dac1da6fdf admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 29 22:12:59.165693 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d490cbc2-1c64-4d71-9a90-f1dac1da6fdf admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:12:59.176245 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 2/4] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Aug 29 22:12:58 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 22:12:59.185437 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b51759-bc93-4d0e-b4d6-cc3d3e4bbb4a None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:12:59.200896 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b51759-bc93-4d0e-b4d6-cc3d3e4bbb4a None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:12:59.206321 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f0ecca-4929-48d2-85ce-c5cb91a789f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:12:59.207439 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0ecca-4929-48d2-85ce-c5cb91a789f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:12:59.207727 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0ecca-4929-48d2-85ce-c5cb91a789f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:12:59.208004 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0ecca-4929-48d2-85ce-c5cb91a789f5 admin admin] PATH_INFO: `/v3/projects/174c552d34394032ba6a5f46a315abf1` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:12:59.209897 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f0ecca-4929-48d2-85ce-c5cb91a789f5 admin admin] RBAC: Authorizing `identity:get_project(project_id=174c552d34394032ba6a5f46a315abf1)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:12:59.262509 dv-cinder-854268-3-smb devstack@keystone.service[81514]: WARNING keystone.common.rbac_enforcer.enforcer [None req-37f0ecca-4929-48d2-85ce-c5cb91a789f5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 29 22:12:59.262859 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f0ecca-4929-48d2-85ce-c5cb91a789f5 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:12:59.267873 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 3/5] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Aug 29 22:12:59 2022] GET /identity/v3/projects/174c552d34394032ba6a5f46a315abf1 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:01.186128 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3423be3-24b4-4000-b911-8658244bdb6e None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:01.187010 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3423be3-24b4-4000-b911-8658244bdb6e None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:01.187010 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3423be3-24b4-4000-b911-8658244bdb6e None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:01.193810 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 3/6] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:13:01 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:13:01.201554 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc6a5e-d8b1-457b-a8a4-9bc5035f3f1b None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:01.201996 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc6a5e-d8b1-457b-a8a4-9bc5035f3f1b None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:01.202088 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc6a5e-d8b1-457b-a8a4-9bc5035f3f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:01.224956 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-02cc6a5e-d8b1-457b-a8a4-9bc5035f3f1b None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:13:01.226519 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-02cc6a5e-d8b1-457b-a8a4-9bc5035f3f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:13:01.235691 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 4/7] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:13:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 29 22:13:01.513654 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3423be3-24b4-4000-b911-8658244bdb6e None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:01.533323 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3423be3-24b4-4000-b911-8658244bdb6e None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:01.538742 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654eb27-5551-4485-b449-c72bb20509e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:01.539361 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654eb27-5551-4485-b449-c72bb20509e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:01.539644 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654eb27-5551-4485-b449-c72bb20509e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:01.539921 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654eb27-5551-4485-b449-c72bb20509e5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:01.548643 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6654eb27-5551-4485-b449-c72bb20509e5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:01.550488 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6654eb27-5551-4485-b449-c72bb20509e5 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:01.560099 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 4/8] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Aug 29 22:13:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 22:13:01.569058 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc6a5e-d8b1-457b-a8a4-9bc5035f3f1b None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:01.584097 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc6a5e-d8b1-457b-a8a4-9bc5035f3f1b None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:01.593193 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe194e2-b636-4492-85d9-764ceb2d2235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:01.594199 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe194e2-b636-4492-85d9-764ceb2d2235 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:01.594665 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe194e2-b636-4492-85d9-764ceb2d2235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:01.595113 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe194e2-b636-4492-85d9-764ceb2d2235 admin admin] PATH_INFO: `/v3/users/6b5654a5750846779dda7b1bf48a68d8` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:01.596751 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe194e2-b636-4492-85d9-764ceb2d2235 admin admin] RBAC: Authorizing `identity:get_user(user_id=6b5654a5750846779dda7b1bf48a68d8)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:01.598624 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe194e2-b636-4492-85d9-764ceb2d2235 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:01.600194 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 5/9] 10.222.0.36 () {56 vars in 1198 bytes} [Mon Aug 29 22:13:01 2022] GET /identity/v3/users/6b5654a5750846779dda7b1bf48a68d8 => generated 247 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:03.583046 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aaa314-b264-43a6-9909-c49262a47a7e None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:03.584044 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aaa314-b264-43a6-9909-c49262a47a7e None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:03.584340 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aaa314-b264-43a6-9909-c49262a47a7e None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:03.585771 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 5/10] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:13:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:13:03.591221 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c9f48-c0b0-408f-b25b-3c11684c665f None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:03.592009 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c9f48-c0b0-408f-b25b-3c11684c665f None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:03.592289 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c9f48-c0b0-408f-b25b-3c11684c665f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:03.611940 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-ea0c9f48-c0b0-408f-b25b-3c11684c665f None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:13:03.613244 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-ea0c9f48-c0b0-408f-b25b-3c11684c665f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:13:03.628108 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8d93c-7c17-471d-a353-d027700d97c5 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:03.628392 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8d93c-7c17-471d-a353-d027700d97c5 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:03.628753 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8d93c-7c17-471d-a353-d027700d97c5 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:03.630036 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 6/11] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:13:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:13:03.635116 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f4369-539a-4795-9fba-8c9e5db72b22 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:03.635398 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f4369-539a-4795-9fba-8c9e5db72b22 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:03.635762 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f4369-539a-4795-9fba-8c9e5db72b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:03.677845 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG passlib.handlers.bcrypt [None req-895f4369-539a-4795-9fba-8c9e5db72b22 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81515) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 29 22:13:03.678240 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG passlib.handlers.bcrypt [None req-895f4369-539a-4795-9fba-8c9e5db72b22 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81515) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 29 22:13:03.694827 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 6/12] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:13:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:13:03.726997 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-895f4369-539a-4795-9fba-8c9e5db72b22 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:13:03.728661 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-895f4369-539a-4795-9fba-8c9e5db72b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:13:03.831704 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 7/13] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:13:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:13:03.967478 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c9f48-c0b0-408f-b25b-3c11684c665f None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:03.994643 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:04.092143 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c9f48-c0b0-408f-b25b-3c11684c665f None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:04.103982 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f4369-539a-4795-9fba-8c9e5db72b22 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:04.130389 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb46a9b4-38d6-414b-8c22-a178e89382c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:04.131033 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb46a9b4-38d6-414b-8c22-a178e89382c2 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:04.131315 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb46a9b4-38d6-414b-8c22-a178e89382c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:04.131620 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb46a9b4-38d6-414b-8c22-a178e89382c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:04.143635 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb46a9b4-38d6-414b-8c22-a178e89382c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:13:04.152748 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-cb46a9b4-38d6-414b-8c22-a178e89382c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:13:04.152748 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:13:04.152748 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:13:04.152748 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:13:04.152748 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:13:04.152748 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:13:04.152748 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:13:04.152748 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:13:04.152748 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:13:04.152748 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:13:04.152748 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:13:04.152748 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:13:04.152748 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:13:04.152748 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:13:04.152748 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:13:04.152748 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:13:04.153696 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:13:04.153696 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:13:04.153696 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:13:04.153696 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:13:04.153696 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:13:04.153696 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:13:04.153696 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:13:04.153696 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:13:04.153696 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:13:04.153696 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:13:04.153696 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:13:04.153696 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:13:04.153696 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:13:04.153696 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:13:04.153696 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:13:04.153696 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:13:04.154574 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:13:04.154574 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:13:04.154574 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:13:04.154574 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:13:04.154574 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:13:04.154574 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:13:04.154574 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:13:04.154574 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:13:04.154574 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:13:04.154574 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:13:04.154574 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:13:04.154574 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:13:04.154574 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 7/14] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Aug 29 22:13:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:13:04.160077 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb46a9b4-38d6-414b-8c22-a178e89382c2 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:04.211091 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f4369-539a-4795-9fba-8c9e5db72b22 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:04.213818 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:04.247746 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:04.249770 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b34dd-7500-4623-bbf5-ce1ccb443847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:04.250679 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b34dd-7500-4623-bbf5-ce1ccb443847 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:04.251015 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b34dd-7500-4623-bbf5-ce1ccb443847 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:04.251233 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b34dd-7500-4623-bbf5-ce1ccb443847 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:04.269273 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb46a9b4-38d6-414b-8c22-a178e89382c2 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:04.304682 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d133d77b-d83c-460a-99a3-d4b3a81a07f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:04.305297 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133d77b-d83c-460a-99a3-d4b3a81a07f9 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:04.305582 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133d77b-d83c-460a-99a3-d4b3a81a07f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:04.305864 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133d77b-d83c-460a-99a3-d4b3a81a07f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:04.306541 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d133d77b-d83c-460a-99a3-d4b3a81a07f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:04.306844 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d133d77b-d83c-460a-99a3-d4b3a81a07f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:04.308311 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d133d77b-d83c-460a-99a3-d4b3a81a07f9 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:04.320123 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 8/15] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:13:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:13:04.321447 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88b34dd-7500-4623-bbf5-ce1ccb443847 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:04.322980 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88b34dd-7500-4623-bbf5-ce1ccb443847 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:04.326100 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d133d77b-d83c-460a-99a3-d4b3a81a07f9 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:04.426351 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 8/16] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:13:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:13:04.429335 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d133d77b-d83c-460a-99a3-d4b3a81a07f9 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:04.432101 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b34dd-7500-4623-bbf5-ce1ccb443847 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:04.434959 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:04.467577 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e3299-ab95-4e72-b331-60975a42b996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:04.468215 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e3299-ab95-4e72-b331-60975a42b996 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:04.468511 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e3299-ab95-4e72-b331-60975a42b996 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:04.468783 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e3299-ab95-4e72-b331-60975a42b996 None admin] PATH_INFO: `/v3/users/6b5654a5750846779dda7b1bf48a68d8` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:04.469924 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e3299-ab95-4e72-b331-60975a42b996 None admin] RBAC: Authorizing `identity:get_user(user_id=6b5654a5750846779dda7b1bf48a68d8)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:04.471394 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e3299-ab95-4e72-b331-60975a42b996 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:04.473023 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 9/17] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Aug 29 22:13:04 2022] GET /identity/v3/users/6b5654a5750846779dda7b1bf48a68d8 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:13:04.478767 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e3299-ab95-4e72-b331-60975a42b996 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:04.493801 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:04.529889 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b34dd-7500-4623-bbf5-ce1ccb443847 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:04.563416 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83671f-a228-49ce-b5fe-99a9d31ce0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:04.564377 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83671f-a228-49ce-b5fe-99a9d31ce0b2 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:04.564695 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83671f-a228-49ce-b5fe-99a9d31ce0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:04.564947 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83671f-a228-49ce-b5fe-99a9d31ce0b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:04.579873 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e3299-ab95-4e72-b331-60975a42b996 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:04.583346 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c83671f-a228-49ce-b5fe-99a9d31ce0b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:04.584867 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c83671f-a228-49ce-b5fe-99a9d31ce0b2 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:04.603927 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-7c83671f-a228-49ce-b5fe-99a9d31ce0b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:13:04.603927 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:13:04.603927 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:13:04.603927 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:13:04.603927 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:13:04.603927 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:13:04.603927 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:13:04.603927 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:13:04.603927 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:13:04.603927 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:13:04.603927 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:13:04.603927 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:13:04.603927 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:13:04.603927 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:13:04.603927 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:13:04.603927 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:13:04.604999 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:13:04.604999 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:13:04.604999 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:13:04.604999 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:13:04.604999 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:13:04.604999 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:13:04.604999 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:13:04.604999 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:13:04.604999 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:13:04.604999 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:13:04.604999 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:13:04.604999 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:13:04.604999 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:13:04.604999 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:13:04.604999 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:13:04.604999 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:13:04.604999 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:13:04.606068 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:13:04.606068 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:13:04.606068 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:13:04.606068 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 9/18] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:13:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:13:04.611622 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83671f-a228-49ce-b5fe-99a9d31ce0b2 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:04.615207 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb1956-94f3-4666-a872-e9acd5a18ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:04.615907 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb1956-94f3-4666-a872-e9acd5a18ab9 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:04.616188 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb1956-94f3-4666-a872-e9acd5a18ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:04.616490 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb1956-94f3-4666-a872-e9acd5a18ab9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:04.617614 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb1956-94f3-4666-a872-e9acd5a18ab9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:04.619094 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb1956-94f3-4666-a872-e9acd5a18ab9 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:04.621091 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 10/19] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:13:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:13:04.626629 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb1956-94f3-4666-a872-e9acd5a18ab9 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:04.669057 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:04.707178 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:04.715496 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83671f-a228-49ce-b5fe-99a9d31ce0b2 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:04.727584 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb1956-94f3-4666-a872-e9acd5a18ab9 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:04.747469 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c646f-a55e-4a06-988f-f666a7357ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:04.748078 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c646f-a55e-4a06-988f-f666a7357ffd None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:04.748354 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c646f-a55e-4a06-988f-f666a7357ffd None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:04.748651 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c646f-a55e-4a06-988f-f666a7357ffd None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:04.749303 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c646f-a55e-4a06-988f-f666a7357ffd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:04.749601 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c646f-a55e-4a06-988f-f666a7357ffd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:04.750973 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c646f-a55e-4a06-988f-f666a7357ffd None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:04.761912 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6236fc79-8428-43a5-aebe-dc20525a3329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:04.762525 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236fc79-8428-43a5-aebe-dc20525a3329 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:04.762808 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236fc79-8428-43a5-aebe-dc20525a3329 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:04.763082 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236fc79-8428-43a5-aebe-dc20525a3329 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:04.763808 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6236fc79-8428-43a5-aebe-dc20525a3329 None admin] RBAC: Adding query filter params (role.id=ff59a239a50b4bd899a83bf3c3fd1f63, scope.domain.id=default, user.id=6b5654a5750846779dda7b1bf48a68d8) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:04.764119 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6236fc79-8428-43a5-aebe-dc20525a3329 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:04.765914 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6236fc79-8428-43a5-aebe-dc20525a3329 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:04.768702 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 10/20] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:13:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:13:04.777069 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 11/21] 10.222.0.36 () {56 vars in 1322 bytes} [Mon Aug 29 22:13:04 2022] GET /identity/v3/role_assignments?user.id=6b5654a5750846779dda7b1bf48a68d8&scope.domain.id=default&role.id=ff59a239a50b4bd899a83bf3c3fd1f63 => generated 233 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:13:06.752208 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0cce1-53b5-4005-87b4-6ae62a4382b7 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:06.753203 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0cce1-53b5-4005-87b4-6ae62a4382b7 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:06.753679 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0cce1-53b5-4005-87b4-6ae62a4382b7 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:06.755231 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 11/22] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:13:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:13:06.768108 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18bb9c5-0cdb-45ef-915d-e025b0925bcc None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:06.768621 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18bb9c5-0cdb-45ef-915d-e025b0925bcc None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:06.768713 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18bb9c5-0cdb-45ef-915d-e025b0925bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:06.795036 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-a18bb9c5-0cdb-45ef-915d-e025b0925bcc None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:13:06.796245 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a18bb9c5-0cdb-45ef-915d-e025b0925bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:13:06.900141 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 12/23] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:13:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:13:06.943722 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca446911-e167-4e4b-b689-4802178dcbb4 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:06.944017 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca446911-e167-4e4b-b689-4802178dcbb4 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:06.944279 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca446911-e167-4e4b-b689-4802178dcbb4 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:06.945782 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 12/24] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:13:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:13:06.951048 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8cf5f-160d-4e1c-b3fa-b8775eeb7bf8 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:06.951345 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8cf5f-160d-4e1c-b3fa-b8775eeb7bf8 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:06.951623 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8cf5f-160d-4e1c-b3fa-b8775eeb7bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:06.974975 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-9ff8cf5f-160d-4e1c-b3fa-b8775eeb7bf8 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:13:06.976165 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-9ff8cf5f-160d-4e1c-b3fa-b8775eeb7bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:13:07.059220 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 13/25] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:13:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:13:07.425814 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca446911-e167-4e4b-b689-4802178dcbb4 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:07.491223 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8cf5f-160d-4e1c-b3fa-b8775eeb7bf8 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:07.494381 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:07.631166 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca446911-e167-4e4b-b689-4802178dcbb4 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:07.671257 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:07.693078 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de592f8-ca64-4276-8dc5-4b8460494ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:07.694079 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de592f8-ca64-4276-8dc5-4b8460494ba6 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:07.694578 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de592f8-ca64-4276-8dc5-4b8460494ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:07.695043 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de592f8-ca64-4276-8dc5-4b8460494ba6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:07.705728 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8cf5f-160d-4e1c-b3fa-b8775eeb7bf8 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:07.709138 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de592f8-ca64-4276-8dc5-4b8460494ba6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:13:07.715913 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-7de592f8-ca64-4276-8dc5-4b8460494ba6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:13:07.715913 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:13:07.715913 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:13:07.715913 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:13:07.715913 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:13:07.715913 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:13:07.715913 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:13:07.715913 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:13:07.715913 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:13:07.715913 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:13:07.715913 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:13:07.715913 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:13:07.715913 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:13:07.715913 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:13:07.715913 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:13:07.715913 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:13:07.717012 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:13:07.717012 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:13:07.717012 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:13:07.717012 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:13:07.717012 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:13:07.717012 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:13:07.717012 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:13:07.717012 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:13:07.717012 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:13:07.717012 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:13:07.717012 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:13:07.717012 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:13:07.717012 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:13:07.717012 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:13:07.717012 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:13:07.717012 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:13:07.717812 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:13:07.717812 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:13:07.717812 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:13:07.717812 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:13:07.717812 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:13:07.717812 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:13:07.717812 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:13:07.717812 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:13:07.717812 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:13:07.717812 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:13:07.717812 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:13:07.717812 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:13:07.720181 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 13/26] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Aug 29 22:13:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:13:07.721793 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457d0fd-7c53-484e-88d6-d5baeff4178a None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:07.722369 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457d0fd-7c53-484e-88d6-d5baeff4178a None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:07.722845 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457d0fd-7c53-484e-88d6-d5baeff4178a None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:07.724532 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 14/27] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:13:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:13:07.726076 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb4ffc-a8f4-41f0-a48a-3a2b52cb8afd None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:07.726586 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb4ffc-a8f4-41f0-a48a-3a2b52cb8afd None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:07.727172 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb4ffc-a8f4-41f0-a48a-3a2b52cb8afd None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:07.728776 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 15/28] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:13:07.737472 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c1bbb-691e-44fe-9169-2f2b30b14123 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:07.737691 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c1bbb-691e-44fe-9169-2f2b30b14123 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:07.738760 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c1bbb-691e-44fe-9169-2f2b30b14123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:07.750833 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf7aace-254a-478d-8ec4-bb06897a9620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:07.751483 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7aace-254a-478d-8ec4-bb06897a9620 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:07.751762 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7aace-254a-478d-8ec4-bb06897a9620 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:07.752033 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7aace-254a-478d-8ec4-bb06897a9620 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:07.762457 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-5b5c1bbb-691e-44fe-9169-2f2b30b14123 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:13:07.762959 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf7aace-254a-478d-8ec4-bb06897a9620 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:07.763716 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-5b5c1bbb-691e-44fe-9169-2f2b30b14123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:13:07.764397 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf7aace-254a-478d-8ec4-bb06897a9620 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:07.781441 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-edf7aace-254a-478d-8ec4-bb06897a9620 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:13:07.781441 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:13:07.781441 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:13:07.781441 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:13:07.781441 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:13:07.781441 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:13:07.781441 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:13:07.781441 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:13:07.781441 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:13:07.781441 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:13:07.781441 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:13:07.781441 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:13:07.781441 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:13:07.781441 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:13:07.781441 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:13:07.781441 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:13:07.782766 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:13:07.782766 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:13:07.782766 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:13:07.782766 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:13:07.782766 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:13:07.782766 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:13:07.782766 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:13:07.782766 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:13:07.782766 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:13:07.782766 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:13:07.782766 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:13:07.782766 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:13:07.782766 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:13:07.782766 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:13:07.782766 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:13:07.782766 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:13:07.782766 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:13:07.783574 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:13:07.783574 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:13:07.783574 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:13:07.783574 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 14/29] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:13:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:13:07.783574 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf7aace-254a-478d-8ec4-bb06897a9620 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:07.840323 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 16/30] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:13:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:13:07.841742 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33309fc1-4262-43d2-9bc2-cec9803089df None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:07.842032 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33309fc1-4262-43d2-9bc2-cec9803089df None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:07.842305 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33309fc1-4262-43d2-9bc2-cec9803089df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:07.859546 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:07.869050 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-33309fc1-4262-43d2-9bc2-cec9803089df None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:13:07.870971 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-33309fc1-4262-43d2-9bc2-cec9803089df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:13:07.958787 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf7aace-254a-478d-8ec4-bb06897a9620 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:07.961588 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 17/31] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:13:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:13:07.962481 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33309fc1-4262-43d2-9bc2-cec9803089df None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:08.036574 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d8c265-1383-4c20-9bc7-8f6afa6cec19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:08.037204 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8c265-1383-4c20-9bc7-8f6afa6cec19 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:08.037482 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8c265-1383-4c20-9bc7-8f6afa6cec19 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:08.037754 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8c265-1383-4c20-9bc7-8f6afa6cec19 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:08.038432 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d8c265-1383-4c20-9bc7-8f6afa6cec19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:08.038728 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d8c265-1383-4c20-9bc7-8f6afa6cec19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:08.040620 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d8c265-1383-4c20-9bc7-8f6afa6cec19 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:08.052982 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:08.079012 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 15/32] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:13:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:08.097899 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d8c265-1383-4c20-9bc7-8f6afa6cec19 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:08.170395 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33309fc1-4262-43d2-9bc2-cec9803089df None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:08.238753 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e573e-4c1d-4a4b-8ddc-322c14d7942d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:08.239298 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e573e-4c1d-4a4b-8ddc-322c14d7942d None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:08.239573 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e573e-4c1d-4a4b-8ddc-322c14d7942d None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:08.239840 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e573e-4c1d-4a4b-8ddc-322c14d7942d None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:08.240514 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e573e-4c1d-4a4b-8ddc-322c14d7942d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:08.240817 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e573e-4c1d-4a4b-8ddc-322c14d7942d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:08.242211 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e573e-4c1d-4a4b-8ddc-322c14d7942d None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:08.254643 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d8c265-1383-4c20-9bc7-8f6afa6cec19 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:08.275088 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 18/33] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:13:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:08.281458 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e573e-4c1d-4a4b-8ddc-322c14d7942d None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:08.286162 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:08.316509 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156d8863-f777-44e0-96c9-352df7a2e927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:08.317176 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d8863-f777-44e0-96c9-352df7a2e927 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:08.317508 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d8863-f777-44e0-96c9-352df7a2e927 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:08.317791 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d8863-f777-44e0-96c9-352df7a2e927 None admin] PATH_INFO: `/v3/users/6b5654a5750846779dda7b1bf48a68d8` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:08.319264 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156d8863-f777-44e0-96c9-352df7a2e927 None admin] RBAC: Authorizing `identity:get_user(user_id=6b5654a5750846779dda7b1bf48a68d8)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:08.321023 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156d8863-f777-44e0-96c9-352df7a2e927 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:08.323079 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 16/34] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Aug 29 22:13:08 2022] GET /identity/v3/users/6b5654a5750846779dda7b1bf48a68d8 => generated 247 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:13:08.324270 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156d8863-f777-44e0-96c9-352df7a2e927 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:08.460677 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:08.473062 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e573e-4c1d-4a4b-8ddc-322c14d7942d None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:08.487799 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156d8863-f777-44e0-96c9-352df7a2e927 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:08.520666 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acdcbd0-6462-41c9-a103-1a90329e9c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:08.521211 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acdcbd0-6462-41c9-a103-1a90329e9c0b None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:08.521496 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acdcbd0-6462-41c9-a103-1a90329e9c0b None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:08.521773 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acdcbd0-6462-41c9-a103-1a90329e9c0b None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:08.522894 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acdcbd0-6462-41c9-a103-1a90329e9c0b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:08.524358 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acdcbd0-6462-41c9-a103-1a90329e9c0b None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:08.525466 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c0479-4cbd-4649-97fa-74ce0815ed2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:08.526378 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c0479-4cbd-4649-97fa-74ce0815ed2b None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:08.526885 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c0479-4cbd-4649-97fa-74ce0815ed2b None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:08.527359 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c0479-4cbd-4649-97fa-74ce0815ed2b None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:08.528433 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405c0479-4cbd-4649-97fa-74ce0815ed2b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:08.530063 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405c0479-4cbd-4649-97fa-74ce0815ed2b None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:08.653818 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 17/35] 10.222.0.36 () {60 vars in 1131 bytes} [Mon Aug 29 22:13:08 2022] POST /identity/v3/roles => generated 225 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:13:08.655133 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c0479-4cbd-4649-97fa-74ce0815ed2b None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:08.677835 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 19/36] 10.222.0.36 () {60 vars in 1141 bytes} [Mon Aug 29 22:13:08 2022] POST /identity/v3/projects => generated 301 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:13:08.679201 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acdcbd0-6462-41c9-a103-1a90329e9c0b None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:08.737462 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:08.802840 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acdcbd0-6462-41c9-a103-1a90329e9c0b None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:08.825641 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c0479-4cbd-4649-97fa-74ce0815ed2b None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:08.849632 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f694d32-b64d-4be8-8404-0193cfcf0c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:08.850642 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f694d32-b64d-4be8-8404-0193cfcf0c39 None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:08.851113 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f694d32-b64d-4be8-8404-0193cfcf0c39 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:08.851631 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f694d32-b64d-4be8-8404-0193cfcf0c39 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:08.852564 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f694d32-b64d-4be8-8404-0193cfcf0c39 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:08.854364 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f694d32-b64d-4be8-8404-0193cfcf0c39 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:08.877389 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e2bc2-038f-4861-9fed-3a86520a6298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:08.878056 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e2bc2-038f-4861-9fed-3a86520a6298 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:08.878339 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e2bc2-038f-4861-9fed-3a86520a6298 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:08.878617 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e2bc2-038f-4861-9fed-3a86520a6298 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:08.879857 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22e2bc2-038f-4861-9fed-3a86520a6298 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:08.881339 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 20/37] 10.222.0.36 () {60 vars in 1131 bytes} [Mon Aug 29 22:13:08 2022] POST /identity/v3/roles => generated 219 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:13:08.881444 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22e2bc2-038f-4861-9fed-3a86520a6298 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:08.882491 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79442c-fef0-4673-ba84-928d84774e57 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:08.882755 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79442c-fef0-4673-ba84-928d84774e57 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:08.883105 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 18/38] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:13:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:08.883224 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79442c-fef0-4673-ba84-928d84774e57 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:08.884343 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 21/39] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:13:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:13:08.884805 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f830597-3a9e-413b-bdb8-d0fd698d7546 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:08.885302 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f830597-3a9e-413b-bdb8-d0fd698d7546 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:08.885520 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f830597-3a9e-413b-bdb8-d0fd698d7546 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:08.886900 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 19/40] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:13:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:13:08.892511 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79442c-fef0-4673-ba84-928d84774e57 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:08.892840 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7bafbe-157e-46e6-9508-19f8d0cf86a9 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:08.893134 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7bafbe-157e-46e6-9508-19f8d0cf86a9 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:08.893412 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7bafbe-157e-46e6-9508-19f8d0cf86a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:08.916262 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:09.032697 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-2a7bafbe-157e-46e6-9508-19f8d0cf86a9 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:13:09.034292 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-2a7bafbe-157e-46e6-9508-19f8d0cf86a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:13:09.047591 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79442c-fef0-4673-ba84-928d84774e57 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:09.085283 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7185e7fc-a560-4b62-84ff-7218b53cf941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:09.086267 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7185e7fc-a560-4b62-84ff-7218b53cf941 None admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:09.086722 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7185e7fc-a560-4b62-84ff-7218b53cf941 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:09.087152 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7185e7fc-a560-4b62-84ff-7218b53cf941 None admin] PATH_INFO: `/v3/domains/default/users/6b5654a5750846779dda7b1bf48a68d8/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:09.090443 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7185e7fc-a560-4b62-84ff-7218b53cf941 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=6b5654a5750846779dda7b1bf48a68d8, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:09.091921 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7185e7fc-a560-4b62-84ff-7218b53cf941 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:09.110814 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 22/41] 10.222.0.36 () {58 vars in 1361 bytes} [Mon Aug 29 22:13:08 2022] PUT /identity/v3/domains/default/users/6b5654a5750846779dda7b1bf48a68d8/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:13:09.112077 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9dccf-03f8-42d2-8a32-c2ac96f57f86 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:09.112369 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9dccf-03f8-42d2-8a32-c2ac96f57f86 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:09.112672 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9dccf-03f8-42d2-8a32-c2ac96f57f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:09.129720 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 20/42] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:13:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:13:09.140430 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-c0c9dccf-03f8-42d2-8a32-c2ac96f57f86 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:13:09.142358 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c0c9dccf-03f8-42d2-8a32-c2ac96f57f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:13:09.212294 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:09.224644 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 23/43] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:13:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:13:09.400214 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7bafbe-157e-46e6-9508-19f8d0cf86a9 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:09.451123 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:09.497988 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c9dccf-03f8-42d2-8a32-c2ac96f57f86 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:09.510745 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7bafbe-157e-46e6-9508-19f8d0cf86a9 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:09.547541 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080baba5-4656-45a5-88cc-ea8495177902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:09.548179 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080baba5-4656-45a5-88cc-ea8495177902 None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:09.548464 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080baba5-4656-45a5-88cc-ea8495177902 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:09.548753 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080baba5-4656-45a5-88cc-ea8495177902 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:09.549449 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080baba5-4656-45a5-88cc-ea8495177902 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:09.551075 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080baba5-4656-45a5-88cc-ea8495177902 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:09.566917 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 21/44] 10.222.0.36 () {60 vars in 1131 bytes} [Mon Aug 29 22:13:09 2022] POST /identity/v3/roles => generated 223 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:13:09.607944 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c9dccf-03f8-42d2-8a32-c2ac96f57f86 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:09.647346 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5738c1d3-0fff-441c-b627-7bbc7be2e304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:09.648014 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738c1d3-0fff-441c-b627-7bbc7be2e304 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:09.648302 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738c1d3-0fff-441c-b627-7bbc7be2e304 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:09.648614 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738c1d3-0fff-441c-b627-7bbc7be2e304 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:09.649772 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5738c1d3-0fff-441c-b627-7bbc7be2e304 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:09.651756 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5738c1d3-0fff-441c-b627-7bbc7be2e304 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:09.653575 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 24/45] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:13:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:13:09.659182 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080baba5-4656-45a5-88cc-ea8495177902 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:09.775479 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080baba5-4656-45a5-88cc-ea8495177902 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:09.778040 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:09.812009 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cf5609-205e-4a18-a002-8231afd69f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:09.812665 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf5609-205e-4a18-a002-8231afd69f1d None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:09.812950 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf5609-205e-4a18-a002-8231afd69f1d None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:09.813226 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf5609-205e-4a18-a002-8231afd69f1d None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:09.813882 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cf5609-205e-4a18-a002-8231afd69f1d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:09.815370 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cf5609-205e-4a18-a002-8231afd69f1d None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:09.844152 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 22/46] 10.222.0.36 () {60 vars in 1141 bytes} [Mon Aug 29 22:13:09 2022] POST /identity/v3/projects => generated 312 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:13:11.029400 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9dfbdc-715b-4757-88d7-a99c484ab231 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:11.029967 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9dfbdc-715b-4757-88d7-a99c484ab231 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:11.029967 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9dfbdc-715b-4757-88d7-a99c484ab231 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:11.031256 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 25/47] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:13:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:13:11.036672 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e3a6e-c11d-4756-ae4b-00153ca156c7 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:11.037080 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e3a6e-c11d-4756-ae4b-00153ca156c7 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:11.037361 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e3a6e-c11d-4756-ae4b-00153ca156c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:11.055945 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-459e3a6e-c11d-4756-ae4b-00153ca156c7 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:13:11.057238 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-459e3a6e-c11d-4756-ae4b-00153ca156c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:13:11.130401 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 23/48] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:13:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:13:11.398344 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9dfbdc-715b-4757-88d7-a99c484ab231 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:11.468042 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:11.508067 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9dfbdc-715b-4757-88d7-a99c484ab231 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:11.545704 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e529141-709e-4a58-82ac-628ce7cde932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:11.546332 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e529141-709e-4a58-82ac-628ce7cde932 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:11.546619 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e529141-709e-4a58-82ac-628ce7cde932 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:11.546891 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e529141-709e-4a58-82ac-628ce7cde932 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:11.557703 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e529141-709e-4a58-82ac-628ce7cde932 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:13:11.563081 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-4e529141-709e-4a58-82ac-628ce7cde932 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:13:11.563081 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:13:11.563081 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:13:11.563081 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:13:11.563081 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:13:11.563081 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:13:11.563081 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:13:11.563081 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:13:11.563081 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:13:11.563081 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:13:11.563081 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:13:11.563081 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:13:11.563081 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:13:11.563081 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:13:11.563081 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:13:11.563081 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:13:11.564187 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:13:11.564187 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:13:11.564187 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:13:11.564187 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:13:11.564187 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:13:11.564187 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:13:11.564187 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:13:11.564187 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:13:11.564187 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:13:11.564187 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:13:11.564187 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:13:11.564187 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:13:11.564187 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:13:11.564187 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:13:11.564187 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:13:11.564187 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:13:11.565129 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:13:11.565129 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:13:11.565129 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:13:11.565129 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:13:11.565129 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:13:11.565129 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:13:11.565129 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:13:11.565129 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:13:11.565129 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:13:11.565129 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:13:11.565129 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:13:11.565129 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:13:11.568651 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 26/49] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Aug 29 22:13:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:13:11.570171 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e3a6e-c11d-4756-ae4b-00153ca156c7 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:11.658814 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:11.675647 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e3a6e-c11d-4756-ae4b-00153ca156c7 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:11.711494 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da7067-ed76-44c2-b98d-d59f95926fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:11.712116 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da7067-ed76-44c2-b98d-d59f95926fd2 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:11.712397 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da7067-ed76-44c2-b98d-d59f95926fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:11.712696 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da7067-ed76-44c2-b98d-d59f95926fd2 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:11.713496 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48da7067-ed76-44c2-b98d-d59f95926fd2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:11.713837 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48da7067-ed76-44c2-b98d-d59f95926fd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:11.715238 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48da7067-ed76-44c2-b98d-d59f95926fd2 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:11.725596 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 24/50] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:13:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:11.726034 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7de6a-cea1-48e2-a708-9bb3059e43f3 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:11.726397 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7de6a-cea1-48e2-a708-9bb3059e43f3 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:11.726744 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7de6a-cea1-48e2-a708-9bb3059e43f3 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:11.728169 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 27/51] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:13:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:13:11.731476 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da7067-ed76-44c2-b98d-d59f95926fd2 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:11.735039 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af89586-1090-42e8-8654-95fc9873ffac None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:11.735367 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af89586-1090-42e8-8654-95fc9873ffac None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:11.735745 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af89586-1090-42e8-8654-95fc9873ffac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:11.753980 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-5af89586-1090-42e8-8654-95fc9873ffac None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:13:11.755222 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-5af89586-1090-42e8-8654-95fc9873ffac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:13:11.825740 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 28/52] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:13:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:13:11.848470 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da7067-ed76-44c2-b98d-d59f95926fd2 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:11.883345 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88348b64-21f2-4b83-a46d-900451d8d2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:11.883954 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88348b64-21f2-4b83-a46d-900451d8d2f9 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:11.884271 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88348b64-21f2-4b83-a46d-900451d8d2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:11.884585 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88348b64-21f2-4b83-a46d-900451d8d2f9 None admin] PATH_INFO: `/v3/users/6b5654a5750846779dda7b1bf48a68d8` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:11.886063 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88348b64-21f2-4b83-a46d-900451d8d2f9 None admin] RBAC: Authorizing `identity:get_user(user_id=6b5654a5750846779dda7b1bf48a68d8)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:11.887530 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88348b64-21f2-4b83-a46d-900451d8d2f9 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:11.889150 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 25/53] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Aug 29 22:13:11 2022] GET /identity/v3/users/6b5654a5750846779dda7b1bf48a68d8 => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:11.895332 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af89586-1090-42e8-8654-95fc9873ffac None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:11.952756 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:11.999094 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af89586-1090-42e8-8654-95fc9873ffac None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:12.034238 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2180e7bd-25ec-412d-b5b0-573fa2323d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:12.034890 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180e7bd-25ec-412d-b5b0-573fa2323d6c None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:12.035118 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180e7bd-25ec-412d-b5b0-573fa2323d6c None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:12.035636 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180e7bd-25ec-412d-b5b0-573fa2323d6c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:12.036797 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2180e7bd-25ec-412d-b5b0-573fa2323d6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:12.038268 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2180e7bd-25ec-412d-b5b0-573fa2323d6c None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:12.040109 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 29/54] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:13:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:12.046221 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88348b64-21f2-4b83-a46d-900451d8d2f9 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:12.066931 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:12.120138 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2180e7bd-25ec-412d-b5b0-573fa2323d6c None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:12.176178 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88348b64-21f2-4b83-a46d-900451d8d2f9 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:12.219995 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c3425-d81b-4f7e-9dc7-aa3f25820360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:12.220909 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c3425-d81b-4f7e-9dc7-aa3f25820360 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:12.221192 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c3425-d81b-4f7e-9dc7-aa3f25820360 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:12.221467 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c3425-d81b-4f7e-9dc7-aa3f25820360 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:12.222195 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c3425-d81b-4f7e-9dc7-aa3f25820360 None admin] RBAC: Adding query filter params (role.id=ff59a239a50b4bd899a83bf3c3fd1f63, scope.domain.id=default, user.id=6b5654a5750846779dda7b1bf48a68d8) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:12.222506 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c3425-d81b-4f7e-9dc7-aa3f25820360 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:12.223958 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c3425-d81b-4f7e-9dc7-aa3f25820360 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:12.230293 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 26/55] 10.222.0.36 () {56 vars in 1322 bytes} [Mon Aug 29 22:13:12 2022] GET /identity/v3/role_assignments?user.id=6b5654a5750846779dda7b1bf48a68d8&scope.domain.id=default&role.id=ff59a239a50b4bd899a83bf3c3fd1f63 => generated 530 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:12.237725 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2180e7bd-25ec-412d-b5b0-573fa2323d6c None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:12.267508 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:12.279788 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f18be-8194-4a76-87b5-29bd3454bb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:12.280471 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f18be-8194-4a76-87b5-29bd3454bb1b None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:12.280769 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f18be-8194-4a76-87b5-29bd3454bb1b None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:12.281045 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f18be-8194-4a76-87b5-29bd3454bb1b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:12.282246 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1f18be-8194-4a76-87b5-29bd3454bb1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:12.283743 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1f18be-8194-4a76-87b5-29bd3454bb1b None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:12.285492 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 30/56] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:13:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:12.291395 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c3425-d81b-4f7e-9dc7-aa3f25820360 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:12.379247 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:12.401405 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c3425-d81b-4f7e-9dc7-aa3f25820360 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:12.435633 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0e877-c214-4763-b1ea-8376aa0e79b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:12.436252 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0e877-c214-4763-b1ea-8376aa0e79b7 None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:12.436560 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0e877-c214-4763-b1ea-8376aa0e79b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:12.436817 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0e877-c214-4763-b1ea-8376aa0e79b7 None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:12.437469 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b0e877-c214-4763-b1ea-8376aa0e79b7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:12.438934 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b0e877-c214-4763-b1ea-8376aa0e79b7 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:12.467520 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 27/57] 10.222.0.36 () {60 vars in 1140 bytes} [Mon Aug 29 22:13:12 2022] POST /identity/v3/projects => generated 298 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:13:14.377420 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5a035-3c36-4639-a8af-6c575a3519b1 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:14.377962 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5a035-3c36-4639-a8af-6c575a3519b1 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:14.377962 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5a035-3c36-4639-a8af-6c575a3519b1 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:14.379296 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 31/58] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:13:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:13:14.385838 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5a6bb-dd26-4f33-becb-06b5072592f7 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:14.386302 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5a6bb-dd26-4f33-becb-06b5072592f7 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:14.386389 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5a6bb-dd26-4f33-becb-06b5072592f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:14.407460 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-6eb5a6bb-dd26-4f33-becb-06b5072592f7 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:13:14.408713 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-6eb5a6bb-dd26-4f33-becb-06b5072592f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:13:14.488628 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 28/59] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:13:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:13:14.748337 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e5a035-3c36-4639-a8af-6c575a3519b1 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:14.972427 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e5a035-3c36-4639-a8af-6c575a3519b1 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:15.010983 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a393dcb-f198-4b90-9023-489165928769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:15.011556 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a393dcb-f198-4b90-9023-489165928769 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:15.011843 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a393dcb-f198-4b90-9023-489165928769 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:15.012124 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a393dcb-f198-4b90-9023-489165928769 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:15.013457 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a393dcb-f198-4b90-9023-489165928769 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:15.014891 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a393dcb-f198-4b90-9023-489165928769 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:15.016805 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 32/60] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:13:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:15.022815 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb5a6bb-dd26-4f33-becb-06b5072592f7 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:15.086656 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:15.131713 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb5a6bb-dd26-4f33-becb-06b5072592f7 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:15.170046 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ecd6b6-80ca-488c-9012-fe17741f279b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:15.170658 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecd6b6-80ca-488c-9012-fe17741f279b None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:15.170944 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecd6b6-80ca-488c-9012-fe17741f279b None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:15.171218 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecd6b6-80ca-488c-9012-fe17741f279b None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:15.171867 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ecd6b6-80ca-488c-9012-fe17741f279b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:15.173366 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ecd6b6-80ca-488c-9012-fe17741f279b None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:15.203029 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 29/61] 10.222.0.36 () {60 vars in 1132 bytes} [Mon Aug 29 22:13:15 2022] POST /identity/v3/users => generated 275 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:13:18.397294 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7b2cc-3007-47ac-a869-422681259724 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:18.398094 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7b2cc-3007-47ac-a869-422681259724 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:18.398094 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7b2cc-3007-47ac-a869-422681259724 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:18.399414 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 33/62] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:13:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:13:18.404952 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5907852-4814-44c0-bbef-42b85c4f9062 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:18.405553 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5907852-4814-44c0-bbef-42b85c4f9062 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:18.405553 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5907852-4814-44c0-bbef-42b85c4f9062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:18.436742 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-e5907852-4814-44c0-bbef-42b85c4f9062 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:13:18.437966 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e5907852-4814-44c0-bbef-42b85c4f9062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:13:18.534660 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 30/63] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:13:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:13:18.755576 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be150f3-42e5-4ffb-9193-510a4ea3130d None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:18.755997 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be150f3-42e5-4ffb-9193-510a4ea3130d None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:18.755997 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be150f3-42e5-4ffb-9193-510a4ea3130d None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:18.757628 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 34/64] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:13:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:13:18.762820 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304c159-27a1-4635-be49-cec5b478bc64 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:18.763090 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304c159-27a1-4635-be49-cec5b478bc64 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:18.763372 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304c159-27a1-4635-be49-cec5b478bc64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:18.792330 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-6304c159-27a1-4635-be49-cec5b478bc64 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:13:18.793655 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-6304c159-27a1-4635-be49-cec5b478bc64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:13:18.843216 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:18.873307 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 31/65] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:13:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:13:19.025730 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ce981-027f-4da2-98c7-a85f155ad340 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:19.025960 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ce981-027f-4da2-98c7-a85f155ad340 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:19.026288 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ce981-027f-4da2-98c7-a85f155ad340 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:19.027644 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 35/66] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:13:19.035692 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e61b7e-fff3-4756-b30d-0a67ca880767 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:19.036537 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e61b7e-fff3-4756-b30d-0a67ca880767 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:19.037296 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e61b7e-fff3-4756-b30d-0a67ca880767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:19.064790 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-08e61b7e-fff3-4756-b30d-0a67ca880767 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:13:19.065995 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-08e61b7e-fff3-4756-b30d-0a67ca880767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:13:19.115637 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ce981-027f-4da2-98c7-a85f155ad340 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:19.184371 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 32/67] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:13:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:13:19.186663 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb669f6-52e4-4bb9-b15c-7a85fa763b4a None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:19.187171 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb669f6-52e4-4bb9-b15c-7a85fa763b4a None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:19.187647 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb669f6-52e4-4bb9-b15c-7a85fa763b4a None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:19.189975 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 33/68] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:13:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:13:19.190939 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:19.191247 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb669f6-52e4-4bb9-b15c-7a85fa763b4a None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:19.245303 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ce981-027f-4da2-98c7-a85f155ad340 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:19.285166 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6fda90-9358-4f12-969c-60c47d56deb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:19.286577 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6fda90-9358-4f12-969c-60c47d56deb7 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:19.287052 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6fda90-9358-4f12-969c-60c47d56deb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:19.287533 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6fda90-9358-4f12-969c-60c47d56deb7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:19.300702 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6fda90-9358-4f12-969c-60c47d56deb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:13:19.306666 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-8b6fda90-9358-4f12-969c-60c47d56deb7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:13:19.306666 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:13:19.306666 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:13:19.306666 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:13:19.306666 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:13:19.306666 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:13:19.306666 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:13:19.306666 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:13:19.306666 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:13:19.306666 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:13:19.306666 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:13:19.306666 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:13:19.306666 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:13:19.306666 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:13:19.306666 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:13:19.306666 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:13:19.307746 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:13:19.307746 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:13:19.307746 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:13:19.307746 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:13:19.307746 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:13:19.307746 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:13:19.307746 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:13:19.307746 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:13:19.307746 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:13:19.307746 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:13:19.307746 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:13:19.307746 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:13:19.307746 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:13:19.307746 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:13:19.307746 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:13:19.307746 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:13:19.308526 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:13:19.308526 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:13:19.308526 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:13:19.308526 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:13:19.308526 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:13:19.308526 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:13:19.308526 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:13:19.308526 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:13:19.308526 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:13:19.308526 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:13:19.308526 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:13:19.308526 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:13:19.315961 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 36/69] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:13:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:13:19.317321 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a07f38-9d36-4df7-9953-f2d82df2ee10 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:19.317801 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a07f38-9d36-4df7-9953-f2d82df2ee10 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:19.318528 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a07f38-9d36-4df7-9953-f2d82df2ee10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:19.339191 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-b5a07f38-9d36-4df7-9953-f2d82df2ee10 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:13:19.341002 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b5a07f38-9d36-4df7-9953-f2d82df2ee10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:13:19.377700 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb669f6-52e4-4bb9-b15c-7a85fa763b4a None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:19.395736 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:19.418204 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 37/70] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:13:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:13:19.419685 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a07f38-9d36-4df7-9953-f2d82df2ee10 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:19.441980 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451622cf-447d-49ca-93e1-a94d1ce3fd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:19.443982 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451622cf-447d-49ca-93e1-a94d1ce3fd21 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:19.444728 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451622cf-447d-49ca-93e1-a94d1ce3fd21 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:19.445470 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451622cf-447d-49ca-93e1-a94d1ce3fd21 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:19.462180 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451622cf-447d-49ca-93e1-a94d1ce3fd21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:13:19.467337 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-451622cf-447d-49ca-93e1-a94d1ce3fd21 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:13:19.467337 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:13:19.467337 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:13:19.467337 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:13:19.467337 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:13:19.467337 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:13:19.467337 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:13:19.467337 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:13:19.467337 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:13:19.467337 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:13:19.467337 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:13:19.467337 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:13:19.467337 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:13:19.467337 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:13:19.467337 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:13:19.467337 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:13:19.468191 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:13:19.468191 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:13:19.468191 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:13:19.468191 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:13:19.468191 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:13:19.468191 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:13:19.468191 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:13:19.468191 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:13:19.468191 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:13:19.468191 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:13:19.468191 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:13:19.468191 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:13:19.468191 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:13:19.468191 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:13:19.468191 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:13:19.468191 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:13:19.469018 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:13:19.469018 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:13:19.469018 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:13:19.469018 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:13:19.469018 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:13:19.469018 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:13:19.469018 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:13:19.469018 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:13:19.469018 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:13:19.469018 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:13:19.469018 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:13:19.469018 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:13:19.469018 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 34/71] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Aug 29 22:13:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:13:19.469637 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451622cf-447d-49ca-93e1-a94d1ce3fd21 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:19.495647 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:19.568328 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a07f38-9d36-4df7-9953-f2d82df2ee10 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:19.586837 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451622cf-447d-49ca-93e1-a94d1ce3fd21 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:19.614595 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc2bda0-99ee-43f9-a1f2-89f5bb66450b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:19.615474 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2bda0-99ee-43f9-a1f2-89f5bb66450b None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:19.615888 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2bda0-99ee-43f9-a1f2-89f5bb66450b None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:19.616756 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2bda0-99ee-43f9-a1f2-89f5bb66450b None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:19.618448 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc2bda0-99ee-43f9-a1f2-89f5bb66450b None admin] RBAC: Adding query filter params (name=member) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:19.619106 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc2bda0-99ee-43f9-a1f2-89f5bb66450b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:19.621388 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc2bda0-99ee-43f9-a1f2-89f5bb66450b None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:19.625968 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6884574d-f0e7-407b-9ec2-04148c1e1f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:19.626926 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6884574d-f0e7-407b-9ec2-04148c1e1f0a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:19.627407 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6884574d-f0e7-407b-9ec2-04148c1e1f0a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:19.627880 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6884574d-f0e7-407b-9ec2-04148c1e1f0a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:19.640154 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6884574d-f0e7-407b-9ec2-04148c1e1f0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:13:19.642239 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 38/72] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Aug 29 22:13:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:19.643894 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc2bda0-99ee-43f9-a1f2-89f5bb66450b None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:19.645775 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-6884574d-f0e7-407b-9ec2-04148c1e1f0a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:13:19.645775 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:13:19.645775 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:13:19.645775 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:13:19.645775 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:13:19.645775 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:13:19.645775 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:13:19.645775 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:13:19.645775 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:13:19.645775 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:13:19.645775 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:13:19.645775 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:13:19.645775 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:13:19.645775 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:13:19.645775 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:13:19.645775 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:13:19.646808 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:13:19.646808 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:13:19.646808 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:13:19.646808 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:13:19.646808 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:13:19.646808 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:13:19.646808 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:13:19.646808 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:13:19.646808 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:13:19.646808 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:13:19.646808 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:13:19.646808 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:13:19.646808 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:13:19.646808 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:13:19.646808 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:13:19.646808 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:13:19.647599 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:13:19.647599 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:13:19.647599 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:13:19.647599 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:13:19.647599 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:13:19.647599 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:13:19.647599 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:13:19.647599 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:13:19.647599 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:13:19.647599 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:13:19.647599 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:13:19.647599 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:13:19.654513 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 35/73] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Aug 29 22:13:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:13:19.654513 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acad459-3389-406a-a455-8cc771976ccd None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:19.654513 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acad459-3389-406a-a455-8cc771976ccd None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:19.654513 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acad459-3389-406a-a455-8cc771976ccd None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:19.656318 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 36/74] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:13:19.660983 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acad459-3389-406a-a455-8cc771976ccd None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:19.692782 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:19.768763 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acad459-3389-406a-a455-8cc771976ccd None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:19.771934 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc2bda0-99ee-43f9-a1f2-89f5bb66450b None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:19.784839 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:19.802773 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c74b15-3ea6-47a1-8848-9fa47fbbf45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:19.803420 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c74b15-3ea6-47a1-8848-9fa47fbbf45f None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:19.803707 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c74b15-3ea6-47a1-8848-9fa47fbbf45f None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:19.803985 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c74b15-3ea6-47a1-8848-9fa47fbbf45f None admin] PATH_INFO: `/v3/users/a107bc03b1f041ceb3d4a7e34f3699ab` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:19.806852 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4196535d-d48c-4393-9e28-129afa4f0f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:19.807636 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4196535d-d48c-4393-9e28-129afa4f0f9e None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:19.807924 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4196535d-d48c-4393-9e28-129afa4f0f9e None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:19.808199 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4196535d-d48c-4393-9e28-129afa4f0f9e None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:19.808904 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4196535d-d48c-4393-9e28-129afa4f0f9e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:19.809212 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4196535d-d48c-4393-9e28-129afa4f0f9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:19.810609 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4196535d-d48c-4393-9e28-129afa4f0f9e None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:19.817512 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c74b15-3ea6-47a1-8848-9fa47fbbf45f None admin] RBAC: Authorizing `identity:get_user(user_id=a107bc03b1f041ceb3d4a7e34f3699ab)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:19.818775 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 39/75] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:13:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:19.818948 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c74b15-3ea6-47a1-8848-9fa47fbbf45f None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:19.819510 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4196535d-d48c-4393-9e28-129afa4f0f9e None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:19.820723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 37/76] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Aug 29 22:13:19 2022] GET /identity/v3/users/a107bc03b1f041ceb3d4a7e34f3699ab => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:19.826363 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2009e-f07a-48a1-9b8b-bf27b3d75f8d None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:19.826650 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2009e-f07a-48a1-9b8b-bf27b3d75f8d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:19.826928 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2009e-f07a-48a1-9b8b-bf27b3d75f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:19.844151 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-12b2009e-f07a-48a1-9b8b-bf27b3d75f8d None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:13:19.845380 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-12b2009e-f07a-48a1-9b8b-bf27b3d75f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:13:19.916676 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 38/77] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:13:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:13:19.917526 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b2009e-f07a-48a1-9b8b-bf27b3d75f8d None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:19.922569 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4196535d-d48c-4393-9e28-129afa4f0f9e None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:19.937624 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:19.958525 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b7aff-96d7-492d-aaa0-97620fed073a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:19.959140 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b7aff-96d7-492d-aaa0-97620fed073a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:19.959423 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b7aff-96d7-492d-aaa0-97620fed073a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:19.959695 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b7aff-96d7-492d-aaa0-97620fed073a None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:19.960362 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26b7aff-96d7-492d-aaa0-97620fed073a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:19.960760 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26b7aff-96d7-492d-aaa0-97620fed073a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:19.962191 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26b7aff-96d7-492d-aaa0-97620fed073a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:19.970543 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 40/78] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Aug 29 22:13:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:19.971349 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b7aff-96d7-492d-aaa0-97620fed073a None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:20.009986 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:20.046302 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b2009e-f07a-48a1-9b8b-bf27b3d75f8d None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:20.078812 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b7aff-96d7-492d-aaa0-97620fed073a None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:20.083239 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e51f4-f3d4-4098-b680-99f35d8c9550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:20.083884 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e51f4-f3d4-4098-b680-99f35d8c9550 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:20.084165 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e51f4-f3d4-4098-b680-99f35d8c9550 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:20.084433 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e51f4-f3d4-4098-b680-99f35d8c9550 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:20.095909 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5e51f4-f3d4-4098-b680-99f35d8c9550 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:13:20.100742 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-1d5e51f4-f3d4-4098-b680-99f35d8c9550 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:13:20.100742 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:13:20.100742 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:13:20.100742 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:13:20.100742 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:13:20.100742 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:13:20.100742 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:13:20.100742 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:13:20.100742 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:13:20.100742 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:13:20.100742 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:13:20.100742 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:13:20.100742 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:13:20.100742 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:13:20.100742 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:13:20.100742 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:13:20.101610 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:13:20.101610 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:13:20.101610 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:13:20.101610 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:13:20.101610 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:13:20.101610 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:13:20.101610 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:13:20.101610 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:13:20.101610 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:13:20.101610 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:13:20.101610 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:13:20.101610 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:13:20.101610 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:13:20.101610 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:13:20.101610 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:13:20.101610 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:13:20.102383 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:13:20.102383 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:13:20.102383 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:13:20.102383 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:13:20.102383 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:13:20.102383 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:13:20.102383 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:13:20.102383 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:13:20.102383 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:13:20.102383 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:13:20.102383 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:13:20.102383 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:13:20.102383 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 39/79] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:13:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:13:20.103373 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e51f4-f3d4-4098-b680-99f35d8c9550 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:20.120356 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc15f68-de16-49b2-bae9-65a996ee16ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:20.121058 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc15f68-de16-49b2-bae9-65a996ee16ac None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:20.121362 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc15f68-de16-49b2-bae9-65a996ee16ac None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:20.121639 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc15f68-de16-49b2-bae9-65a996ee16ac None admin] PATH_INFO: `/v3/users/6b5654a5750846779dda7b1bf48a68d8` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:20.122790 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc15f68-de16-49b2-bae9-65a996ee16ac None admin] RBAC: Authorizing `identity:get_user(user_id=6b5654a5750846779dda7b1bf48a68d8)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:20.124233 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc15f68-de16-49b2-bae9-65a996ee16ac None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:20.130464 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 41/80] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Aug 29 22:13:19 2022] GET /identity/v3/users/6b5654a5750846779dda7b1bf48a68d8 => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:20.130464 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc15f68-de16-49b2-bae9-65a996ee16ac None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:20.189493 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:20.212562 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e51f4-f3d4-4098-b680-99f35d8c9550 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:20.240161 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc15f68-de16-49b2-bae9-65a996ee16ac None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:20.242891 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:20.248072 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358b3b8-4b50-4eb5-ad1a-71bc867e80a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:20.248740 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358b3b8-4b50-4eb5-ad1a-71bc867e80a0 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:20.249025 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358b3b8-4b50-4eb5-ad1a-71bc867e80a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:20.249299 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358b3b8-4b50-4eb5-ad1a-71bc867e80a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:20.274857 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13870b6b-8ce1-411a-b8cb-b547e2ea7438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:20.275581 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13870b6b-8ce1-411a-b8cb-b547e2ea7438 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:20.275867 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13870b6b-8ce1-411a-b8cb-b547e2ea7438 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:20.276139 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13870b6b-8ce1-411a-b8cb-b547e2ea7438 None admin] PATH_INFO: `/v3/users/a107bc03b1f041ceb3d4a7e34f3699ab` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:20.277297 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13870b6b-8ce1-411a-b8cb-b547e2ea7438 None admin] RBAC: Authorizing `identity:get_user(user_id=a107bc03b1f041ceb3d4a7e34f3699ab)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:20.278762 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13870b6b-8ce1-411a-b8cb-b547e2ea7438 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:20.280533 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 42/81] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Aug 29 22:13:20 2022] GET /identity/v3/users/a107bc03b1f041ceb3d4a7e34f3699ab => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:20.281133 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13870b6b-8ce1-411a-b8cb-b547e2ea7438 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:20.327009 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b358b3b8-4b50-4eb5-ad1a-71bc867e80a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:20.328657 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b358b3b8-4b50-4eb5-ad1a-71bc867e80a0 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:20.382287 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13870b6b-8ce1-411a-b8cb-b547e2ea7438 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:20.402427 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:20.417366 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7fa2c-3e40-4829-b227-54084ac87d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:20.417986 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7fa2c-3e40-4829-b227-54084ac87d32 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:20.418275 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7fa2c-3e40-4829-b227-54084ac87d32 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:20.418832 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7fa2c-3e40-4829-b227-54084ac87d32 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:20.419218 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf7fa2c-3e40-4829-b227-54084ac87d32 None admin] RBAC: Adding query filter params (name=member) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:20.419526 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf7fa2c-3e40-4829-b227-54084ac87d32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:20.420978 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf7fa2c-3e40-4829-b227-54084ac87d32 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:20.427510 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 40/82] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:13:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:13:20.428118 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358b3b8-4b50-4eb5-ad1a-71bc867e80a0 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:20.429904 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 43/83] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Aug 29 22:13:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:20.430587 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7fa2c-3e40-4829-b227-54084ac87d32 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:20.465033 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:20.531681 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7fa2c-3e40-4829-b227-54084ac87d32 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:20.532540 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358b3b8-4b50-4eb5-ad1a-71bc867e80a0 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:20.565151 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0306ce-66e0-45d9-8122-756feca5ae9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:20.565786 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0306ce-66e0-45d9-8122-756feca5ae9b None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:20.566064 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0306ce-66e0-45d9-8122-756feca5ae9b None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:20.566336 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0306ce-66e0-45d9-8122-756feca5ae9b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:20.567432 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0306ce-66e0-45d9-8122-756feca5ae9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:20.568919 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0306ce-66e0-45d9-8122-756feca5ae9b None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:20.569108 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c979f10f-160b-4acb-acf6-05ac492e9315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:20.569727 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979f10f-160b-4acb-acf6-05ac492e9315 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:20.570011 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979f10f-160b-4acb-acf6-05ac492e9315 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:20.570288 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979f10f-160b-4acb-acf6-05ac492e9315 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:20.570464 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 44/84] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:13:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:20.571239 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0306ce-66e0-45d9-8122-756feca5ae9b None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:20.616280 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:20.640833 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c979f10f-160b-4acb-acf6-05ac492e9315 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:20.642561 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c979f10f-160b-4acb-acf6-05ac492e9315 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:20.669251 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0306ce-66e0-45d9-8122-756feca5ae9b None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:20.670766 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:20.703792 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4945b6-6298-47ba-9906-c75f1ee1dd3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:20.704355 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4945b6-6298-47ba-9906-c75f1ee1dd3b None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:20.704691 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4945b6-6298-47ba-9906-c75f1ee1dd3b None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:20.704938 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4945b6-6298-47ba-9906-c75f1ee1dd3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:20.740108 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 41/85] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:13:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:13:20.740987 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c979f10f-160b-4acb-acf6-05ac492e9315 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:20.778210 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4945b6-6298-47ba-9906-c75f1ee1dd3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:20.779682 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4945b6-6298-47ba-9906-c75f1ee1dd3b None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:20.817112 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:20.841505 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c979f10f-160b-4acb-acf6-05ac492e9315 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:20.878330 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df406bd-21ca-4f25-8684-6001928402e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:20.878998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df406bd-21ca-4f25-8684-6001928402e9 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:20.879301 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df406bd-21ca-4f25-8684-6001928402e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:20.879606 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df406bd-21ca-4f25-8684-6001928402e9 None admin] PATH_INFO: `/v3/users/a107bc03b1f041ceb3d4a7e34f3699ab` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:20.880832 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df406bd-21ca-4f25-8684-6001928402e9 None admin] RBAC: Authorizing `identity:get_user(user_id=a107bc03b1f041ceb3d4a7e34f3699ab)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:20.882166 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 45/86] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:13:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:13:20.882332 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df406bd-21ca-4f25-8684-6001928402e9 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:20.883011 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4945b6-6298-47ba-9906-c75f1ee1dd3b None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:20.888688 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 42/87] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Aug 29 22:13:20 2022] GET /identity/v3/users/a107bc03b1f041ceb3d4a7e34f3699ab => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:20.888688 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df406bd-21ca-4f25-8684-6001928402e9 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:20.889273 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:20.986580 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4945b6-6298-47ba-9906-c75f1ee1dd3b None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:20.989126 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df406bd-21ca-4f25-8684-6001928402e9 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:21.021655 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aee5ad-6170-4598-95e5-c21ea3bc35cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:21.022300 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aee5ad-6170-4598-95e5-c21ea3bc35cd None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:21.022584 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aee5ad-6170-4598-95e5-c21ea3bc35cd None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:21.022858 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aee5ad-6170-4598-95e5-c21ea3bc35cd None admin] PATH_INFO: `/v3/projects/72e0b172f95b4686aa832057c998ddbe` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:21.023336 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf8be7-4f23-482f-9132-5df1b13830c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:21.023956 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf8be7-4f23-482f-9132-5df1b13830c8 None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:21.024053 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aee5ad-6170-4598-95e5-c21ea3bc35cd None admin] RBAC: Authorizing `identity:get_project(project_id=72e0b172f95b4686aa832057c998ddbe)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:21.024240 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf8be7-4f23-482f-9132-5df1b13830c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:21.024552 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf8be7-4f23-482f-9132-5df1b13830c8 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:21.025203 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf8be7-4f23-482f-9132-5df1b13830c8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:21.025511 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aee5ad-6170-4598-95e5-c21ea3bc35cd None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:21.026980 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf8be7-4f23-482f-9132-5df1b13830c8 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:21.027145 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 46/88] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Aug 29 22:13:20 2022] GET /identity/v3/projects/72e0b172f95b4686aa832057c998ddbe => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:21.027890 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aee5ad-6170-4598-95e5-c21ea3bc35cd None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:21.046158 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:21.056510 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 43/89] 10.222.0.36 () {60 vars in 1132 bytes} [Mon Aug 29 22:13:20 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:13:21.056510 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf8be7-4f23-482f-9132-5df1b13830c8 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:21.122102 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:21.166253 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aee5ad-6170-4598-95e5-c21ea3bc35cd None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:21.180707 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf8be7-4f23-482f-9132-5df1b13830c8 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:21.207341 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9016aaf-64dc-484e-9faf-1b7f7b0e34dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:21.207993 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9016aaf-64dc-484e-9faf-1b7f7b0e34dd None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:21.208278 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9016aaf-64dc-484e-9faf-1b7f7b0e34dd None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:21.208588 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9016aaf-64dc-484e-9faf-1b7f7b0e34dd None admin] PATH_INFO: `/v3/projects/72e0b172f95b4686aa832057c998ddbe` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:21.210025 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9016aaf-64dc-484e-9faf-1b7f7b0e34dd None admin] RBAC: Authorizing `identity:get_project(project_id=72e0b172f95b4686aa832057c998ddbe)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:21.212331 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9016aaf-64dc-484e-9faf-1b7f7b0e34dd None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:21.214784 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 47/90] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Aug 29 22:13:21 2022] GET /identity/v3/projects/72e0b172f95b4686aa832057c998ddbe => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:21.215664 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9016aaf-64dc-484e-9faf-1b7f7b0e34dd None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:21.220184 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f74ba-c3c3-44bb-9ce8-84313d352ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:21.220803 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f74ba-c3c3-44bb-9ce8-84313d352ae6 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:21.221090 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f74ba-c3c3-44bb-9ce8-84313d352ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:21.221366 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f74ba-c3c3-44bb-9ce8-84313d352ae6 None admin] PATH_INFO: `/v3/projects/72e0b172f95b4686aa832057c998ddbe` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:21.222592 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296f74ba-c3c3-44bb-9ce8-84313d352ae6 None admin] RBAC: Authorizing `identity:get_project(project_id=72e0b172f95b4686aa832057c998ddbe)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:21.224053 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296f74ba-c3c3-44bb-9ce8-84313d352ae6 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:21.225739 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 44/91] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Aug 29 22:13:21 2022] GET /identity/v3/projects/72e0b172f95b4686aa832057c998ddbe => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:21.226508 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f74ba-c3c3-44bb-9ce8-84313d352ae6 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:21.318519 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:21.350696 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9016aaf-64dc-484e-9faf-1b7f7b0e34dd None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:21.367422 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f74ba-c3c3-44bb-9ce8-84313d352ae6 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:21.399923 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb46ea-6524-4eac-b9a7-1c08e92fcabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:21.400999 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb46ea-6524-4eac-b9a7-1c08e92fcabb None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:21.402245 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb46ea-6524-4eac-b9a7-1c08e92fcabb None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:21.402245 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb46ea-6524-4eac-b9a7-1c08e92fcabb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:21.417859 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab0bed-b7c4-4b59-92f4-91165c067197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:21.417859 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab0bed-b7c4-4b59-92f4-91165c067197 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:21.417859 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab0bed-b7c4-4b59-92f4-91165c067197 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:21.417859 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab0bed-b7c4-4b59-92f4-91165c067197 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:21.418263 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ab0bed-b7c4-4b59-92f4-91165c067197 None admin] RBAC: Adding query filter params (role.id=c358a37c24fe42bca4a93331f2c99d90, scope.project.id=72e0b172f95b4686aa832057c998ddbe, user.id=a107bc03b1f041ceb3d4a7e34f3699ab) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:21.418263 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ab0bed-b7c4-4b59-92f4-91165c067197 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:21.418263 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ab0bed-b7c4-4b59-92f4-91165c067197 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:21.418932 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:21.427656 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 45/92] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Aug 29 22:13:21 2022] GET /identity/v3/role_assignments?user.id=a107bc03b1f041ceb3d4a7e34f3699ab&scope.project.id=72e0b172f95b4686aa832057c998ddbe&role.id=c358a37c24fe42bca4a93331f2c99d90 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:21.428896 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab0bed-b7c4-4b59-92f4-91165c067197 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:21.487658 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fb46ea-6524-4eac-b9a7-1c08e92fcabb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:21.489360 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fb46ea-6524-4eac-b9a7-1c08e92fcabb None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:21.604015 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 48/93] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:13:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:13:21.605031 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb46ea-6524-4eac-b9a7-1c08e92fcabb None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:21.651487 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:21.653653 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab0bed-b7c4-4b59-92f4-91165c067197 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:21.689435 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:21.695228 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593694f8-b0e5-4278-9d70-6494b0829420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:21.695867 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593694f8-b0e5-4278-9d70-6494b0829420 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:21.696153 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593694f8-b0e5-4278-9d70-6494b0829420 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:21.696428 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593694f8-b0e5-4278-9d70-6494b0829420 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:21.697366 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593694f8-b0e5-4278-9d70-6494b0829420 None admin] RBAC: Adding query filter params (role.id=ff59a239a50b4bd899a83bf3c3fd1f63, scope.project.id=72e0b172f95b4686aa832057c998ddbe, user.id=6b5654a5750846779dda7b1bf48a68d8) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:21.697679 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593694f8-b0e5-4278-9d70-6494b0829420 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:21.699156 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593694f8-b0e5-4278-9d70-6494b0829420 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:21.707411 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 46/94] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Aug 29 22:13:21 2022] GET /identity/v3/role_assignments?user.id=6b5654a5750846779dda7b1bf48a68d8&scope.project.id=72e0b172f95b4686aa832057c998ddbe&role.id=ff59a239a50b4bd899a83bf3c3fd1f63 => generated 259 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:21.708245 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593694f8-b0e5-4278-9d70-6494b0829420 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:21.724409 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb46ea-6524-4eac-b9a7-1c08e92fcabb None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:21.765133 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d85e8-750c-42c1-af4a-6bc9b834a0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:21.765777 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d85e8-750c-42c1-af4a-6bc9b834a0c3 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:21.766376 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d85e8-750c-42c1-af4a-6bc9b834a0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:21.766659 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d85e8-750c-42c1-af4a-6bc9b834a0c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:21.767420 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66d85e8-750c-42c1-af4a-6bc9b834a0c3 None admin] RBAC: Adding query filter params (role.id=8767fe0bd994478fac741fc8c76f649e, scope.project.id=72e0b172f95b4686aa832057c998ddbe, user.id=a107bc03b1f041ceb3d4a7e34f3699ab) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:21.767736 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66d85e8-750c-42c1-af4a-6bc9b834a0c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:21.769283 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66d85e8-750c-42c1-af4a-6bc9b834a0c3 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:21.779506 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 49/95] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Aug 29 22:13:21 2022] GET /identity/v3/role_assignments?user.id=a107bc03b1f041ceb3d4a7e34f3699ab&scope.project.id=72e0b172f95b4686aa832057c998ddbe&role.id=8767fe0bd994478fac741fc8c76f649e => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:21.859864 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593694f8-b0e5-4278-9d70-6494b0829420 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:21.907408 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ffaecc-4bbe-422d-ac72-9b90a5d62838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:21.908085 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffaecc-4bbe-422d-ac72-9b90a5d62838 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:21.908375 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffaecc-4bbe-422d-ac72-9b90a5d62838 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:21.908693 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffaecc-4bbe-422d-ac72-9b90a5d62838 None admin] PATH_INFO: `/v3/projects/1c70b5e26a7749d68e05e4c899c6fed7` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:21.910018 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ffaecc-4bbe-422d-ac72-9b90a5d62838 None admin] RBAC: Authorizing `identity:get_project(project_id=1c70b5e26a7749d68e05e4c899c6fed7)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:21.911610 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ffaecc-4bbe-422d-ac72-9b90a5d62838 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:21.913719 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 47/96] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Aug 29 22:13:21 2022] GET /identity/v3/projects/1c70b5e26a7749d68e05e4c899c6fed7 => generated 312 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:21.919936 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d85e8-750c-42c1-af4a-6bc9b834a0c3 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:22.047434 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d85e8-750c-42c1-af4a-6bc9b834a0c3 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:22.049092 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:22.090153 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330e925-9c51-4e3a-96eb-6cabd4cce942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:22.090784 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330e925-9c51-4e3a-96eb-6cabd4cce942 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:22.091068 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330e925-9c51-4e3a-96eb-6cabd4cce942 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:22.091343 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330e925-9c51-4e3a-96eb-6cabd4cce942 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:22.092093 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2330e925-9c51-4e3a-96eb-6cabd4cce942 None admin] RBAC: Adding query filter params (role.id=c358a37c24fe42bca4a93331f2c99d90, scope.project.id=1c70b5e26a7749d68e05e4c899c6fed7, user.id=a107bc03b1f041ceb3d4a7e34f3699ab) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:22.092403 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2330e925-9c51-4e3a-96eb-6cabd4cce942 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:22.093893 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2330e925-9c51-4e3a-96eb-6cabd4cce942 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:22.101428 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 50/97] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Aug 29 22:13:21 2022] GET /identity/v3/role_assignments?user.id=a107bc03b1f041ceb3d4a7e34f3699ab&scope.project.id=1c70b5e26a7749d68e05e4c899c6fed7&role.id=c358a37c24fe42bca4a93331f2c99d90 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:23.495311 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069abc8f-d191-4d74-9073-04b7ba0225a2 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:23.495887 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069abc8f-d191-4d74-9073-04b7ba0225a2 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:23.495887 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069abc8f-d191-4d74-9073-04b7ba0225a2 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:23.497340 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 48/98] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:13:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:13:23.510160 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6547a-427c-4cac-b941-ef7096f7fb65 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:23.511117 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6547a-427c-4cac-b941-ef7096f7fb65 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:23.511621 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6547a-427c-4cac-b941-ef7096f7fb65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:23.534101 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-83c6547a-427c-4cac-b941-ef7096f7fb65 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:13:23.535666 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-83c6547a-427c-4cac-b941-ef7096f7fb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:13:23.618809 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 51/99] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:13:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:13:24.154661 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069abc8f-d191-4d74-9073-04b7ba0225a2 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:24.229565 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:24.279376 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069abc8f-d191-4d74-9073-04b7ba0225a2 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:24.286599 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4294b8d-55c6-4564-a8d3-ab21e17aae11 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:24.286888 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4294b8d-55c6-4564-a8d3-ab21e17aae11 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:24.287165 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4294b8d-55c6-4564-a8d3-ab21e17aae11 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:24.288679 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 52/100] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:13:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:13:24.294311 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7699b-73bb-4e04-8a6f-0db3570d7bf3 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:24.294858 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7699b-73bb-4e04-8a6f-0db3570d7bf3 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:24.295326 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7699b-73bb-4e04-8a6f-0db3570d7bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:24.315978 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-d8b7699b-73bb-4e04-8a6f-0db3570d7bf3 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:13:24.318364 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d8b7699b-73bb-4e04-8a6f-0db3570d7bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:13:24.332312 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c65f0f-7497-448e-9793-c55c9319e024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:24.333107 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c65f0f-7497-448e-9793-c55c9319e024 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:24.333397 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c65f0f-7497-448e-9793-c55c9319e024 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:24.333676 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c65f0f-7497-448e-9793-c55c9319e024 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:24.355774 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c65f0f-7497-448e-9793-c55c9319e024 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:13:24.362519 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-22c65f0f-7497-448e-9793-c55c9319e024 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:13:24.362519 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:13:24.362519 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:13:24.362519 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:13:24.362519 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:13:24.362519 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:13:24.362519 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:13:24.362519 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:13:24.362519 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:13:24.362519 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:13:24.362519 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:13:24.362519 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:13:24.362519 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:13:24.362519 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:13:24.362519 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:13:24.362519 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:13:24.363393 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:13:24.363393 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:13:24.363393 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:13:24.363393 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:13:24.363393 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:13:24.363393 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:13:24.363393 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:13:24.363393 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:13:24.363393 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:13:24.363393 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:13:24.363393 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:13:24.363393 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:13:24.363393 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:13:24.363393 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:13:24.363393 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:13:24.363393 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:13:24.364251 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:13:24.364251 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:13:24.364251 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:13:24.364251 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:13:24.364251 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:13:24.364251 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:13:24.364251 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:13:24.364251 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:13:24.364251 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:13:24.364251 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:13:24.364251 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:13:24.364251 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:13:24.368090 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 49/101] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:13:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:13:24.374997 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566c0a7-6332-4f95-82f1-d226d3961d8f None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:24.376293 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566c0a7-6332-4f95-82f1-d226d3961d8f None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:24.377454 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566c0a7-6332-4f95-82f1-d226d3961d8f None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:24.381136 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 50/102] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:13:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:13:24.386241 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7566c0a7-6332-4f95-82f1-d226d3961d8f None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:24.493973 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 53/103] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:13:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:13:24.495377 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec8a18-9ad3-4487-8fa4-8d3d8099dbec None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:24.495672 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec8a18-9ad3-4487-8fa4-8d3d8099dbec None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:24.496003 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec8a18-9ad3-4487-8fa4-8d3d8099dbec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:24.503232 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7566c0a7-6332-4f95-82f1-d226d3961d8f None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:24.531003 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:24.533547 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-eeec8a18-9ad3-4487-8fa4-8d3d8099dbec None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:13:24.534823 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-eeec8a18-9ad3-4487-8fa4-8d3d8099dbec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:13:24.545401 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f9566-57a3-48b8-99dd-063748c7cd22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:24.546356 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f9566-57a3-48b8-99dd-063748c7cd22 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:24.546852 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f9566-57a3-48b8-99dd-063748c7cd22 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:24.547335 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f9566-57a3-48b8-99dd-063748c7cd22 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:24.548196 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511f9566-57a3-48b8-99dd-063748c7cd22 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:24.548724 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511f9566-57a3-48b8-99dd-063748c7cd22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:24.550453 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511f9566-57a3-48b8-99dd-063748c7cd22 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:24.560324 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 51/104] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Aug 29 22:13:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:24.572885 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:24.577557 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f9566-57a3-48b8-99dd-063748c7cd22 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:24.686103 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f9566-57a3-48b8-99dd-063748c7cd22 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:24.706317 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 54/105] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:13:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:13:24.707608 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582d257-83fb-4ced-9b4a-2a1f462e94ea None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:24.707899 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582d257-83fb-4ced-9b4a-2a1f462e94ea None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:24.708173 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582d257-83fb-4ced-9b4a-2a1f462e94ea None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:24.709449 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 55/106] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:13:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:13:24.715032 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa765d-ca20-4c65-91d7-3c64f80d995b None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:24.715423 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa765d-ca20-4c65-91d7-3c64f80d995b None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:24.715650 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa765d-ca20-4c65-91d7-3c64f80d995b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:24.725060 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e8cd4-2f97-4d12-8e34-0e2f86b26632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:24.726202 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e8cd4-2f97-4d12-8e34-0e2f86b26632 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:24.726695 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e8cd4-2f97-4d12-8e34-0e2f86b26632 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:24.727230 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e8cd4-2f97-4d12-8e34-0e2f86b26632 None admin] PATH_INFO: `/v3/users/dce5a2b9e2a34b80a10cf521b36c532b` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:24.743033 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407e8cd4-2f97-4d12-8e34-0e2f86b26632 None admin] RBAC: Authorizing `identity:get_user(user_id=dce5a2b9e2a34b80a10cf521b36c532b)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:24.745085 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407e8cd4-2f97-4d12-8e34-0e2f86b26632 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:24.747079 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 52/107] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Aug 29 22:13:24 2022] GET /identity/v3/users/dce5a2b9e2a34b80a10cf521b36c532b => generated 289 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:13:24.751970 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-f7fa765d-ca20-4c65-91d7-3c64f80d995b None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:13:24.751970 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f7fa765d-ca20-4c65-91d7-3c64f80d995b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:13:24.753197 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e8cd4-2f97-4d12-8e34-0e2f86b26632 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:24.847359 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:24.888221 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 56/108] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:13:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:13:24.896137 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa765d-ca20-4c65-91d7-3c64f80d995b None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:24.955663 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e8cd4-2f97-4d12-8e34-0e2f86b26632 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:25.030662 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb9a8cd-82fe-4b6d-9a1b-8a1c35905db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:25.031203 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb9a8cd-82fe-4b6d-9a1b-8a1c35905db4 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:25.031796 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb9a8cd-82fe-4b6d-9a1b-8a1c35905db4 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:25.032080 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb9a8cd-82fe-4b6d-9a1b-8a1c35905db4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:25.052865 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:25.063547 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa765d-ca20-4c65-91d7-3c64f80d995b None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:25.098986 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab96266-e005-4291-937b-a019b8ba8138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:25.099950 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab96266-e005-4291-937b-a019b8ba8138 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:25.100425 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab96266-e005-4291-937b-a019b8ba8138 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:25.100916 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab96266-e005-4291-937b-a019b8ba8138 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:25.102226 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab96266-e005-4291-937b-a019b8ba8138 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:25.103967 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab96266-e005-4291-937b-a019b8ba8138 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:25.104950 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb9a8cd-82fe-4b6d-9a1b-8a1c35905db4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:25.106289 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 57/109] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:13:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:25.106459 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb9a8cd-82fe-4b6d-9a1b-8a1c35905db4 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:25.112152 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a1793-264a-4c0e-8a78-6c8e3fdaa996 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:25.112756 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a1793-264a-4c0e-8a78-6c8e3fdaa996 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:25.113235 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a1793-264a-4c0e-8a78-6c8e3fdaa996 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:25.114759 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 58/110] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:13:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:13:25.116060 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a566d24b-a616-4a1d-a4f4-4603275975b1 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:25.116572 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a566d24b-a616-4a1d-a4f4-4603275975b1 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:25.117057 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a566d24b-a616-4a1d-a4f4-4603275975b1 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:25.118467 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 59/111] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:13:25.119413 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a566d24b-a616-4a1d-a4f4-4603275975b1 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:25.156522 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:25.214389 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 53/112] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:13:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:13:25.215669 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87941634-553d-457e-bb35-9e983da49058 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:25.215965 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87941634-553d-457e-bb35-9e983da49058 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:25.216247 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87941634-553d-457e-bb35-9e983da49058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:25.226155 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a566d24b-a616-4a1d-a4f4-4603275975b1 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:25.235699 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-87941634-553d-457e-bb35-9e983da49058 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:13:25.236964 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-87941634-553d-457e-bb35-9e983da49058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:13:25.263405 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b4731-d853-448a-8686-0f8c5535c2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:25.264025 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b4731-d853-448a-8686-0f8c5535c2f6 None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:25.264296 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b4731-d853-448a-8686-0f8c5535c2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:25.266229 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b4731-d853-448a-8686-0f8c5535c2f6 None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:25.266229 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912b4731-d853-448a-8686-0f8c5535c2f6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:25.267506 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912b4731-d853-448a-8686-0f8c5535c2f6 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:25.296196 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 60/113] 10.222.0.36 () {60 vars in 1141 bytes} [Mon Aug 29 22:13:25 2022] POST /identity/v3/projects => generated 302 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:13:25.297547 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5636537-cd2b-45e6-9bae-5bd155140db6 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:25.297886 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5636537-cd2b-45e6-9bae-5bd155140db6 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:25.298118 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5636537-cd2b-45e6-9bae-5bd155140db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:25.312171 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 54/114] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:13:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:13:25.313304 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87941634-553d-457e-bb35-9e983da49058 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:25.329066 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:25.338129 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-e5636537-cd2b-45e6-9bae-5bd155140db6 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:13:25.340507 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-e5636537-cd2b-45e6-9bae-5bd155140db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:13:25.403958 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:25.419580 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 61/115] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:13:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:13:25.420747 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5636537-cd2b-45e6-9bae-5bd155140db6 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:25.434740 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87941634-553d-457e-bb35-9e983da49058 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:25.472555 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f194065-71f5-44fd-978f-83a1870e8e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:25.474208 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f194065-71f5-44fd-978f-83a1870e8e5d None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:25.474667 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f194065-71f5-44fd-978f-83a1870e8e5d None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:25.475081 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f194065-71f5-44fd-978f-83a1870e8e5d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:25.486480 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f194065-71f5-44fd-978f-83a1870e8e5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:13:25.491702 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-4f194065-71f5-44fd-978f-83a1870e8e5d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:13:25.491702 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:13:25.491702 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:13:25.491702 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:13:25.491702 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:13:25.491702 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:13:25.491702 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:13:25.491702 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:13:25.491702 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:13:25.491702 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:13:25.491702 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:13:25.491702 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:13:25.491702 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:13:25.491702 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:13:25.491702 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:13:25.491702 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:13:25.492589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:13:25.492589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:13:25.492589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:13:25.492589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:13:25.492589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:13:25.492589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:13:25.492589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:13:25.492589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:13:25.492589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:13:25.492589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:13:25.492589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:13:25.492589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:13:25.492589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:13:25.492589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:13:25.492589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:13:25.492589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:13:25.493393 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:13:25.493393 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:13:25.493393 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:13:25.493393 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:13:25.493393 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:13:25.493393 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:13:25.493393 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:13:25.493393 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:13:25.493393 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:13:25.493393 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:13:25.493393 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:13:25.493393 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:13:25.495813 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 55/116] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:13:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:13:25.497680 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f194065-71f5-44fd-978f-83a1870e8e5d None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:25.532581 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5636537-cd2b-45e6-9bae-5bd155140db6 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:25.568257 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78bbfcc-53cc-4e11-b0c1-f14655879a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:25.568895 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bbfcc-53cc-4e11-b0c1-f14655879a05 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:25.569169 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bbfcc-53cc-4e11-b0c1-f14655879a05 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:25.569429 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bbfcc-53cc-4e11-b0c1-f14655879a05 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:25.576819 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:25.581843 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78bbfcc-53cc-4e11-b0c1-f14655879a05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:13:25.587805 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-e78bbfcc-53cc-4e11-b0c1-f14655879a05 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:13:25.587805 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:13:25.587805 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:13:25.587805 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:13:25.587805 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:13:25.587805 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:13:25.587805 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:13:25.587805 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:13:25.587805 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:13:25.587805 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:13:25.587805 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:13:25.587805 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:13:25.587805 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:13:25.587805 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:13:25.587805 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:13:25.587805 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:13:25.589053 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:13:25.589053 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:13:25.589053 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:13:25.589053 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:13:25.589053 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:13:25.589053 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:13:25.589053 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:13:25.589053 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:13:25.589053 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:13:25.589053 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:13:25.589053 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:13:25.589053 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:13:25.589053 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:13:25.589053 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:13:25.589053 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:13:25.589053 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:13:25.589825 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:13:25.589825 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:13:25.589825 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:13:25.589825 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:13:25.589825 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:13:25.589825 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:13:25.589825 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:13:25.589825 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:13:25.589825 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:13:25.589825 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:13:25.589825 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:13:25.589825 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:13:25.589825 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 62/117] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Aug 29 22:13:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:13:25.591168 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78bbfcc-53cc-4e11-b0c1-f14655879a05 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:25.610467 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f194065-71f5-44fd-978f-83a1870e8e5d None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:25.649520 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610d3dd-6476-48cb-a2ec-cf25226e7dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:25.650340 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610d3dd-6476-48cb-a2ec-cf25226e7dd8 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:25.650984 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610d3dd-6476-48cb-a2ec-cf25226e7dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:25.650984 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610d3dd-6476-48cb-a2ec-cf25226e7dd8 None admin] PATH_INFO: `/v3/projects/72e0b172f95b4686aa832057c998ddbe` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:25.652416 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610d3dd-6476-48cb-a2ec-cf25226e7dd8 None admin] RBAC: Authorizing `identity:get_project(project_id=72e0b172f95b4686aa832057c998ddbe)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:25.653901 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610d3dd-6476-48cb-a2ec-cf25226e7dd8 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:25.655546 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 56/118] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Aug 29 22:13:25 2022] GET /identity/v3/projects/72e0b172f95b4686aa832057c998ddbe => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:25.656318 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610d3dd-6476-48cb-a2ec-cf25226e7dd8 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:25.659748 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:25.709264 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78bbfcc-53cc-4e11-b0c1-f14655879a05 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:25.745364 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c52225-18cb-4330-8102-0dc416dfcb52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:25.745989 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c52225-18cb-4330-8102-0dc416dfcb52 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:25.746269 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c52225-18cb-4330-8102-0dc416dfcb52 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:25.746541 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c52225-18cb-4330-8102-0dc416dfcb52 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:25.747220 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c52225-18cb-4330-8102-0dc416dfcb52 None admin] RBAC: Adding query filter params (name=member) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:25.747524 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c52225-18cb-4330-8102-0dc416dfcb52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:25.748953 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c52225-18cb-4330-8102-0dc416dfcb52 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:25.757786 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 63/119] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Aug 29 22:13:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:25.763418 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c52225-18cb-4330-8102-0dc416dfcb52 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:25.777100 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610d3dd-6476-48cb-a2ec-cf25226e7dd8 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:25.814453 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86342b73-2c2c-49b2-815a-e9df6dacb6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:25.815077 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86342b73-2c2c-49b2-815a-e9df6dacb6d5 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:25.815371 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86342b73-2c2c-49b2-815a-e9df6dacb6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:25.815645 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86342b73-2c2c-49b2-815a-e9df6dacb6d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:25.816324 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86342b73-2c2c-49b2-815a-e9df6dacb6d5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:25.816742 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86342b73-2c2c-49b2-815a-e9df6dacb6d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:25.818143 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86342b73-2c2c-49b2-815a-e9df6dacb6d5 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:25.827147 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 57/120] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Aug 29 22:13:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:25.829121 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:25.832435 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86342b73-2c2c-49b2-815a-e9df6dacb6d5 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:25.879944 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c52225-18cb-4330-8102-0dc416dfcb52 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:25.901367 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:25.920927 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c5e5f-17e0-4d00-b1cb-36000f7ef4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:25.921575 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c5e5f-17e0-4d00-b1cb-36000f7ef4f2 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:25.921861 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c5e5f-17e0-4d00-b1cb-36000f7ef4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:25.922139 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c5e5f-17e0-4d00-b1cb-36000f7ef4f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:25.933722 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6c5e5f-17e0-4d00-b1cb-36000f7ef4f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:13:25.939165 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-6d6c5e5f-17e0-4d00-b1cb-36000f7ef4f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:13:25.939165 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:13:25.939165 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:13:25.939165 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:13:25.939165 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:13:25.939165 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:13:25.939165 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:13:25.939165 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:13:25.939165 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:13:25.939165 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:13:25.939165 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:13:25.939165 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:13:25.939165 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:13:25.939165 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:13:25.939165 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:13:25.939165 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:13:25.940009 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:13:25.940009 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:13:25.940009 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:13:25.940009 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:13:25.940009 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:13:25.940009 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:13:25.940009 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:13:25.940009 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:13:25.940009 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:13:25.940009 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:13:25.940009 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:13:25.940009 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:13:25.940009 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:13:25.940009 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:13:25.940009 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:13:25.940009 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:13:25.941157 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:13:25.941157 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:13:25.941157 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:13:25.941157 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:13:25.941157 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:13:25.941157 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:13:25.941157 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:13:25.941157 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:13:25.941157 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:13:25.941157 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:13:25.941157 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:13:25.941157 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:13:25.941157 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 64/121] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Aug 29 22:13:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:13:25.941157 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c5e5f-17e0-4d00-b1cb-36000f7ef4f2 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:25.951076 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86342b73-2c2c-49b2-815a-e9df6dacb6d5 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:25.989447 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b3c3a-108c-40c8-a918-32b586cc1ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:25.990063 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b3c3a-108c-40c8-a918-32b586cc1ad4 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:25.990354 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b3c3a-108c-40c8-a918-32b586cc1ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:25.990629 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b3c3a-108c-40c8-a918-32b586cc1ad4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:25.991364 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b3c3a-108c-40c8-a918-32b586cc1ad4 None admin] RBAC: Adding query filter params (role.id=750444f301bf44c59183e4c5470a0dc5, scope.project.id=72e0b172f95b4686aa832057c998ddbe, user.id=dce5a2b9e2a34b80a10cf521b36c532b) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:25.991673 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b3c3a-108c-40c8-a918-32b586cc1ad4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:25.993212 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b3c3a-108c-40c8-a918-32b586cc1ad4 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:25.998880 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 58/122] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Aug 29 22:13:25 2022] GET /identity/v3/role_assignments?user.id=dce5a2b9e2a34b80a10cf521b36c532b&scope.project.id=72e0b172f95b4686aa832057c998ddbe&role.id=750444f301bf44c59183e4c5470a0dc5 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:25.999720 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b3c3a-108c-40c8-a918-32b586cc1ad4 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:26.070658 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c5e5f-17e0-4d00-b1cb-36000f7ef4f2 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:26.100999 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:26.115760 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f426fdb-7afb-4ae0-95b6-f38c91a8c5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:26.117237 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f426fdb-7afb-4ae0-95b6-f38c91a8c5fa None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:26.117666 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f426fdb-7afb-4ae0-95b6-f38c91a8c5fa None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:26.118343 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f426fdb-7afb-4ae0-95b6-f38c91a8c5fa None admin] PATH_INFO: `/v3/roles/member` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:26.136603 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f426fdb-7afb-4ae0-95b6-f38c91a8c5fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:13:26.137090 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b3c3a-108c-40c8-a918-32b586cc1ad4 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:26.143783 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-9f426fdb-7afb-4ae0-95b6-f38c91a8c5fa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:13:26.143783 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:13:26.143783 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:13:26.143783 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:13:26.143783 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:13:26.143783 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:13:26.143783 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:13:26.143783 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:13:26.143783 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:13:26.143783 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:13:26.143783 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:13:26.143783 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:13:26.143783 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:13:26.143783 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:13:26.143783 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:13:26.143783 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:13:26.145005 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:13:26.145005 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:13:26.145005 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:13:26.145005 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:13:26.145005 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:13:26.145005 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:13:26.145005 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:13:26.145005 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:13:26.145005 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:13:26.145005 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:13:26.145005 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:13:26.145005 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:13:26.145005 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:13:26.145005 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:13:26.145005 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:13:26.145005 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:13:26.145806 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:13:26.145806 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:13:26.145806 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:13:26.145806 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:13:26.145806 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:13:26.145806 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:13:26.145806 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:13:26.145806 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:13:26.145806 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:13:26.145806 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:13:26.145806 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:13:26.145806 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:13:26.145806 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 65/123] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:13:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:13:26.146448 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f426fdb-7afb-4ae0-95b6-f38c91a8c5fa None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:26.187088 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:26.192706 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad2420-02a3-4073-8e14-448ea160ce5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:26.193419 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad2420-02a3-4073-8e14-448ea160ce5b None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:26.193709 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad2420-02a3-4073-8e14-448ea160ce5b None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:26.193992 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad2420-02a3-4073-8e14-448ea160ce5b None admin] PATH_INFO: `/v3/users/a107bc03b1f041ceb3d4a7e34f3699ab` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:26.195564 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad2420-02a3-4073-8e14-448ea160ce5b None admin] RBAC: Authorizing `identity:get_user(user_id=a107bc03b1f041ceb3d4a7e34f3699ab)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:26.197389 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad2420-02a3-4073-8e14-448ea160ce5b None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:26.203780 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 59/124] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Aug 29 22:13:25 2022] GET /identity/v3/users/a107bc03b1f041ceb3d4a7e34f3699ab => generated 275 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:26.204756 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad2420-02a3-4073-8e14-448ea160ce5b None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:26.276102 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f426fdb-7afb-4ae0-95b6-f38c91a8c5fa None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:26.311384 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3282332-4416-4e83-a707-b7e78d97832b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:26.312031 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3282332-4416-4e83-a707-b7e78d97832b None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:26.312360 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3282332-4416-4e83-a707-b7e78d97832b None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:26.312682 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3282332-4416-4e83-a707-b7e78d97832b None admin] PATH_INFO: `/v3/users/a107bc03b1f041ceb3d4a7e34f3699ab` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:26.313888 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3282332-4416-4e83-a707-b7e78d97832b None admin] RBAC: Authorizing `identity:get_user(user_id=a107bc03b1f041ceb3d4a7e34f3699ab)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:26.315357 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3282332-4416-4e83-a707-b7e78d97832b None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:26.317510 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 66/125] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Aug 29 22:13:26 2022] GET /identity/v3/users/a107bc03b1f041ceb3d4a7e34f3699ab => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:26.318384 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3282332-4416-4e83-a707-b7e78d97832b None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:26.335679 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad2420-02a3-4073-8e14-448ea160ce5b None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:26.369608 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:26.382455 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd89c1b-5f90-4cde-a437-5346945fa88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:26.383329 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd89c1b-5f90-4cde-a437-5346945fa88a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:26.383617 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd89c1b-5f90-4cde-a437-5346945fa88a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:26.383892 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd89c1b-5f90-4cde-a437-5346945fa88a None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:26.384696 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd89c1b-5f90-4cde-a437-5346945fa88a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:26.385420 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd89c1b-5f90-4cde-a437-5346945fa88a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:26.387577 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd89c1b-5f90-4cde-a437-5346945fa88a None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:26.398581 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 60/126] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:13:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:26.399092 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd89c1b-5f90-4cde-a437-5346945fa88a None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:26.430151 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3282332-4416-4e83-a707-b7e78d97832b None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:26.465932 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:26.466556 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b9016-bbd4-4455-8576-0ca9e1a3ebf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:26.467685 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b9016-bbd4-4455-8576-0ca9e1a3ebf6 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:26.468106 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b9016-bbd4-4455-8576-0ca9e1a3ebf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:26.468631 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b9016-bbd4-4455-8576-0ca9e1a3ebf6 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:26.469662 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09b9016-bbd4-4455-8576-0ca9e1a3ebf6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:26.470104 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09b9016-bbd4-4455-8576-0ca9e1a3ebf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:26.471648 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09b9016-bbd4-4455-8576-0ca9e1a3ebf6 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:26.480989 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 67/127] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Aug 29 22:13:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:26.482292 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b9016-bbd4-4455-8576-0ca9e1a3ebf6 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:26.512344 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd89c1b-5f90-4cde-a437-5346945fa88a None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:26.547826 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4d3d4-4ec6-479e-a3ba-9a37c045875e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:26.548485 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4d3d4-4ec6-479e-a3ba-9a37c045875e None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:26.548774 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4d3d4-4ec6-479e-a3ba-9a37c045875e None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:26.549047 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4d3d4-4ec6-479e-a3ba-9a37c045875e None admin] PATH_INFO: `/v3/projects/72e0b172f95b4686aa832057c998ddbe` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:26.550170 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f4d3d4-4ec6-479e-a3ba-9a37c045875e None admin] RBAC: Authorizing `identity:get_project(project_id=72e0b172f95b4686aa832057c998ddbe)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:26.551632 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f4d3d4-4ec6-479e-a3ba-9a37c045875e None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:26.553743 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 61/128] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Aug 29 22:13:26 2022] GET /identity/v3/projects/72e0b172f95b4686aa832057c998ddbe => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:26.554805 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4d3d4-4ec6-479e-a3ba-9a37c045875e None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:26.595506 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b9016-bbd4-4455-8576-0ca9e1a3ebf6 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:26.609618 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:26.638778 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb75430-5543-40f4-a2e6-69ec6f420c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:26.639719 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb75430-5543-40f4-a2e6-69ec6f420c2c None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:26.640172 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb75430-5543-40f4-a2e6-69ec6f420c2c None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:26.640721 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb75430-5543-40f4-a2e6-69ec6f420c2c None admin] PATH_INFO: `/v3/projects/72e0b172f95b4686aa832057c998ddbe` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:26.642342 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb75430-5543-40f4-a2e6-69ec6f420c2c None admin] RBAC: Authorizing `identity:get_project(project_id=72e0b172f95b4686aa832057c998ddbe)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:26.643965 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb75430-5543-40f4-a2e6-69ec6f420c2c None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:26.646230 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 68/129] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Aug 29 22:13:26 2022] GET /identity/v3/projects/72e0b172f95b4686aa832057c998ddbe => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:26.647235 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb75430-5543-40f4-a2e6-69ec6f420c2c None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:26.671097 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4d3d4-4ec6-479e-a3ba-9a37c045875e None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:26.707419 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:26.718932 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6bf93b-4bf4-4205-8e2d-1694a3552c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:26.720313 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6bf93b-4bf4-4205-8e2d-1694a3552c90 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:26.721030 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6bf93b-4bf4-4205-8e2d-1694a3552c90 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:26.721452 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6bf93b-4bf4-4205-8e2d-1694a3552c90 None admin] PATH_INFO: `/v3/users/6b5654a5750846779dda7b1bf48a68d8` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:26.723423 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6bf93b-4bf4-4205-8e2d-1694a3552c90 None admin] RBAC: Authorizing `identity:get_user(user_id=6b5654a5750846779dda7b1bf48a68d8)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:26.726149 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6bf93b-4bf4-4205-8e2d-1694a3552c90 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:26.728560 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 62/130] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Aug 29 22:13:26 2022] GET /identity/v3/users/6b5654a5750846779dda7b1bf48a68d8 => generated 247 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:26.729632 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6bf93b-4bf4-4205-8e2d-1694a3552c90 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:26.782446 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb75430-5543-40f4-a2e6-69ec6f420c2c None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:26.829167 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd27a9-7d66-4e68-ad4c-6b9104b8784d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:26.830335 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd27a9-7d66-4e68-ad4c-6b9104b8784d None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:26.830622 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd27a9-7d66-4e68-ad4c-6b9104b8784d None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:26.830905 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd27a9-7d66-4e68-ad4c-6b9104b8784d None admin] PATH_INFO: `/v3/users/a107bc03b1f041ceb3d4a7e34f3699ab` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:26.832236 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd27a9-7d66-4e68-ad4c-6b9104b8784d None admin] RBAC: Authorizing `identity:get_user(user_id=a107bc03b1f041ceb3d4a7e34f3699ab)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:26.834557 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd27a9-7d66-4e68-ad4c-6b9104b8784d None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:26.836695 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 69/131] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Aug 29 22:13:26 2022] GET /identity/v3/users/a107bc03b1f041ceb3d4a7e34f3699ab => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:26.837573 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd27a9-7d66-4e68-ad4c-6b9104b8784d None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:26.865760 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6bf93b-4bf4-4205-8e2d-1694a3552c90 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:26.895904 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:26.906569 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d50604e-d8c1-428d-8b2f-8737578a264f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:26.907311 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50604e-d8c1-428d-8b2f-8737578a264f None admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:26.907596 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50604e-d8c1-428d-8b2f-8737578a264f None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:26.907875 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50604e-d8c1-428d-8b2f-8737578a264f None admin] PATH_INFO: `/v3/projects/72e0b172f95b4686aa832057c998ddbe/users/a107bc03b1f041ceb3d4a7e34f3699ab/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:26.909831 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d50604e-d8c1-428d-8b2f-8737578a264f None admin] RBAC: Authorizing `identity:create_grant(project_id=72e0b172f95b4686aa832057c998ddbe, user_id=a107bc03b1f041ceb3d4a7e34f3699ab, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:26.911354 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d50604e-d8c1-428d-8b2f-8737578a264f None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:26.928156 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 63/132] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Aug 29 22:13:26 2022] PUT /identity/v3/projects/72e0b172f95b4686aa832057c998ddbe/users/a107bc03b1f041ceb3d4a7e34f3699ab/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:13:26.929048 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d50604e-d8c1-428d-8b2f-8737578a264f None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:26.961479 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd27a9-7d66-4e68-ad4c-6b9104b8784d None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:26.992675 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:27.000132 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c52ed-1fa5-4e28-af3e-2407d5f87592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:27.001606 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c52ed-1fa5-4e28-af3e-2407d5f87592 None admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:27.002134 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c52ed-1fa5-4e28-af3e-2407d5f87592 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:27.002642 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c52ed-1fa5-4e28-af3e-2407d5f87592 None admin] PATH_INFO: `/v3/projects/72e0b172f95b4686aa832057c998ddbe/users/a107bc03b1f041ceb3d4a7e34f3699ab/roles/8767fe0bd994478fac741fc8c76f649e` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:27.005638 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1c52ed-1fa5-4e28-af3e-2407d5f87592 None admin] RBAC: Authorizing `identity:create_grant(project_id=72e0b172f95b4686aa832057c998ddbe, user_id=a107bc03b1f041ceb3d4a7e34f3699ab, role_id=8767fe0bd994478fac741fc8c76f649e)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:27.007347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1c52ed-1fa5-4e28-af3e-2407d5f87592 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:27.032738 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 70/133] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Aug 29 22:13:26 2022] PUT /identity/v3/projects/72e0b172f95b4686aa832057c998ddbe/users/a107bc03b1f041ceb3d4a7e34f3699ab/roles/8767fe0bd994478fac741fc8c76f649e => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:13:27.034128 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c52ed-1fa5-4e28-af3e-2407d5f87592 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:27.070132 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d50604e-d8c1-428d-8b2f-8737578a264f None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:27.136324 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2779fbd2-763e-44f3-aebc-e2b5f1040371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:27.137005 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2779fbd2-763e-44f3-aebc-e2b5f1040371 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:27.137316 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2779fbd2-763e-44f3-aebc-e2b5f1040371 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:27.137601 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2779fbd2-763e-44f3-aebc-e2b5f1040371 None admin] PATH_INFO: `/v3/projects/72e0b172f95b4686aa832057c998ddbe` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:27.140627 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2779fbd2-763e-44f3-aebc-e2b5f1040371 None admin] RBAC: Authorizing `identity:get_project(project_id=72e0b172f95b4686aa832057c998ddbe)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:27.142697 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2779fbd2-763e-44f3-aebc-e2b5f1040371 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:27.144535 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 64/134] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Aug 29 22:13:26 2022] GET /identity/v3/projects/72e0b172f95b4686aa832057c998ddbe => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:27.151882 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2779fbd2-763e-44f3-aebc-e2b5f1040371 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:27.249647 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c52ed-1fa5-4e28-af3e-2407d5f87592 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:27.252666 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:27.290720 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74640781-6343-4c0d-beef-81d9ed84b8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:27.291511 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74640781-6343-4c0d-beef-81d9ed84b8a2 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:27.292055 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74640781-6343-4c0d-beef-81d9ed84b8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:27.292432 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74640781-6343-4c0d-beef-81d9ed84b8a2 None admin] PATH_INFO: `/v3/projects/1c70b5e26a7749d68e05e4c899c6fed7` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:27.293739 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74640781-6343-4c0d-beef-81d9ed84b8a2 None admin] RBAC: Authorizing `identity:get_project(project_id=1c70b5e26a7749d68e05e4c899c6fed7)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:27.294293 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2779fbd2-763e-44f3-aebc-e2b5f1040371 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:27.295407 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74640781-6343-4c0d-beef-81d9ed84b8a2 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:27.298345 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 71/135] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Aug 29 22:13:27 2022] GET /identity/v3/projects/1c70b5e26a7749d68e05e4c899c6fed7 => generated 312 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:27.305455 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74640781-6343-4c0d-beef-81d9ed84b8a2 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:27.325560 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:27.333883 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5b119-446a-46e8-b364-5222ffbb5133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:27.334854 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5b119-446a-46e8-b364-5222ffbb5133 None admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:27.335303 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5b119-446a-46e8-b364-5222ffbb5133 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:27.335814 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5b119-446a-46e8-b364-5222ffbb5133 None admin] PATH_INFO: `/v3/projects/72e0b172f95b4686aa832057c998ddbe/users/6b5654a5750846779dda7b1bf48a68d8/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:27.345764 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5b119-446a-46e8-b364-5222ffbb5133 None admin] RBAC: Authorizing `identity:create_grant(project_id=72e0b172f95b4686aa832057c998ddbe, user_id=6b5654a5750846779dda7b1bf48a68d8, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:27.347610 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5b119-446a-46e8-b364-5222ffbb5133 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:27.372598 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 65/136] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Aug 29 22:13:27 2022] PUT /identity/v3/projects/72e0b172f95b4686aa832057c998ddbe/users/6b5654a5750846779dda7b1bf48a68d8/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:13:27.490267 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74640781-6343-4c0d-beef-81d9ed84b8a2 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:27.538069 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d3502-501f-4335-bf70-99e3e3161c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:27.538781 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d3502-501f-4335-bf70-99e3e3161c47 None admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:27.539066 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d3502-501f-4335-bf70-99e3e3161c47 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:27.539347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d3502-501f-4335-bf70-99e3e3161c47 None admin] PATH_INFO: `/v3/projects/1c70b5e26a7749d68e05e4c899c6fed7/users/a107bc03b1f041ceb3d4a7e34f3699ab/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:27.541573 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5d3502-501f-4335-bf70-99e3e3161c47 None admin] RBAC: Authorizing `identity:create_grant(project_id=1c70b5e26a7749d68e05e4c899c6fed7, user_id=a107bc03b1f041ceb3d4a7e34f3699ab, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:27.543093 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5d3502-501f-4335-bf70-99e3e3161c47 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:27.544019 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712fae5-f9a7-4ffa-bcf4-21ed1cefc7ea None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:27.544779 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712fae5-f9a7-4ffa-bcf4-21ed1cefc7ea None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:27.545494 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712fae5-f9a7-4ffa-bcf4-21ed1cefc7ea None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:27.547376 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 66/137] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:13:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:13:27.555566 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2aa91-b47e-427c-8237-fba49b611ac2 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:27.556173 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2aa91-b47e-427c-8237-fba49b611ac2 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:27.556882 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2aa91-b47e-427c-8237-fba49b611ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:27.568802 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 72/138] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Aug 29 22:13:27 2022] PUT /identity/v3/projects/1c70b5e26a7749d68e05e4c899c6fed7/users/a107bc03b1f041ceb3d4a7e34f3699ab/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:13:27.593221 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-b1e2aa91-b47e-427c-8237-fba49b611ac2 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:13:27.594445 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b1e2aa91-b47e-427c-8237-fba49b611ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:13:27.675951 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 67/139] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:13:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:13:28.000022 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d3502-501f-4335-bf70-99e3e3161c47 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:28.035424 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:28.113099 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d3502-501f-4335-bf70-99e3e3161c47 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:28.158741 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50381a95-c4d0-4e53-9da1-b21953c3c404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:28.159709 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50381a95-c4d0-4e53-9da1-b21953c3c404 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:28.160179 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50381a95-c4d0-4e53-9da1-b21953c3c404 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:28.160683 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50381a95-c4d0-4e53-9da1-b21953c3c404 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:28.165348 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50381a95-c4d0-4e53-9da1-b21953c3c404 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:28.167663 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50381a95-c4d0-4e53-9da1-b21953c3c404 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:28.170183 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 73/140] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:13:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:28.175693 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e2aa91-b47e-427c-8237-fba49b611ac2 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:28.316981 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e2aa91-b47e-427c-8237-fba49b611ac2 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:28.341443 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:28.368170 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649336f-477b-46df-8a2e-a94f0dcf0338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:28.368983 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649336f-477b-46df-8a2e-a94f0dcf0338 None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:28.369271 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649336f-477b-46df-8a2e-a94f0dcf0338 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:28.369586 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649336f-477b-46df-8a2e-a94f0dcf0338 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:28.370230 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0649336f-477b-46df-8a2e-a94f0dcf0338 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:28.371685 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0649336f-477b-46df-8a2e-a94f0dcf0338 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:28.401269 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 68/141] 10.222.0.36 () {60 vars in 1132 bytes} [Mon Aug 29 22:13:28 2022] POST /identity/v3/users => generated 283 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:13:28.720111 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069e174-6d93-4d22-999b-b87d4cb015c5 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:28.720806 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069e174-6d93-4d22-999b-b87d4cb015c5 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:28.721289 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069e174-6d93-4d22-999b-b87d4cb015c5 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:28.722905 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 74/142] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:13:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:13:28.728549 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6117213-389c-41d7-94ac-11ac49726e1f None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:28.729427 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6117213-389c-41d7-94ac-11ac49726e1f None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:28.729892 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6117213-389c-41d7-94ac-11ac49726e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:28.757725 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-b6117213-389c-41d7-94ac-11ac49726e1f None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:13:28.759262 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b6117213-389c-41d7-94ac-11ac49726e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:13:28.840192 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 69/143] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:13:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:13:29.367444 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1069e174-6d93-4d22-999b-b87d4cb015c5 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:29.475868 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:29.480256 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1069e174-6d93-4d22-999b-b87d4cb015c5 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:29.524251 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ad9ff-e3be-4f21-ab2b-588d081038cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:29.525002 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ad9ff-e3be-4f21-ab2b-588d081038cf None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:29.525286 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ad9ff-e3be-4f21-ab2b-588d081038cf None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:29.525559 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ad9ff-e3be-4f21-ab2b-588d081038cf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:29.537223 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666ad9ff-e3be-4f21-ab2b-588d081038cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:13:29.542421 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-666ad9ff-e3be-4f21-ab2b-588d081038cf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:13:29.542421 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:13:29.542421 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:13:29.542421 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:13:29.542421 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:13:29.542421 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:13:29.542421 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:13:29.542421 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:13:29.542421 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:13:29.542421 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:13:29.542421 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:13:29.542421 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:13:29.542421 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:13:29.542421 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:13:29.542421 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:13:29.542421 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:13:29.543264 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:13:29.543264 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:13:29.543264 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:13:29.543264 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:13:29.543264 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:13:29.543264 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:13:29.543264 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:13:29.543264 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:13:29.543264 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:13:29.543264 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:13:29.543264 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:13:29.543264 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:13:29.543264 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:13:29.543264 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:13:29.543264 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:13:29.543264 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:13:29.544037 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:13:29.544037 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:13:29.544037 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:13:29.544037 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:13:29.544037 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:13:29.544037 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:13:29.544037 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:13:29.544037 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:13:29.544037 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:13:29.544037 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:13:29.544037 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:13:29.544037 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:13:29.544037 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 75/144] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:13:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:13:29.549624 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6117213-389c-41d7-94ac-11ac49726e1f None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:29.662748 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:29.667324 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6117213-389c-41d7-94ac-11ac49726e1f None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:29.710243 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9022596-fd3e-433c-abda-0002715f26e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:29.710865 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9022596-fd3e-433c-abda-0002715f26e4 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:29.711144 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9022596-fd3e-433c-abda-0002715f26e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:29.711416 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9022596-fd3e-433c-abda-0002715f26e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:29.712094 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9022596-fd3e-433c-abda-0002715f26e4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:29.712394 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9022596-fd3e-433c-abda-0002715f26e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:29.713960 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9022596-fd3e-433c-abda-0002715f26e4 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:29.724257 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 70/145] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Aug 29 22:13:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:29.730422 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ad9ff-e3be-4f21-ab2b-588d081038cf None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:29.850421 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ad9ff-e3be-4f21-ab2b-588d081038cf None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:29.891797 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f956238-64bb-45fb-946f-ecb8e1ff6085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:29.891797 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f956238-64bb-45fb-946f-ecb8e1ff6085 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:29.891797 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f956238-64bb-45fb-946f-ecb8e1ff6085 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:29.892097 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f956238-64bb-45fb-946f-ecb8e1ff6085 None admin] PATH_INFO: `/v3/users/dce5a2b9e2a34b80a10cf521b36c532b` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:29.893172 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f956238-64bb-45fb-946f-ecb8e1ff6085 None admin] RBAC: Authorizing `identity:get_user(user_id=dce5a2b9e2a34b80a10cf521b36c532b)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:29.894760 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f956238-64bb-45fb-946f-ecb8e1ff6085 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:29.896500 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 76/146] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Aug 29 22:13:29 2022] GET /identity/v3/users/dce5a2b9e2a34b80a10cf521b36c532b => generated 289 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:29.902885 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9022596-fd3e-433c-abda-0002715f26e4 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:29.951615 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108ffc9-9adb-4d28-82fe-505f6b64d0d4 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:29.951900 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108ffc9-9adb-4d28-82fe-505f6b64d0d4 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:29.952082 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108ffc9-9adb-4d28-82fe-505f6b64d0d4 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:29.953451 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 77/147] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:13:29.974683 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da4c7d-6eba-41bf-a4a0-2256905673d4 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:29.975004 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da4c7d-6eba-41bf-a4a0-2256905673d4 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:29.975221 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da4c7d-6eba-41bf-a4a0-2256905673d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:30.004124 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-03da4c7d-6eba-41bf-a4a0-2256905673d4 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:13:30.005813 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-03da4c7d-6eba-41bf-a4a0-2256905673d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:13:30.037524 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:30.063637 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9022596-fd3e-433c-abda-0002715f26e4 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:30.119190 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 78/148] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:13:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:13:30.120245 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbacec4-7362-4e0c-afcf-552af680a407 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:30.120554 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbacec4-7362-4e0c-afcf-552af680a407 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:30.120823 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbacec4-7362-4e0c-afcf-552af680a407 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:30.122083 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 79/149] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:13:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:13:30.128419 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200cb3f9-9f9d-4da3-bed0-1a5e60e352dc None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:30.130663 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200cb3f9-9f9d-4da3-bed0-1a5e60e352dc None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:30.130950 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200cb3f9-9f9d-4da3-bed0-1a5e60e352dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:30.137242 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77bc9fe-bd66-473f-b72c-555b532af09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:30.137912 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77bc9fe-bd66-473f-b72c-555b532af09d None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:30.138197 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77bc9fe-bd66-473f-b72c-555b532af09d None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:30.138475 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77bc9fe-bd66-473f-b72c-555b532af09d None admin] PATH_INFO: `/v3/projects/72e0b172f95b4686aa832057c998ddbe` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:30.139723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77bc9fe-bd66-473f-b72c-555b532af09d None admin] RBAC: Authorizing `identity:get_project(project_id=72e0b172f95b4686aa832057c998ddbe)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:30.141533 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77bc9fe-bd66-473f-b72c-555b532af09d None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:30.143487 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 71/150] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Aug 29 22:13:29 2022] GET /identity/v3/projects/72e0b172f95b4686aa832057c998ddbe => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:30.155030 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-200cb3f9-9f9d-4da3-bed0-1a5e60e352dc None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:13:30.156215 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-200cb3f9-9f9d-4da3-bed0-1a5e60e352dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:13:30.169814 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77bc9fe-bd66-473f-b72c-555b532af09d None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:30.221607 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:30.237664 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 80/151] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:13:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:13:30.311670 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77bc9fe-bd66-473f-b72c-555b532af09d None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:30.351536 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e53a9-e66e-4452-aed0-26f589998e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:30.352231 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e53a9-e66e-4452-aed0-26f589998e67 None admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:30.352536 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e53a9-e66e-4452-aed0-26f589998e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:30.352819 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e53a9-e66e-4452-aed0-26f589998e67 None admin] PATH_INFO: `/v3/projects/72e0b172f95b4686aa832057c998ddbe/users/dce5a2b9e2a34b80a10cf521b36c532b/roles/750444f301bf44c59183e4c5470a0dc5` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:30.357376 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3e53a9-e66e-4452-aed0-26f589998e67 None admin] RBAC: Authorizing `identity:create_grant(project_id=72e0b172f95b4686aa832057c998ddbe, user_id=dce5a2b9e2a34b80a10cf521b36c532b, role_id=750444f301bf44c59183e4c5470a0dc5)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:30.358861 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3e53a9-e66e-4452-aed0-26f589998e67 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:30.374641 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 72/152] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Aug 29 22:13:30 2022] PUT /identity/v3/projects/72e0b172f95b4686aa832057c998ddbe/users/dce5a2b9e2a34b80a10cf521b36c532b/roles/750444f301bf44c59183e4c5470a0dc5 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:13:30.426724 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0186db72-6c3b-415a-b7e2-2c894a935df1 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:30.427371 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0186db72-6c3b-415a-b7e2-2c894a935df1 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:30.427371 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0186db72-6c3b-415a-b7e2-2c894a935df1 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:30.429039 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 81/153] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:13:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:13:30.434647 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6233b-d0a8-4a23-b517-a7e00e5cc34a None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:30.434993 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6233b-d0a8-4a23-b517-a7e00e5cc34a None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:30.435267 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6233b-d0a8-4a23-b517-a7e00e5cc34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:30.461523 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-a1e6233b-d0a8-4a23-b517-a7e00e5cc34a None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:13:30.462889 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a1e6233b-d0a8-4a23-b517-a7e00e5cc34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:13:30.482648 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cbbc7c-90af-4c17-a697-a7b13957e42d None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:30.482921 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cbbc7c-90af-4c17-a697-a7b13957e42d None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:30.483088 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cbbc7c-90af-4c17-a697-a7b13957e42d None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:30.484435 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 82/154] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:13:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:13:30.502807 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303587c-a489-4395-87d5-3a3fa18f7720 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:30.503106 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303587c-a489-4395-87d5-3a3fa18f7720 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:30.503344 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303587c-a489-4395-87d5-3a3fa18f7720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:30.541169 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-4303587c-a489-4395-87d5-3a3fa18f7720 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:13:30.542550 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-4303587c-a489-4395-87d5-3a3fa18f7720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:13:30.546127 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 73/155] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:13:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:13:30.668563 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 83/156] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:13:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:13:30.774942 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e6233b-d0a8-4a23-b517-a7e00e5cc34a None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:30.798882 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:30.879213 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303587c-a489-4395-87d5-3a3fa18f7720 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:30.907155 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e6233b-d0a8-4a23-b517-a7e00e5cc34a None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:30.928830 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:30.982327 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ba3f6-de9f-460d-9338-5b5a74ba0ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:30.982979 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ba3f6-de9f-460d-9338-5b5a74ba0ae5 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:30.983259 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ba3f6-de9f-460d-9338-5b5a74ba0ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:30.983538 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ba3f6-de9f-460d-9338-5b5a74ba0ae5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:31.005995 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28ba3f6-de9f-460d-9338-5b5a74ba0ae5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:13:31.011741 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-d28ba3f6-de9f-460d-9338-5b5a74ba0ae5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:13:31.011741 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:13:31.011741 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:13:31.011741 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:13:31.011741 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:13:31.011741 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:13:31.011741 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:13:31.011741 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:13:31.011741 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:13:31.011741 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:13:31.011741 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:13:31.011741 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:13:31.011741 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:13:31.011741 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:13:31.011741 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:13:31.011741 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:13:31.013773 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:13:31.013773 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:13:31.013773 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:13:31.013773 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:13:31.013773 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:13:31.013773 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:13:31.013773 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:13:31.013773 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:13:31.013773 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:13:31.013773 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:13:31.013773 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:13:31.013773 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:13:31.013773 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:13:31.013773 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:13:31.013773 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:13:31.013773 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:13:31.015624 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:13:31.015624 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:13:31.015624 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:13:31.015624 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:13:31.015624 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:13:31.015624 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:13:31.015624 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:13:31.015624 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:13:31.015624 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:13:31.015624 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:13:31.015624 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:13:31.015624 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:13:31.017358 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 74/157] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Aug 29 22:13:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:13:31.027400 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ba3f6-de9f-460d-9338-5b5a74ba0ae5 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:31.059131 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303587c-a489-4395-87d5-3a3fa18f7720 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:31.102563 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d31acad-733a-4333-b112-ed0a6f17dbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:31.103295 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31acad-733a-4333-b112-ed0a6f17dbcf None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:31.103570 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31acad-733a-4333-b112-ed0a6f17dbcf None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:31.103838 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31acad-733a-4333-b112-ed0a6f17dbcf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:31.115428 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d31acad-733a-4333-b112-ed0a6f17dbcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:13:31.120357 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-2d31acad-733a-4333-b112-ed0a6f17dbcf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:13:31.120357 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:13:31.120357 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:13:31.120357 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:13:31.120357 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:13:31.120357 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:13:31.120357 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:13:31.120357 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:13:31.120357 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:13:31.120357 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:13:31.120357 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:13:31.120357 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:13:31.120357 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:13:31.120357 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:13:31.120357 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:13:31.120357 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:13:31.122576 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:13:31.122576 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:13:31.122576 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:13:31.122576 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:13:31.122576 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:13:31.122576 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:13:31.122576 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:13:31.122576 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:13:31.122576 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:13:31.122576 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:13:31.122576 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:13:31.122576 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:13:31.122576 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:13:31.122576 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:13:31.122576 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:13:31.122576 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:13:31.124569 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:13:31.124569 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:13:31.124569 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:13:31.124569 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:13:31.124569 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:13:31.124569 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:13:31.124569 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:13:31.124569 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:13:31.124569 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:13:31.124569 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:13:31.124569 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:13:31.124569 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:13:31.124569 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 84/158] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:13:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:13:31.124569 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d31acad-733a-4333-b112-ed0a6f17dbcf None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:31.166298 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:31.206111 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ba3f6-de9f-460d-9338-5b5a74ba0ae5 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:31.214143 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:31.237545 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d31acad-733a-4333-b112-ed0a6f17dbcf None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:31.275056 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67629877-46f4-4630-a3be-2cf18388483b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:31.275695 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67629877-46f4-4630-a3be-2cf18388483b None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:31.276116 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67629877-46f4-4630-a3be-2cf18388483b None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:31.276507 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67629877-46f4-4630-a3be-2cf18388483b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:31.288204 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67629877-46f4-4630-a3be-2cf18388483b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:13:31.289292 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb15fbe-f1fe-476f-ae50-02eb798dfcea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:31.289916 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb15fbe-f1fe-476f-ae50-02eb798dfcea None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:31.290198 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb15fbe-f1fe-476f-ae50-02eb798dfcea None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:31.290473 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb15fbe-f1fe-476f-ae50-02eb798dfcea None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:31.291395 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb15fbe-f1fe-476f-ae50-02eb798dfcea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:31.291746 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb15fbe-f1fe-476f-ae50-02eb798dfcea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:31.293199 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb15fbe-f1fe-476f-ae50-02eb798dfcea None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:31.294211 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-67629877-46f4-4630-a3be-2cf18388483b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:13:31.294211 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:13:31.294211 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:13:31.294211 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:13:31.294211 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:13:31.294211 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:13:31.294211 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:13:31.294211 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:13:31.294211 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:13:31.294211 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:13:31.294211 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:13:31.294211 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:13:31.294211 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:13:31.294211 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:13:31.294211 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:13:31.294211 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:13:31.296031 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:13:31.296031 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:13:31.296031 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:13:31.296031 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:13:31.296031 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:13:31.296031 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:13:31.296031 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:13:31.296031 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:13:31.296031 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:13:31.296031 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:13:31.296031 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:13:31.296031 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:13:31.296031 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:13:31.296031 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:13:31.296031 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:13:31.296031 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:13:31.297775 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:13:31.297775 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:13:31.297775 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:13:31.297775 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:13:31.297775 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:13:31.297775 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:13:31.297775 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:13:31.297775 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:13:31.297775 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:13:31.297775 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:13:31.297775 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:13:31.297775 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:13:31.297775 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 85/159] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Aug 29 22:13:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:13:31.297775 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67629877-46f4-4630-a3be-2cf18388483b None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:31.318051 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 75/160] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Aug 29 22:13:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:13:31.318915 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb15fbe-f1fe-476f-ae50-02eb798dfcea None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:31.517281 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67629877-46f4-4630-a3be-2cf18388483b None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:31.554484 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb15fbe-f1fe-476f-ae50-02eb798dfcea None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:31.608489 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4755a507-023e-40a0-930d-61253fabc847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:31.608489 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755a507-023e-40a0-930d-61253fabc847 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:31.608489 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755a507-023e-40a0-930d-61253fabc847 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:31.608489 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755a507-023e-40a0-930d-61253fabc847 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:31.609265 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4755a507-023e-40a0-930d-61253fabc847 None admin] RBAC: Adding query filter params (name=member) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:31.609265 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4755a507-023e-40a0-930d-61253fabc847 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:31.609811 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4755a507-023e-40a0-930d-61253fabc847 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:31.618026 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:31.622789 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 86/161] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Aug 29 22:13:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:31.623866 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4755a507-023e-40a0-930d-61253fabc847 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:31.641471 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71f893-e7cc-4df8-9b26-ada06e3098ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:31.642123 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71f893-e7cc-4df8-9b26-ada06e3098ac None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:31.642409 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71f893-e7cc-4df8-9b26-ada06e3098ac None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:31.642687 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71f893-e7cc-4df8-9b26-ada06e3098ac None admin] PATH_INFO: `/v3/roles/member` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:31.676786 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:31.681005 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c71f893-e7cc-4df8-9b26-ada06e3098ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:13:31.689465 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-9c71f893-e7cc-4df8-9b26-ada06e3098ac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:13:31.689465 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:13:31.689465 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:13:31.689465 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:13:31.689465 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:13:31.689465 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:13:31.689465 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:13:31.689465 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:13:31.689465 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:13:31.689465 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:13:31.689465 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:13:31.689465 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:13:31.689465 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:13:31.689465 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:13:31.689465 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:13:31.689465 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:13:31.690366 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:13:31.690366 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:13:31.690366 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:13:31.690366 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:13:31.690366 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:13:31.690366 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:13:31.690366 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:13:31.690366 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:13:31.690366 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:13:31.690366 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:13:31.690366 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:13:31.690366 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:13:31.690366 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:13:31.690366 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:13:31.690366 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:13:31.690366 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:13:31.691387 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:13:31.691387 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:13:31.691387 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:13:31.691387 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:13:31.691387 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:13:31.691387 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:13:31.691387 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:13:31.691387 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:13:31.691387 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:13:31.691387 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:13:31.691387 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:13:31.691387 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:13:31.691387 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 76/162] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:13:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:13:31.691387 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71f893-e7cc-4df8-9b26-ada06e3098ac None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:31.878985 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71f893-e7cc-4df8-9b26-ada06e3098ac None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:31.898485 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4755a507-023e-40a0-930d-61253fabc847 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:31.919226 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a9858-12ed-430d-ba0e-009806a2e473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:31.919908 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a9858-12ed-430d-ba0e-009806a2e473 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:31.920150 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a9858-12ed-430d-ba0e-009806a2e473 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:31.920423 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a9858-12ed-430d-ba0e-009806a2e473 None admin] PATH_INFO: `/v3/users/a107bc03b1f041ceb3d4a7e34f3699ab` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:31.921773 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6a9858-12ed-430d-ba0e-009806a2e473 None admin] RBAC: Authorizing `identity:get_user(user_id=a107bc03b1f041ceb3d4a7e34f3699ab)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:31.923300 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6a9858-12ed-430d-ba0e-009806a2e473 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:31.925416 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 77/163] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Aug 29 22:13:31 2022] GET /identity/v3/users/a107bc03b1f041ceb3d4a7e34f3699ab => generated 275 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:31.925978 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a9858-12ed-430d-ba0e-009806a2e473 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:32.013225 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b3a133-db86-4418-9037-866702a9e6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:32.013863 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3a133-db86-4418-9037-866702a9e6a1 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:32.014147 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3a133-db86-4418-9037-866702a9e6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:32.014423 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3a133-db86-4418-9037-866702a9e6a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:32.015117 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b3a133-db86-4418-9037-866702a9e6a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:32.015452 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b3a133-db86-4418-9037-866702a9e6a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:32.017244 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b3a133-db86-4418-9037-866702a9e6a1 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:32.019933 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:32.034794 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 87/164] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:13:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:32.036040 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b3a133-db86-4418-9037-866702a9e6a1 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:32.036944 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a9858-12ed-430d-ba0e-009806a2e473 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:32.074820 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a953ee6-12fd-470d-9886-7557bfe14daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:32.075477 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a953ee6-12fd-470d-9886-7557bfe14daf None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:32.075760 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a953ee6-12fd-470d-9886-7557bfe14daf None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:32.076054 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a953ee6-12fd-470d-9886-7557bfe14daf None admin] PATH_INFO: `/v3/users/a107bc03b1f041ceb3d4a7e34f3699ab` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:32.077311 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a953ee6-12fd-470d-9886-7557bfe14daf None admin] RBAC: Authorizing `identity:get_user(user_id=a107bc03b1f041ceb3d4a7e34f3699ab)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:32.078864 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a953ee6-12fd-470d-9886-7557bfe14daf None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:32.080785 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 78/165] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Aug 29 22:13:31 2022] GET /identity/v3/users/a107bc03b1f041ceb3d4a7e34f3699ab => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:32.081554 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a953ee6-12fd-470d-9886-7557bfe14daf None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:32.116714 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:32.181987 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b3a133-db86-4418-9037-866702a9e6a1 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:32.203950 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a953ee6-12fd-470d-9886-7557bfe14daf None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:32.245620 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c134c0-4e67-4e36-83be-c5aba17593c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:32.245850 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a2eb00-059f-49ba-8eb9-616a472bf318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:32.246262 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c134c0-4e67-4e36-83be-c5aba17593c2 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:32.246366 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2eb00-059f-49ba-8eb9-616a472bf318 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:32.246536 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c134c0-4e67-4e36-83be-c5aba17593c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:32.246635 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2eb00-059f-49ba-8eb9-616a472bf318 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:32.246813 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c134c0-4e67-4e36-83be-c5aba17593c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:32.246921 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2eb00-059f-49ba-8eb9-616a472bf318 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:32.247536 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a2eb00-059f-49ba-8eb9-616a472bf318 None admin] RBAC: Adding query filter params (name=member) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:32.247840 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a2eb00-059f-49ba-8eb9-616a472bf318 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:32.249247 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a2eb00-059f-49ba-8eb9-616a472bf318 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:32.250895 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:32.274401 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 88/166] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Aug 29 22:13:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:32.275457 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a2eb00-059f-49ba-8eb9-616a472bf318 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:32.323404 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c134c0-4e67-4e36-83be-c5aba17593c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:32.325055 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c134c0-4e67-4e36-83be-c5aba17593c2 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:32.440911 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 79/167] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:13:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:13:32.441630 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c134c0-4e67-4e36-83be-c5aba17593c2 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:32.505251 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:32.604809 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a2eb00-059f-49ba-8eb9-616a472bf318 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:32.642098 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c134c0-4e67-4e36-83be-c5aba17593c2 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:32.663047 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:32.701774 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5141d00-5a53-462a-826e-b1b79b2fda34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:32.702397 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5141d00-5a53-462a-826e-b1b79b2fda34 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:32.702687 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5141d00-5a53-462a-826e-b1b79b2fda34 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:32.702966 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5141d00-5a53-462a-826e-b1b79b2fda34 None admin] PATH_INFO: `/v3/users/6b5654a5750846779dda7b1bf48a68d8` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:32.711376 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5141d00-5a53-462a-826e-b1b79b2fda34 None admin] RBAC: Authorizing `identity:get_user(user_id=6b5654a5750846779dda7b1bf48a68d8)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:32.713071 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5141d00-5a53-462a-826e-b1b79b2fda34 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:32.714972 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 89/168] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Aug 29 22:13:32 2022] GET /identity/v3/users/6b5654a5750846779dda7b1bf48a68d8 => generated 247 bytes in 440 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:32.715528 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5141d00-5a53-462a-826e-b1b79b2fda34 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:32.717786 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2751fa44-5e33-43a2-a710-a50f303035a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:32.718420 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751fa44-5e33-43a2-a710-a50f303035a2 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:32.718700 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751fa44-5e33-43a2-a710-a50f303035a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:32.718971 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751fa44-5e33-43a2-a710-a50f303035a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:32.882478 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5141d00-5a53-462a-826e-b1b79b2fda34 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:32.921591 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2751fa44-5e33-43a2-a710-a50f303035a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:32.922806 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be07c5db-c195-4b2a-b942-ed288f5cd668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:32.923736 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07c5db-c195-4b2a-b942-ed288f5cd668 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:32.924030 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2751fa44-5e33-43a2-a710-a50f303035a2 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:32.924310 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07c5db-c195-4b2a-b942-ed288f5cd668 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:32.924760 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07c5db-c195-4b2a-b942-ed288f5cd668 None admin] PATH_INFO: `/v3/users/a107bc03b1f041ceb3d4a7e34f3699ab` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:32.926526 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be07c5db-c195-4b2a-b942-ed288f5cd668 None admin] RBAC: Authorizing `identity:get_user(user_id=a107bc03b1f041ceb3d4a7e34f3699ab)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:32.929151 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be07c5db-c195-4b2a-b942-ed288f5cd668 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:32.930978 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 90/169] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Aug 29 22:13:32 2022] GET /identity/v3/users/a107bc03b1f041ceb3d4a7e34f3699ab => generated 275 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:32.932443 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be07c5db-c195-4b2a-b942-ed288f5cd668 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:33.002215 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:33.030059 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:33.051408 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be07c5db-c195-4b2a-b942-ed288f5cd668 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:33.090673 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b96bdca-3924-4bdc-95d6-da70f07d0731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:33.091736 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b96bdca-3924-4bdc-95d6-da70f07d0731 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:33.092219 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b96bdca-3924-4bdc-95d6-da70f07d0731 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:33.092725 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b96bdca-3924-4bdc-95d6-da70f07d0731 None admin] PATH_INFO: `/v3/projects/72e0b172f95b4686aa832057c998ddbe` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:33.094346 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b96bdca-3924-4bdc-95d6-da70f07d0731 None admin] RBAC: Authorizing `identity:get_project(project_id=72e0b172f95b4686aa832057c998ddbe)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:33.096098 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b96bdca-3924-4bdc-95d6-da70f07d0731 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:33.098742 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 91/170] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Aug 29 22:13:32 2022] GET /identity/v3/projects/72e0b172f95b4686aa832057c998ddbe => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:33.100422 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b96bdca-3924-4bdc-95d6-da70f07d0731 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:33.187831 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 80/171] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:13:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 747 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:13:33.189150 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644104cd-16a0-425e-bd61-81392122da53 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:33.189590 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644104cd-16a0-425e-bd61-81392122da53 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:33.189872 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644104cd-16a0-425e-bd61-81392122da53 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:33.191282 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 81/172] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:13:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:13:33.191822 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644104cd-16a0-425e-bd61-81392122da53 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:33.289948 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b96bdca-3924-4bdc-95d6-da70f07d0731 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:33.320041 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:33.330614 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b61db-d59e-4a77-ab80-eec69b3ba4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:33.331009 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b61db-d59e-4a77-ab80-eec69b3ba4f8 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:33.331292 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b61db-d59e-4a77-ab80-eec69b3ba4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:33.331608 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b61db-d59e-4a77-ab80-eec69b3ba4f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:33.355563 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644104cd-16a0-425e-bd61-81392122da53 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:33.404867 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e464cbe-eb30-4020-a4eb-c57d12628ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:33.405477 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e464cbe-eb30-4020-a4eb-c57d12628ce0 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:33.405751 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e464cbe-eb30-4020-a4eb-c57d12628ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:33.406021 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e464cbe-eb30-4020-a4eb-c57d12628ce0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:33.408507 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b61db-d59e-4a77-ab80-eec69b3ba4f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:33.410198 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b61db-d59e-4a77-ab80-eec69b3ba4f8 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:33.410500 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:33.492894 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e464cbe-eb30-4020-a4eb-c57d12628ce0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:33.495340 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e464cbe-eb30-4020-a4eb-c57d12628ce0 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:33.515930 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 92/173] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:13:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:13:33.516823 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b61db-d59e-4a77-ab80-eec69b3ba4f8 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:33.547947 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:33.597216 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 82/174] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:13:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:13:33.598069 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e464cbe-eb30-4020-a4eb-c57d12628ce0 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:33.620396 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b61db-d59e-4a77-ab80-eec69b3ba4f8 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:33.635559 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:33.656659 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459936ff-4658-40e6-a5a6-1972071cc1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:33.657285 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459936ff-4658-40e6-a5a6-1972071cc1fd None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:33.657562 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459936ff-4658-40e6-a5a6-1972071cc1fd None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:33.657984 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459936ff-4658-40e6-a5a6-1972071cc1fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:33.659063 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459936ff-4658-40e6-a5a6-1972071cc1fd None admin] RBAC: Adding query filter params (role.id=8767fe0bd994478fac741fc8c76f649e, scope.project.id=72e0b172f95b4686aa832057c998ddbe, user.id=a107bc03b1f041ceb3d4a7e34f3699ab) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:33.659375 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459936ff-4658-40e6-a5a6-1972071cc1fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:33.660880 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459936ff-4658-40e6-a5a6-1972071cc1fd None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:33.667625 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 93/175] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Aug 29 22:13:33 2022] GET /identity/v3/role_assignments?user.id=a107bc03b1f041ceb3d4a7e34f3699ab&scope.project.id=72e0b172f95b4686aa832057c998ddbe&role.id=8767fe0bd994478fac741fc8c76f649e => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:33.668895 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a7a64-a1f2-4b16-b89d-2058632a7bac None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:33.669181 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a7a64-a1f2-4b16-b89d-2058632a7bac None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:33.669456 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a7a64-a1f2-4b16-b89d-2058632a7bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:33.690331 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-be9a7a64-a1f2-4b16-b89d-2058632a7bac None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:13:33.691587 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-be9a7a64-a1f2-4b16-b89d-2058632a7bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:13:33.710313 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e464cbe-eb30-4020-a4eb-c57d12628ce0 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:33.749929 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce20fe-1634-44e4-be62-623f30ff518f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:33.750683 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce20fe-1634-44e4-be62-623f30ff518f None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:33.751040 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce20fe-1634-44e4-be62-623f30ff518f None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:33.751379 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce20fe-1634-44e4-be62-623f30ff518f None admin] PATH_INFO: `/v3/projects/72e0b172f95b4686aa832057c998ddbe` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:33.752779 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccce20fe-1634-44e4-be62-623f30ff518f None admin] RBAC: Authorizing `identity:get_project(project_id=72e0b172f95b4686aa832057c998ddbe)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:33.754268 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccce20fe-1634-44e4-be62-623f30ff518f None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:33.761698 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 83/176] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Aug 29 22:13:33 2022] GET /identity/v3/projects/72e0b172f95b4686aa832057c998ddbe => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:33.761698 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb72875-e03d-40f3-abb6-c9e6beed2fb8 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:33.761698 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb72875-e03d-40f3-abb6-c9e6beed2fb8 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:33.761698 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb72875-e03d-40f3-abb6-c9e6beed2fb8 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:33.761698 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 84/177] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:13:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:13:33.761698 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b371d-9701-4dbc-8afd-8ab67f884346 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:33.763478 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b371d-9701-4dbc-8afd-8ab67f884346 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:33.763478 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b371d-9701-4dbc-8afd-8ab67f884346 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:33.763478 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 85/178] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:13:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:13:33.763478 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01340cd-8b30-47c5-aee7-6b3078945926 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:33.763713 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01340cd-8b30-47c5-aee7-6b3078945926 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:33.764038 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01340cd-8b30-47c5-aee7-6b3078945926 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:33.765926 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 86/179] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:13:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:13:33.766277 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01340cd-8b30-47c5-aee7-6b3078945926 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:33.781740 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 94/180] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:13:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:13:33.782961 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a7a64-a1f2-4b16-b89d-2058632a7bac None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:33.809833 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:33.905870 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01340cd-8b30-47c5-aee7-6b3078945926 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:33.910035 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:33.918508 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a7a64-a1f2-4b16-b89d-2058632a7bac None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:33.955860 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e0aca-1f31-4193-bd23-bb0b566953d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:33.956527 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e0aca-1f31-4193-bd23-bb0b566953d0 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:33.956805 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e0aca-1f31-4193-bd23-bb0b566953d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:33.957243 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e0aca-1f31-4193-bd23-bb0b566953d0 None admin] PATH_INFO: `/v3/projects/72e0b172f95b4686aa832057c998ddbe` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:33.960210 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e0aca-1f31-4193-bd23-bb0b566953d0 None admin] RBAC: Authorizing `identity:get_project(project_id=72e0b172f95b4686aa832057c998ddbe)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:33.961395 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f71ad6-22f4-4731-a2a9-a019164bba7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:33.961740 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e0aca-1f31-4193-bd23-bb0b566953d0 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:33.962060 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f71ad6-22f4-4731-a2a9-a019164bba7f None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:33.962665 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f71ad6-22f4-4731-a2a9-a019164bba7f None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:33.963125 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f71ad6-22f4-4731-a2a9-a019164bba7f None admin] PATH_INFO: `/v3/projects/1c70b5e26a7749d68e05e4c899c6fed7` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:33.963485 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 87/181] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Aug 29 22:13:33 2022] GET /identity/v3/projects/72e0b172f95b4686aa832057c998ddbe => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:33.964343 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e0aca-1f31-4193-bd23-bb0b566953d0 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:33.969248 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f71ad6-22f4-4731-a2a9-a019164bba7f None admin] RBAC: Authorizing `identity:get_project(project_id=1c70b5e26a7749d68e05e4c899c6fed7)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:33.970714 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f71ad6-22f4-4731-a2a9-a019164bba7f None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:33.977458 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 95/182] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Aug 29 22:13:33 2022] GET /identity/v3/projects/1c70b5e26a7749d68e05e4c899c6fed7 => generated 312 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:33.977458 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49222d-d3b1-4718-83e7-60049dec9e5e None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:33.977458 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49222d-d3b1-4718-83e7-60049dec9e5e None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:33.977458 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49222d-d3b1-4718-83e7-60049dec9e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:33.995145 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-3b49222d-d3b1-4718-83e7-60049dec9e5e None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:13:33.996755 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-3b49222d-d3b1-4718-83e7-60049dec9e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:13:34.069663 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 96/183] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:13:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:13:34.070925 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed0d23-c60b-472f-98e0-d9ff91d45ea8 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:34.071219 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed0d23-c60b-472f-98e0-d9ff91d45ea8 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:34.071494 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed0d23-c60b-472f-98e0-d9ff91d45ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:34.081480 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e0aca-1f31-4193-bd23-bb0b566953d0 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:34.100837 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-e3ed0d23-c60b-472f-98e0-d9ff91d45ea8 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:13:34.102323 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-e3ed0d23-c60b-472f-98e0-d9ff91d45ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:13:34.120030 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deccb10a-e762-497a-ba58-731b5d751583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:34.120677 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deccb10a-e762-497a-ba58-731b5d751583 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:34.121036 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deccb10a-e762-497a-ba58-731b5d751583 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:34.121308 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deccb10a-e762-497a-ba58-731b5d751583 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:34.121460 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:34.122335 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deccb10a-e762-497a-ba58-731b5d751583 None admin] RBAC: Adding query filter params (role.id=c358a37c24fe42bca4a93331f2c99d90, scope.project.id=72e0b172f95b4686aa832057c998ddbe, user.id=a107bc03b1f041ceb3d4a7e34f3699ab) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:34.122335 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deccb10a-e762-497a-ba58-731b5d751583 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:34.123982 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deccb10a-e762-497a-ba58-731b5d751583 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:34.130723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 88/184] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Aug 29 22:13:33 2022] GET /identity/v3/role_assignments?user.id=a107bc03b1f041ceb3d4a7e34f3699ab&scope.project.id=72e0b172f95b4686aa832057c998ddbe&role.id=c358a37c24fe42bca4a93331f2c99d90 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:34.138429 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4cb83c-b067-4611-85e4-f03af800f92d None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:34.139488 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4cb83c-b067-4611-85e4-f03af800f92d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:34.140216 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4cb83c-b067-4611-85e4-f03af800f92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:34.165335 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-cd4cb83c-b067-4611-85e4-f03af800f92d None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:13:34.168221 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-cd4cb83c-b067-4611-85e4-f03af800f92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:13:34.192420 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 97/185] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:13:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:13:34.193477 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed0d23-c60b-472f-98e0-d9ff91d45ea8 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:34.210625 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:34.264024 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 89/186] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:13:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:13:34.265281 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4cb83c-b067-4611-85e4-f03af800f92d None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:34.333663 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed0d23-c60b-472f-98e0-d9ff91d45ea8 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:34.376897 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8840d625-8c34-462b-b082-44d2038ed9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:34.377885 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840d625-8c34-462b-b082-44d2038ed9c4 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:34.378340 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840d625-8c34-462b-b082-44d2038ed9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:34.378802 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840d625-8c34-462b-b082-44d2038ed9c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:34.379759 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8840d625-8c34-462b-b082-44d2038ed9c4 None admin] RBAC: Adding query filter params (role.id=ff59a239a50b4bd899a83bf3c3fd1f63, scope.project.id=72e0b172f95b4686aa832057c998ddbe, user.id=6b5654a5750846779dda7b1bf48a68d8) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:34.380278 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8840d625-8c34-462b-b082-44d2038ed9c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:34.381950 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8840d625-8c34-462b-b082-44d2038ed9c4 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:34.389548 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 98/187] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Aug 29 22:13:34 2022] GET /identity/v3/role_assignments?user.id=6b5654a5750846779dda7b1bf48a68d8&scope.project.id=72e0b172f95b4686aa832057c998ddbe&role.id=ff59a239a50b4bd899a83bf3c3fd1f63 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:34.391123 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8840d625-8c34-462b-b082-44d2038ed9c4 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:34.399598 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4cb83c-b067-4611-85e4-f03af800f92d None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:34.410022 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:34.457422 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2983e6f-3ad0-48f2-b4d4-e7edb8cd2c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:34.458683 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2983e6f-3ad0-48f2-b4d4-e7edb8cd2c46 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:34.459673 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2983e6f-3ad0-48f2-b4d4-e7edb8cd2c46 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:34.460143 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2983e6f-3ad0-48f2-b4d4-e7edb8cd2c46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:34.461385 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2983e6f-3ad0-48f2-b4d4-e7edb8cd2c46 None admin] RBAC: Adding query filter params (role.id=c358a37c24fe42bca4a93331f2c99d90, scope.project.id=1c70b5e26a7749d68e05e4c899c6fed7, user.id=a107bc03b1f041ceb3d4a7e34f3699ab) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:34.461911 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2983e6f-3ad0-48f2-b4d4-e7edb8cd2c46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:34.464388 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2983e6f-3ad0-48f2-b4d4-e7edb8cd2c46 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:34.474113 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 90/188] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Aug 29 22:13:34 2022] GET /identity/v3/role_assignments?user.id=a107bc03b1f041ceb3d4a7e34f3699ab&scope.project.id=1c70b5e26a7749d68e05e4c899c6fed7&role.id=c358a37c24fe42bca4a93331f2c99d90 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:34.475920 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2983e6f-3ad0-48f2-b4d4-e7edb8cd2c46 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:34.523879 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:34.541301 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8840d625-8c34-462b-b082-44d2038ed9c4 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:34.588695 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d715d-65d5-4927-8974-526c41a727b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:34.589827 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d715d-65d5-4927-8974-526c41a727b0 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:34.590303 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d715d-65d5-4927-8974-526c41a727b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:34.590929 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d715d-65d5-4927-8974-526c41a727b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:34.606186 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1d715d-65d5-4927-8974-526c41a727b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:13:34.613362 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2983e6f-3ad0-48f2-b4d4-e7edb8cd2c46 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:34.614781 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-ab1d715d-65d5-4927-8974-526c41a727b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:13:34.614781 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:13:34.614781 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:13:34.614781 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:13:34.614781 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:13:34.614781 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:13:34.614781 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:13:34.614781 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:13:34.614781 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:13:34.614781 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:13:34.614781 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:13:34.614781 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:13:34.614781 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:13:34.614781 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:13:34.614781 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:13:34.614781 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:13:34.615664 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:13:34.615664 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:13:34.615664 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:13:34.615664 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:13:34.615664 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:13:34.615664 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:13:34.615664 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:13:34.615664 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:13:34.615664 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:13:34.615664 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:13:34.615664 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:13:34.615664 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:13:34.615664 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:13:34.615664 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:13:34.615664 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:13:34.615664 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:13:34.616521 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:13:34.616521 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:13:34.616521 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:13:34.616521 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:13:34.616521 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:13:34.616521 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:13:34.616521 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:13:34.616521 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:13:34.616521 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:13:34.616521 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:13:34.616521 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:13:34.616521 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:13:34.617737 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 99/189] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Aug 29 22:13:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:13:34.630297 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d715d-65d5-4927-8974-526c41a727b0 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:34.677498 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b243ab9b-f3bd-4d2d-96e3-d6f26bddf707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:34.678557 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243ab9b-f3bd-4d2d-96e3-d6f26bddf707 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:34.679038 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243ab9b-f3bd-4d2d-96e3-d6f26bddf707 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:34.679507 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243ab9b-f3bd-4d2d-96e3-d6f26bddf707 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:34.696040 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b243ab9b-f3bd-4d2d-96e3-d6f26bddf707 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:13:34.705284 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-b243ab9b-f3bd-4d2d-96e3-d6f26bddf707 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:13:34.705284 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:13:34.705284 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:13:34.705284 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:13:34.705284 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:13:34.705284 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:13:34.705284 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:13:34.705284 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:13:34.705284 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:13:34.705284 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:13:34.705284 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:13:34.705284 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:13:34.705284 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:13:34.705284 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:13:34.705284 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:13:34.705284 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:13:34.706251 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:13:34.706251 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:13:34.706251 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:13:34.706251 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:13:34.706251 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:13:34.706251 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:13:34.706251 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:13:34.706251 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:13:34.706251 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:13:34.706251 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:13:34.706251 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:13:34.706251 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:13:34.706251 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:13:34.706251 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:13:34.706251 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:13:34.706251 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:13:34.707074 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:13:34.707074 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:13:34.707074 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:13:34.707074 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:13:34.707074 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:13:34.707074 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:13:34.707074 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:13:34.707074 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:13:34.707074 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:13:34.707074 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:13:34.707074 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:13:34.707074 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:13:34.709993 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 91/190] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Aug 29 22:13:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:13:34.717420 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b243ab9b-f3bd-4d2d-96e3-d6f26bddf707 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:34.745030 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:34.783235 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d715d-65d5-4927-8974-526c41a727b0 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:34.828512 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae11f9-ebde-47ca-864b-70f9384b60c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:34.828967 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae11f9-ebde-47ca-864b-70f9384b60c7 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:34.829291 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae11f9-ebde-47ca-864b-70f9384b60c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:34.829555 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae11f9-ebde-47ca-864b-70f9384b60c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:34.830179 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ae11f9-ebde-47ca-864b-70f9384b60c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:34.830496 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ae11f9-ebde-47ca-864b-70f9384b60c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:34.831920 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ae11f9-ebde-47ca-864b-70f9384b60c7 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:34.839889 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:34.843112 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 100/191] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:13:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:13:34.843823 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae11f9-ebde-47ca-864b-70f9384b60c7 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:34.851755 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b243ab9b-f3bd-4d2d-96e3-d6f26bddf707 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:34.896542 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da040edd-6ab0-44e0-9861-cd389480bbde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:34.897113 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da040edd-6ab0-44e0-9861-cd389480bbde None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:34.897392 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da040edd-6ab0-44e0-9861-cd389480bbde None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:34.897664 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da040edd-6ab0-44e0-9861-cd389480bbde None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:34.898342 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da040edd-6ab0-44e0-9861-cd389480bbde None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:34.898937 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da040edd-6ab0-44e0-9861-cd389480bbde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:34.900120 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da040edd-6ab0-44e0-9861-cd389480bbde None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:34.908255 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 92/192] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Aug 29 22:13:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:13:34.908255 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da040edd-6ab0-44e0-9861-cd389480bbde None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:34.953327 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae11f9-ebde-47ca-864b-70f9384b60c7 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:34.986456 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27a05b-7369-4370-9570-995d9ff787c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:34.987106 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27a05b-7369-4370-9570-995d9ff787c5 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:34.987381 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27a05b-7369-4370-9570-995d9ff787c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:34.987652 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27a05b-7369-4370-9570-995d9ff787c5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:34.990286 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:34.999510 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb27a05b-7369-4370-9570-995d9ff787c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:13:35.004955 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-fb27a05b-7369-4370-9570-995d9ff787c5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:13:35.004955 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:13:35.004955 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:13:35.004955 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:13:35.004955 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:13:35.004955 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:13:35.004955 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:13:35.004955 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:13:35.004955 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:13:35.004955 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:13:35.004955 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:13:35.004955 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:13:35.004955 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:13:35.004955 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:13:35.004955 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:13:35.004955 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:13:35.005867 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:13:35.005867 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:13:35.005867 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:13:35.005867 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:13:35.005867 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:13:35.005867 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:13:35.005867 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:13:35.005867 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:13:35.005867 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:13:35.005867 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:13:35.005867 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:13:35.005867 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:13:35.005867 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:13:35.005867 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:13:35.005867 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:13:35.005867 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:13:35.006656 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:13:35.006656 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:13:35.006656 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:13:35.006656 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:13:35.006656 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:13:35.006656 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:13:35.006656 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:13:35.006656 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:13:35.006656 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:13:35.006656 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:13:35.006656 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:13:35.006656 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:13:35.006656 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 101/193] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:13:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:13:35.007973 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27a05b-7369-4370-9570-995d9ff787c5 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:35.014763 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da040edd-6ab0-44e0-9861-cd389480bbde None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:35.051274 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1c2c0-02a1-4a09-9810-e7843f8fd36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:35.051909 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1c2c0-02a1-4a09-9810-e7843f8fd36d None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:35.052175 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1c2c0-02a1-4a09-9810-e7843f8fd36d None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:35.052484 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1c2c0-02a1-4a09-9810-e7843f8fd36d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:35.053590 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c1c2c0-02a1-4a09-9810-e7843f8fd36d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:35.055076 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c1c2c0-02a1-4a09-9810-e7843f8fd36d None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:35.061434 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 93/194] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:13:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:35.061434 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1c2c0-02a1-4a09-9810-e7843f8fd36d None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:35.086655 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:35.110705 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27a05b-7369-4370-9570-995d9ff787c5 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:35.151795 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f5ef0-40d9-41d6-a801-1954b149257c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:35.152404 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f5ef0-40d9-41d6-a801-1954b149257c None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:35.152709 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f5ef0-40d9-41d6-a801-1954b149257c None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:35.152979 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f5ef0-40d9-41d6-a801-1954b149257c None admin] PATH_INFO: `/v3/users/f00ea433bb35435c80365d30c3f58e0e` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:35.169645 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5f5ef0-40d9-41d6-a801-1954b149257c None admin] RBAC: Authorizing `identity:get_user(user_id=f00ea433bb35435c80365d30c3f58e0e)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:35.171086 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5f5ef0-40d9-41d6-a801-1954b149257c None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:35.172782 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 102/195] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Aug 29 22:13:35 2022] GET /identity/v3/users/f00ea433bb35435c80365d30c3f58e0e => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:35.173541 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f5ef0-40d9-41d6-a801-1954b149257c None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:35.173646 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1c2c0-02a1-4a09-9810-e7843f8fd36d None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:35.210281 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c2b84-3552-443c-b039-0b3f20d7dd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:35.211314 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c2b84-3552-443c-b039-0b3f20d7dd2a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:35.211787 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c2b84-3552-443c-b039-0b3f20d7dd2a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:35.212290 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c2b84-3552-443c-b039-0b3f20d7dd2a None admin] PATH_INFO: `/v3/users/f00ea433bb35435c80365d30c3f58e0e` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:35.214097 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c2b84-3552-443c-b039-0b3f20d7dd2a None admin] RBAC: Authorizing `identity:get_user(user_id=f00ea433bb35435c80365d30c3f58e0e)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:35.216350 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c2b84-3552-443c-b039-0b3f20d7dd2a None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:35.219020 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 94/196] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Aug 29 22:13:35 2022] GET /identity/v3/users/f00ea433bb35435c80365d30c3f58e0e => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:35.219894 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c2b84-3552-443c-b039-0b3f20d7dd2a None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:35.233780 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:35.286292 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f5ef0-40d9-41d6-a801-1954b149257c None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:35.328416 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8e170-b9b6-427a-9272-cb2dd178afed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:35.329079 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8e170-b9b6-427a-9272-cb2dd178afed None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:35.329358 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8e170-b9b6-427a-9272-cb2dd178afed None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:35.329632 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8e170-b9b6-427a-9272-cb2dd178afed None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:35.330319 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da8e170-b9b6-427a-9272-cb2dd178afed None admin] RBAC: Adding query filter params (name=reader) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:35.330617 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da8e170-b9b6-427a-9272-cb2dd178afed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:35.332022 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da8e170-b9b6-427a-9272-cb2dd178afed None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:35.335540 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:35.344116 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 103/197] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Aug 29 22:13:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:35.347082 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8e170-b9b6-427a-9272-cb2dd178afed None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:35.354496 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c2b84-3552-443c-b039-0b3f20d7dd2a None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:35.399008 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a6bf8-c2a6-4f24-ace7-31413db7285f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:35.399539 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a6bf8-c2a6-4f24-ace7-31413db7285f None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:35.399854 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a6bf8-c2a6-4f24-ace7-31413db7285f None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:35.400127 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a6bf8-c2a6-4f24-ace7-31413db7285f None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:35.401058 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4a6bf8-c2a6-4f24-ace7-31413db7285f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:35.403320 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4a6bf8-c2a6-4f24-ace7-31413db7285f None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:35.429838 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 95/198] 10.222.0.36 () {60 vars in 1132 bytes} [Mon Aug 29 22:13:35 2022] POST /identity/v3/users => generated 297 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:13:35.437489 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a6bf8-c2a6-4f24-ace7-31413db7285f None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:35.473264 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8e170-b9b6-427a-9272-cb2dd178afed None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:35.492894 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:35.517280 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f851b-0a3d-48f8-82ce-342de271e73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:35.517903 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f851b-0a3d-48f8-82ce-342de271e73a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:35.518185 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f851b-0a3d-48f8-82ce-342de271e73a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:35.518447 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f851b-0a3d-48f8-82ce-342de271e73a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:35.590454 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a6bf8-c2a6-4f24-ace7-31413db7285f None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:35.610425 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4f851b-0a3d-48f8-82ce-342de271e73a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:35.611919 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4f851b-0a3d-48f8-82ce-342de271e73a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:35.634881 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d436d7-0839-4d9d-af19-411831b4f366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:35.635605 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d436d7-0839-4d9d-af19-411831b4f366 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:35.635998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d436d7-0839-4d9d-af19-411831b4f366 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:35.636404 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d436d7-0839-4d9d-af19-411831b4f366 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:35.656307 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:35.735679 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d436d7-0839-4d9d-af19-411831b4f366 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:35.739053 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d436d7-0839-4d9d-af19-411831b4f366 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:35.762015 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 104/199] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:13:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:13:35.762894 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f851b-0a3d-48f8-82ce-342de271e73a None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:35.785253 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:35.887649 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 96/200] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:13:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:13:35.888583 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f851b-0a3d-48f8-82ce-342de271e73a None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:35.891849 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d436d7-0839-4d9d-af19-411831b4f366 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:35.929032 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5bce13-44cd-4e19-9846-97f08ab70647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:35.929618 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5bce13-44cd-4e19-9846-97f08ab70647 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:35.929954 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5bce13-44cd-4e19-9846-97f08ab70647 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:35.930213 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5bce13-44cd-4e19-9846-97f08ab70647 None admin] PATH_INFO: `/v3/users/dce5a2b9e2a34b80a10cf521b36c532b` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:35.932330 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5bce13-44cd-4e19-9846-97f08ab70647 None admin] RBAC: Authorizing `identity:get_user(user_id=dce5a2b9e2a34b80a10cf521b36c532b)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:35.933880 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5bce13-44cd-4e19-9846-97f08ab70647 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:35.935535 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 105/201] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Aug 29 22:13:35 2022] GET /identity/v3/users/dce5a2b9e2a34b80a10cf521b36c532b => generated 289 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:35.936325 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5bce13-44cd-4e19-9846-97f08ab70647 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:35.949595 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:36.013700 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d436d7-0839-4d9d-af19-411831b4f366 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:36.036657 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:36.055412 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5bce13-44cd-4e19-9846-97f08ab70647 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:36.055824 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cd7524-18e0-40bd-a68a-9a482a88a050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:36.056582 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd7524-18e0-40bd-a68a-9a482a88a050 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:36.057133 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd7524-18e0-40bd-a68a-9a482a88a050 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:36.057133 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd7524-18e0-40bd-a68a-9a482a88a050 None admin] PATH_INFO: `/v3/projects/e0b257f7f1874d8483a2453331254e1a` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:36.058531 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cd7524-18e0-40bd-a68a-9a482a88a050 None admin] RBAC: Authorizing `identity:get_project(project_id=e0b257f7f1874d8483a2453331254e1a)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:36.060565 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cd7524-18e0-40bd-a68a-9a482a88a050 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:36.063317 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 97/202] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Aug 29 22:13:35 2022] GET /identity/v3/projects/e0b257f7f1874d8483a2453331254e1a => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:36.064218 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cd7524-18e0-40bd-a68a-9a482a88a050 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:36.096791 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea78294-1968-4df0-81d6-4fc6fae44bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:36.097833 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea78294-1968-4df0-81d6-4fc6fae44bd3 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:36.098339 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea78294-1968-4df0-81d6-4fc6fae44bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:36.098786 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea78294-1968-4df0-81d6-4fc6fae44bd3 None admin] PATH_INFO: `/v3/projects/e0b257f7f1874d8483a2453331254e1a` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:36.100369 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea78294-1968-4df0-81d6-4fc6fae44bd3 None admin] RBAC: Authorizing `identity:get_project(project_id=e0b257f7f1874d8483a2453331254e1a)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:36.102074 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea78294-1968-4df0-81d6-4fc6fae44bd3 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:36.105302 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 106/203] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Aug 29 22:13:35 2022] GET /identity/v3/projects/e0b257f7f1874d8483a2453331254e1a => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:36.106334 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea78294-1968-4df0-81d6-4fc6fae44bd3 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:36.176001 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cd7524-18e0-40bd-a68a-9a482a88a050 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:36.190179 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:36.213966 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2f2ba-06de-4eda-b939-c16b7796f9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:36.214664 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2f2ba-06de-4eda-b939-c16b7796f9c0 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:36.214952 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2f2ba-06de-4eda-b939-c16b7796f9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:36.215353 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2f2ba-06de-4eda-b939-c16b7796f9c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:36.221024 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea78294-1968-4df0-81d6-4fc6fae44bd3 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:36.260591 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4128730-cf0c-4e0d-bf4e-066c4b8729dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:36.261677 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4128730-cf0c-4e0d-bf4e-066c4b8729dc None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:36.262160 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4128730-cf0c-4e0d-bf4e-066c4b8729dc None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:36.262746 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4128730-cf0c-4e0d-bf4e-066c4b8729dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:36.263717 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4128730-cf0c-4e0d-bf4e-066c4b8729dc None admin] RBAC: Adding query filter params (role.id=ff59a239a50b4bd899a83bf3c3fd1f63, scope.project.id=e0b257f7f1874d8483a2453331254e1a, user.id=f00ea433bb35435c80365d30c3f58e0e) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:36.264299 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4128730-cf0c-4e0d-bf4e-066c4b8729dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:36.266601 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4128730-cf0c-4e0d-bf4e-066c4b8729dc None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:36.273293 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 107/204] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Aug 29 22:13:36 2022] GET /identity/v3/role_assignments?user.id=f00ea433bb35435c80365d30c3f58e0e&scope.project.id=e0b257f7f1874d8483a2453331254e1a&role.id=ff59a239a50b4bd899a83bf3c3fd1f63 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:36.274479 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4128730-cf0c-4e0d-bf4e-066c4b8729dc None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:36.291838 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb2f2ba-06de-4eda-b939-c16b7796f9c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:36.293447 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb2f2ba-06de-4eda-b939-c16b7796f9c0 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:36.297946 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:36.397804 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4128730-cf0c-4e0d-bf4e-066c4b8729dc None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:36.457104 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafafdf4-95f0-4770-b8c7-7ee1737fead6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:36.461651 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafafdf4-95f0-4770-b8c7-7ee1737fead6 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:36.462563 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafafdf4-95f0-4770-b8c7-7ee1737fead6 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:36.464553 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafafdf4-95f0-4770-b8c7-7ee1737fead6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:36.465936 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafafdf4-95f0-4770-b8c7-7ee1737fead6 None admin] RBAC: Adding query filter params (role.id=8767fe0bd994478fac741fc8c76f649e, scope.project.id=e0b257f7f1874d8483a2453331254e1a, user.id=f00ea433bb35435c80365d30c3f58e0e) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:36.466245 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafafdf4-95f0-4770-b8c7-7ee1737fead6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:36.467957 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafafdf4-95f0-4770-b8c7-7ee1737fead6 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:36.475904 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 108/205] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Aug 29 22:13:36 2022] GET /identity/v3/role_assignments?user.id=f00ea433bb35435c80365d30c3f58e0e&scope.project.id=e0b257f7f1874d8483a2453331254e1a&role.id=8767fe0bd994478fac741fc8c76f649e => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:36.480765 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 98/206] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:13:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:13:36.488320 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafafdf4-95f0-4770-b8c7-7ee1737fead6 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:36.592152 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:36.649327 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafafdf4-95f0-4770-b8c7-7ee1737fead6 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:36.702875 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222db174-1414-40c5-ae73-861a37895934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:36.703514 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222db174-1414-40c5-ae73-861a37895934 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:36.703790 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222db174-1414-40c5-ae73-861a37895934 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:36.704057 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222db174-1414-40c5-ae73-861a37895934 None admin] PATH_INFO: `/v3/projects/72e0b172f95b4686aa832057c998ddbe` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:36.705350 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222db174-1414-40c5-ae73-861a37895934 None admin] RBAC: Authorizing `identity:get_project(project_id=72e0b172f95b4686aa832057c998ddbe)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:36.706788 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222db174-1414-40c5-ae73-861a37895934 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:36.708837 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 109/207] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Aug 29 22:13:36 2022] GET /identity/v3/projects/72e0b172f95b4686aa832057c998ddbe => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:36.715016 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2f2ba-06de-4eda-b939-c16b7796f9c0 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:36.731698 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:36.850332 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2f2ba-06de-4eda-b939-c16b7796f9c0 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:36.904226 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44534571-df3e-4ffb-8d4c-fbcdfa2c6806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:36.904963 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44534571-df3e-4ffb-8d4c-fbcdfa2c6806 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:36.905251 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44534571-df3e-4ffb-8d4c-fbcdfa2c6806 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:36.905527 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44534571-df3e-4ffb-8d4c-fbcdfa2c6806 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:36.906280 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44534571-df3e-4ffb-8d4c-fbcdfa2c6806 None admin] RBAC: Adding query filter params (role.id=750444f301bf44c59183e4c5470a0dc5, scope.project.id=72e0b172f95b4686aa832057c998ddbe, user.id=dce5a2b9e2a34b80a10cf521b36c532b) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:36.906588 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44534571-df3e-4ffb-8d4c-fbcdfa2c6806 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:36.908051 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44534571-df3e-4ffb-8d4c-fbcdfa2c6806 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:36.918208 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 99/208] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Aug 29 22:13:36 2022] GET /identity/v3/role_assignments?user.id=dce5a2b9e2a34b80a10cf521b36c532b&scope.project.id=72e0b172f95b4686aa832057c998ddbe&role.id=750444f301bf44c59183e4c5470a0dc5 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:37.646501 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a105b82-0fa1-4a08-9bd1-cdaaedf707ef None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:37.647021 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a105b82-0fa1-4a08-9bd1-cdaaedf707ef None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:37.647021 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a105b82-0fa1-4a08-9bd1-cdaaedf707ef None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:37.648641 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 110/209] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:13:37.653873 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b63e59-14ad-42c0-8163-74e810757079 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:37.654270 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b63e59-14ad-42c0-8163-74e810757079 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:37.654413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b63e59-14ad-42c0-8163-74e810757079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:37.673074 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-66b63e59-14ad-42c0-8163-74e810757079 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:13:37.674578 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-66b63e59-14ad-42c0-8163-74e810757079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:13:37.746286 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 100/210] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:13:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:13:37.959592 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f737134-2bac-4a20-93c2-b5c5b20c4b79 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:37.959891 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f737134-2bac-4a20-93c2-b5c5b20c4b79 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:37.960074 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f737134-2bac-4a20-93c2-b5c5b20c4b79 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:37.961416 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 111/211] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:13:37.966996 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387f9c0-e345-4cca-bf95-8141fb82a39d None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:37.967549 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387f9c0-e345-4cca-bf95-8141fb82a39d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:37.968030 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387f9c0-e345-4cca-bf95-8141fb82a39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:37.981512 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:37.987484 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-e387f9c0-e345-4cca-bf95-8141fb82a39d None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:13:37.989216 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e387f9c0-e345-4cca-bf95-8141fb82a39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:13:38.027503 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f737134-2bac-4a20-93c2-b5c5b20c4b79 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:38.060803 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 101/212] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:13:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:13:38.134986 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f737134-2bac-4a20-93c2-b5c5b20c4b79 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:38.172966 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3708b-a464-433c-8061-983eae232bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:38.173603 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3708b-a464-433c-8061-983eae232bf4 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:38.173876 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3708b-a464-433c-8061-983eae232bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:38.174141 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3708b-a464-433c-8061-983eae232bf4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:38.184916 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b3708b-a464-433c-8061-983eae232bf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:13:38.190237 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-f6b3708b-a464-433c-8061-983eae232bf4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:13:38.190237 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:13:38.190237 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:13:38.190237 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:13:38.190237 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:13:38.190237 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:13:38.190237 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:13:38.190237 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:13:38.190237 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:13:38.190237 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:13:38.190237 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:13:38.190237 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:13:38.190237 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:13:38.190237 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:13:38.190237 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:13:38.190237 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:13:38.191128 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:13:38.191128 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:13:38.191128 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:13:38.191128 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:13:38.191128 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:13:38.191128 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:13:38.191128 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:13:38.191128 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:13:38.191128 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:13:38.191128 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:13:38.191128 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:13:38.191128 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:13:38.191128 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:13:38.191128 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:13:38.191128 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:13:38.191128 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:13:38.191958 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:13:38.191958 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:13:38.191958 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:13:38.191958 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:13:38.191958 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:13:38.191958 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:13:38.191958 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:13:38.191958 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:13:38.191958 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:13:38.191958 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:13:38.191958 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:13:38.191958 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:13:38.191958 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 112/213] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:13:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:13:38.197457 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e387f9c0-e345-4cca-bf95-8141fb82a39d None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:38.301743 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e387f9c0-e345-4cca-bf95-8141fb82a39d None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:38.342265 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d7be1-d9f9-4d72-b326-fdfd6b846fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:38.342890 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d7be1-d9f9-4d72-b326-fdfd6b846fb1 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:38.343173 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d7be1-d9f9-4d72-b326-fdfd6b846fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:38.343448 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d7be1-d9f9-4d72-b326-fdfd6b846fb1 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:38.344489 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9d7be1-d9f9-4d72-b326-fdfd6b846fb1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:38.344805 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9d7be1-d9f9-4d72-b326-fdfd6b846fb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:38.346210 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9d7be1-d9f9-4d72-b326-fdfd6b846fb1 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:38.348628 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:38.355380 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3708b-a464-433c-8061-983eae232bf4 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:38.356539 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 102/214] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Aug 29 22:13:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:38.366143 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d7be1-d9f9-4d72-b326-fdfd6b846fb1 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:38.367166 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:38.465459 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3708b-a464-433c-8061-983eae232bf4 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:38.477278 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d7be1-d9f9-4d72-b326-fdfd6b846fb1 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:38.500167 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f58bb21-3ed2-4697-8ecf-a41ce70bb00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:38.500827 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58bb21-3ed2-4697-8ecf-a41ce70bb00a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:38.501108 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58bb21-3ed2-4697-8ecf-a41ce70bb00a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:38.501378 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58bb21-3ed2-4697-8ecf-a41ce70bb00a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:38.502477 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f58bb21-3ed2-4697-8ecf-a41ce70bb00a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:38.503919 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f58bb21-3ed2-4697-8ecf-a41ce70bb00a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:38.505811 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 113/215] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:13:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:13:38.511373 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89661c-52b8-489d-9d04-a06192c382fd None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:38.511692 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89661c-52b8-489d-9d04-a06192c382fd None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:38.511919 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89661c-52b8-489d-9d04-a06192c382fd None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:38.516596 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 114/216] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:13:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:13:38.516596 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89661c-52b8-489d-9d04-a06192c382fd None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:38.519471 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a66a2d-21b3-41f7-93b2-2f537b66e39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:38.520248 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a66a2d-21b3-41f7-93b2-2f537b66e39f None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:38.520555 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a66a2d-21b3-41f7-93b2-2f537b66e39f None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:38.520885 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a66a2d-21b3-41f7-93b2-2f537b66e39f None admin] PATH_INFO: `/v3/users/c2d65f8ea2d34ce9ad379851cb2eb672` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:38.536613 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a66a2d-21b3-41f7-93b2-2f537b66e39f None admin] RBAC: Authorizing `identity:get_user(user_id=c2d65f8ea2d34ce9ad379851cb2eb672)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:38.538762 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a66a2d-21b3-41f7-93b2-2f537b66e39f None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:38.540779 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 103/217] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Aug 29 22:13:38 2022] GET /identity/v3/users/c2d65f8ea2d34ce9ad379851cb2eb672 => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:13:38.546488 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7dbeb-06ae-4dc8-8519-0854b2d09f02 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:38.546780 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7dbeb-06ae-4dc8-8519-0854b2d09f02 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:38.547054 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7dbeb-06ae-4dc8-8519-0854b2d09f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:38.565334 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-77a7dbeb-06ae-4dc8-8519-0854b2d09f02 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:13:38.566441 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-77a7dbeb-06ae-4dc8-8519-0854b2d09f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:13:38.599576 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:38.619249 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:38.628558 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89661c-52b8-489d-9d04-a06192c382fd None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:38.638307 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 104/218] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:13:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:13:38.649430 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7dbeb-06ae-4dc8-8519-0854b2d09f02 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:38.670897 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5310d-6445-40ed-8c27-1b3a0b2b690f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:38.672836 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5310d-6445-40ed-8c27-1b3a0b2b690f None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:38.673627 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5310d-6445-40ed-8c27-1b3a0b2b690f None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:38.674095 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5310d-6445-40ed-8c27-1b3a0b2b690f None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:38.675690 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a5310d-6445-40ed-8c27-1b3a0b2b690f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:38.677960 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a5310d-6445-40ed-8c27-1b3a0b2b690f None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:38.720495 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 115/219] 10.222.0.36 () {60 vars in 1132 bytes} [Mon Aug 29 22:13:38 2022] POST /identity/v3/users => generated 297 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:13:38.720495 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d79dd-fe02-46c8-b51b-22595e18ef1c None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:38.720495 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d79dd-fe02-46c8-b51b-22595e18ef1c None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:38.720495 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d79dd-fe02-46c8-b51b-22595e18ef1c None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:38.720910 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 116/220] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:13:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:13:38.724940 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b05c34-8237-496d-b564-b794335b729a None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:38.725390 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b05c34-8237-496d-b564-b794335b729a None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:38.725674 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b05c34-8237-496d-b564-b794335b729a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:38.754263 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-94b05c34-8237-496d-b564-b794335b729a None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:13:38.756279 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-94b05c34-8237-496d-b564-b794335b729a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:13:38.764173 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7dbeb-06ae-4dc8-8519-0854b2d09f02 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:38.815443 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad99005-655d-4d34-9ecd-286c6eebbd3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:38.816151 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad99005-655d-4d34-9ecd-286c6eebbd3b None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:38.816877 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad99005-655d-4d34-9ecd-286c6eebbd3b None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:38.817175 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad99005-655d-4d34-9ecd-286c6eebbd3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:38.845032 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 117/221] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:13:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:13:38.896518 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:38.917573 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad99005-655d-4d34-9ecd-286c6eebbd3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:38.919325 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad99005-655d-4d34-9ecd-286c6eebbd3b None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:38.938474 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b05c34-8237-496d-b564-b794335b729a None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:39.030294 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:39.080486 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 105/222] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:13:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:13:39.085803 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b05c34-8237-496d-b564-b794335b729a None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:39.085998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad99005-655d-4d34-9ecd-286c6eebbd3b None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:39.129898 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9253d64-3f74-460e-83c9-2ccb52eb6769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:39.130783 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9253d64-3f74-460e-83c9-2ccb52eb6769 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:39.131177 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9253d64-3f74-460e-83c9-2ccb52eb6769 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:39.131562 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9253d64-3f74-460e-83c9-2ccb52eb6769 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:39.152638 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9253d64-3f74-460e-83c9-2ccb52eb6769 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:13:39.160841 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-b9253d64-3f74-460e-83c9-2ccb52eb6769 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:13:39.160841 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:13:39.160841 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:13:39.160841 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:13:39.160841 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:13:39.160841 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:13:39.160841 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:13:39.160841 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:13:39.160841 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:13:39.160841 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:13:39.160841 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:13:39.160841 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:13:39.160841 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:13:39.160841 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:13:39.160841 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:13:39.160841 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:13:39.162416 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:13:39.162416 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:13:39.162416 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:13:39.162416 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:13:39.162416 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:13:39.162416 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:13:39.162416 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:13:39.162416 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:13:39.162416 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:13:39.162416 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:13:39.162416 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:13:39.162416 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:13:39.162416 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:13:39.162416 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:13:39.162416 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:13:39.162416 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:13:39.163695 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:13:39.163695 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:13:39.163695 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:13:39.163695 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:13:39.163695 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:13:39.163695 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:13:39.163695 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:13:39.163695 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:13:39.163695 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:13:39.163695 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:13:39.163695 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:13:39.163695 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:13:39.163695 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 118/223] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Aug 29 22:13:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:13:39.165641 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9253d64-3f74-460e-83c9-2ccb52eb6769 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:39.217587 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:39.241725 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad99005-655d-4d34-9ecd-286c6eebbd3b None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:39.287190 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9253d64-3f74-460e-83c9-2ccb52eb6769 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:39.296881 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7b82ef-4d45-4b13-9f31-01d995cb2e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:39.297619 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b82ef-4d45-4b13-9f31-01d995cb2e99 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:39.297619 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b82ef-4d45-4b13-9f31-01d995cb2e99 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:39.297619 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b82ef-4d45-4b13-9f31-01d995cb2e99 None admin] PATH_INFO: `/v3/projects/e0b257f7f1874d8483a2453331254e1a` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:39.298930 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7b82ef-4d45-4b13-9f31-01d995cb2e99 None admin] RBAC: Authorizing `identity:get_project(project_id=e0b257f7f1874d8483a2453331254e1a)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:39.300415 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7b82ef-4d45-4b13-9f31-01d995cb2e99 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:39.302251 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 106/224] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Aug 29 22:13:39 2022] GET /identity/v3/projects/e0b257f7f1874d8483a2453331254e1a => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:13:39.303152 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7b82ef-4d45-4b13-9f31-01d995cb2e99 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:39.312689 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:39.326428 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3499f8-0730-4543-96de-35717a141d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:39.327075 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3499f8-0730-4543-96de-35717a141d82 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:39.327352 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3499f8-0730-4543-96de-35717a141d82 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:39.327624 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3499f8-0730-4543-96de-35717a141d82 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:39.339131 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3499f8-0730-4543-96de-35717a141d82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:13:39.344089 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-6b3499f8-0730-4543-96de-35717a141d82 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:13:39.344089 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:13:39.344089 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:13:39.344089 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:13:39.344089 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:13:39.344089 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:13:39.344089 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:13:39.344089 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:13:39.344089 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:13:39.344089 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:13:39.344089 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:13:39.344089 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:13:39.344089 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:13:39.344089 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:13:39.344089 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:13:39.344089 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:13:39.345020 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:13:39.345020 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:13:39.345020 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:13:39.345020 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:13:39.345020 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:13:39.345020 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:13:39.345020 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:13:39.345020 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:13:39.345020 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:13:39.345020 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:13:39.345020 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:13:39.345020 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:13:39.345020 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:13:39.345020 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:13:39.345020 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:13:39.345020 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:13:39.345829 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:13:39.345829 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:13:39.345829 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:13:39.345829 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:13:39.345829 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:13:39.345829 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:13:39.345829 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:13:39.345829 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:13:39.345829 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:13:39.345829 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:13:39.345829 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:13:39.345829 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:13:39.345829 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 119/225] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Aug 29 22:13:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:13:39.346498 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3499f8-0730-4543-96de-35717a141d82 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:39.432009 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7b82ef-4d45-4b13-9f31-01d995cb2e99 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:39.469115 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8460f1-9d3a-4910-9196-02c6ae218416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:39.469734 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8460f1-9d3a-4910-9196-02c6ae218416 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:39.470058 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8460f1-9d3a-4910-9196-02c6ae218416 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:39.470332 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8460f1-9d3a-4910-9196-02c6ae218416 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:39.471114 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8460f1-9d3a-4910-9196-02c6ae218416 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:39.471420 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8460f1-9d3a-4910-9196-02c6ae218416 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:39.472822 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8460f1-9d3a-4910-9196-02c6ae218416 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:39.475385 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3499f8-0730-4543-96de-35717a141d82 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:39.482616 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 107/226] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:13:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:39.483451 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8460f1-9d3a-4910-9196-02c6ae218416 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:39.502599 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:39.522428 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d110fb3-f9a5-4c3c-b5b6-c18481abcbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:39.524222 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d110fb3-f9a5-4c3c-b5b6-c18481abcbf3 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:39.524746 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d110fb3-f9a5-4c3c-b5b6-c18481abcbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:39.525845 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d110fb3-f9a5-4c3c-b5b6-c18481abcbf3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:39.526749 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d110fb3-f9a5-4c3c-b5b6-c18481abcbf3 None admin] RBAC: Adding query filter params (role.id=c358a37c24fe42bca4a93331f2c99d90, scope.project.id=e0b257f7f1874d8483a2453331254e1a, user.id=c2d65f8ea2d34ce9ad379851cb2eb672) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:39.527203 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d110fb3-f9a5-4c3c-b5b6-c18481abcbf3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:39.529402 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d110fb3-f9a5-4c3c-b5b6-c18481abcbf3 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:39.537428 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 120/227] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Aug 29 22:13:39 2022] GET /identity/v3/role_assignments?user.id=c2d65f8ea2d34ce9ad379851cb2eb672&scope.project.id=e0b257f7f1874d8483a2453331254e1a&role.id=c358a37c24fe42bca4a93331f2c99d90 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:39.538737 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d110fb3-f9a5-4c3c-b5b6-c18481abcbf3 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:39.596749 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:39.605599 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8460f1-9d3a-4910-9196-02c6ae218416 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:39.643489 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5650e1f8-ebbb-4b5c-b4a6-f5f625bc88b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:39.644368 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650e1f8-ebbb-4b5c-b4a6-f5f625bc88b2 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:39.644869 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650e1f8-ebbb-4b5c-b4a6-f5f625bc88b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:39.645290 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650e1f8-ebbb-4b5c-b4a6-f5f625bc88b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:39.646116 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5650e1f8-ebbb-4b5c-b4a6-f5f625bc88b2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:39.646570 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5650e1f8-ebbb-4b5c-b4a6-f5f625bc88b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:39.648571 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5650e1f8-ebbb-4b5c-b4a6-f5f625bc88b2 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:39.658347 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 108/228] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Aug 29 22:13:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:39.658647 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d110fb3-f9a5-4c3c-b5b6-c18481abcbf3 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:39.675616 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5650e1f8-ebbb-4b5c-b4a6-f5f625bc88b2 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:39.702534 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658997f8-50f7-4c16-8855-1da74062c84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:39.703181 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658997f8-50f7-4c16-8855-1da74062c84b None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:39.703478 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658997f8-50f7-4c16-8855-1da74062c84b None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:39.703864 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658997f8-50f7-4c16-8855-1da74062c84b None admin] PATH_INFO: `/v3/users/f00ea433bb35435c80365d30c3f58e0e` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:39.704956 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658997f8-50f7-4c16-8855-1da74062c84b None admin] RBAC: Authorizing `identity:get_user(user_id=f00ea433bb35435c80365d30c3f58e0e)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:39.706532 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658997f8-50f7-4c16-8855-1da74062c84b None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:39.708429 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 121/229] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Aug 29 22:13:39 2022] GET /identity/v3/users/f00ea433bb35435c80365d30c3f58e0e => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:39.716080 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658997f8-50f7-4c16-8855-1da74062c84b None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:39.777416 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:39.802369 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5650e1f8-ebbb-4b5c-b4a6-f5f625bc88b2 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:39.825471 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658997f8-50f7-4c16-8855-1da74062c84b None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:39.839527 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2148de-972f-4c46-a904-58e8fb2afbb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:39.840501 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2148de-972f-4c46-a904-58e8fb2afbb4 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:39.840646 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:39.841083 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2148de-972f-4c46-a904-58e8fb2afbb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:39.841564 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2148de-972f-4c46-a904-58e8fb2afbb4 None admin] PATH_INFO: `/v3/users/f00ea433bb35435c80365d30c3f58e0e` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:39.842781 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2148de-972f-4c46-a904-58e8fb2afbb4 None admin] RBAC: Authorizing `identity:get_user(user_id=f00ea433bb35435c80365d30c3f58e0e)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:39.844366 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2148de-972f-4c46-a904-58e8fb2afbb4 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:39.846113 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 109/230] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Aug 29 22:13:39 2022] GET /identity/v3/users/f00ea433bb35435c80365d30c3f58e0e => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:13:39.854062 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2148de-972f-4c46-a904-58e8fb2afbb4 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:39.878764 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9903c565-35c8-4cc2-a939-8e48c8651e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:39.879406 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903c565-35c8-4cc2-a939-8e48c8651e70 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:39.879684 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903c565-35c8-4cc2-a939-8e48c8651e70 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:39.879957 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903c565-35c8-4cc2-a939-8e48c8651e70 None admin] PATH_INFO: `/v3/projects/e0b257f7f1874d8483a2453331254e1a` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:39.881847 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9903c565-35c8-4cc2-a939-8e48c8651e70 None admin] RBAC: Authorizing `identity:get_project(project_id=e0b257f7f1874d8483a2453331254e1a)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:39.883316 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9903c565-35c8-4cc2-a939-8e48c8651e70 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:39.885130 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 122/231] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Aug 29 22:13:39 2022] GET /identity/v3/projects/e0b257f7f1874d8483a2453331254e1a => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:39.891356 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9903c565-35c8-4cc2-a939-8e48c8651e70 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:39.974311 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2148de-972f-4c46-a904-58e8fb2afbb4 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:40.011294 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4087eac3-0684-4127-804c-d5d3ca9e04d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:40.012305 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087eac3-0684-4127-804c-d5d3ca9e04d5 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:40.012815 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087eac3-0684-4127-804c-d5d3ca9e04d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:40.013307 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087eac3-0684-4127-804c-d5d3ca9e04d5 None admin] PATH_INFO: `/v3/projects/e0b257f7f1874d8483a2453331254e1a` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:40.014629 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4087eac3-0684-4127-804c-d5d3ca9e04d5 None admin] RBAC: Authorizing `identity:get_project(project_id=e0b257f7f1874d8483a2453331254e1a)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:40.016640 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4087eac3-0684-4127-804c-d5d3ca9e04d5 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:40.018728 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 110/232] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Aug 29 22:13:39 2022] GET /identity/v3/projects/e0b257f7f1874d8483a2453331254e1a => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:13:40.025308 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4087eac3-0684-4127-804c-d5d3ca9e04d5 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:40.043681 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:40.088812 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9903c565-35c8-4cc2-a939-8e48c8651e70 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:40.136188 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4087eac3-0684-4127-804c-d5d3ca9e04d5 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:40.154248 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd106fd-8c93-4e67-b865-fea4c7ca15ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:40.154951 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd106fd-8c93-4e67-b865-fea4c7ca15ac None admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:40.155254 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd106fd-8c93-4e67-b865-fea4c7ca15ac None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:40.155505 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd106fd-8c93-4e67-b865-fea4c7ca15ac None admin] PATH_INFO: `/v3/projects/e0b257f7f1874d8483a2453331254e1a/users/f00ea433bb35435c80365d30c3f58e0e/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:40.161842 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd106fd-8c93-4e67-b865-fea4c7ca15ac None admin] RBAC: Authorizing `identity:create_grant(project_id=e0b257f7f1874d8483a2453331254e1a, user_id=f00ea433bb35435c80365d30c3f58e0e, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:40.163343 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd106fd-8c93-4e67-b865-fea4c7ca15ac None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:40.177526 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820f2b0-accf-4bcf-8f88-42f98f924a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:40.178610 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820f2b0-accf-4bcf-8f88-42f98f924a77 None admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:40.179211 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820f2b0-accf-4bcf-8f88-42f98f924a77 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:40.179717 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820f2b0-accf-4bcf-8f88-42f98f924a77 None admin] PATH_INFO: `/v3/projects/e0b257f7f1874d8483a2453331254e1a/users/f00ea433bb35435c80365d30c3f58e0e/roles/8767fe0bd994478fac741fc8c76f649e` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:40.182913 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b820f2b0-accf-4bcf-8f88-42f98f924a77 None admin] RBAC: Authorizing `identity:create_grant(project_id=e0b257f7f1874d8483a2453331254e1a, user_id=f00ea433bb35435c80365d30c3f58e0e, role_id=8767fe0bd994478fac741fc8c76f649e)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:40.184879 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b820f2b0-accf-4bcf-8f88-42f98f924a77 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:40.190720 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 123/233] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Aug 29 22:13:39 2022] PUT /identity/v3/projects/e0b257f7f1874d8483a2453331254e1a/users/f00ea433bb35435c80365d30c3f58e0e/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:13:40.209012 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 111/234] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Aug 29 22:13:40 2022] PUT /identity/v3/projects/e0b257f7f1874d8483a2453331254e1a/users/f00ea433bb35435c80365d30c3f58e0e/roles/8767fe0bd994478fac741fc8c76f649e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:13:41.385210 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee0c5b-5084-4402-a7bd-f6ef21c08b14 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:41.385768 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee0c5b-5084-4402-a7bd-f6ef21c08b14 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:41.385768 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee0c5b-5084-4402-a7bd-f6ef21c08b14 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:41.387666 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 124/235] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:13:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:13:41.406556 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45997cdf-435c-4714-8c7f-17c27f3dfbf5 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:41.406745 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad96fa-658d-4300-854c-361853d6efb9 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:41.407143 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45997cdf-435c-4714-8c7f-17c27f3dfbf5 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:41.407229 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad96fa-658d-4300-854c-361853d6efb9 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:41.407299 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45997cdf-435c-4714-8c7f-17c27f3dfbf5 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:41.407365 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad96fa-658d-4300-854c-361853d6efb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:41.408384 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 125/236] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:13:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:13:41.413313 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084df825-a7a4-474a-abd7-8be8b87ee4a7 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:41.413600 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084df825-a7a4-474a-abd7-8be8b87ee4a7 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:41.413858 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084df825-a7a4-474a-abd7-8be8b87ee4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:41.433794 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-084df825-a7a4-474a-abd7-8be8b87ee4a7 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:13:41.433981 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-88ad96fa-658d-4300-854c-361853d6efb9 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:13:41.434977 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-084df825-a7a4-474a-abd7-8be8b87ee4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:13:41.435103 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-88ad96fa-658d-4300-854c-361853d6efb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:13:41.497322 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:41.557284 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 112/237] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:13:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:13:41.571615 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 126/238] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:13:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:13:41.932425 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad96fa-658d-4300-854c-361853d6efb9 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:41.936789 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:41.938043 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084df825-a7a4-474a-abd7-8be8b87ee4a7 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:42.044095 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad96fa-658d-4300-854c-361853d6efb9 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:42.079896 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca4ab9b-b5f5-4226-969f-a4380160de05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:42.081235 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4ab9b-b5f5-4226-969f-a4380160de05 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:42.081957 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4ab9b-b5f5-4226-969f-a4380160de05 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:42.082415 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4ab9b-b5f5-4226-969f-a4380160de05 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:42.084149 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca4ab9b-b5f5-4226-969f-a4380160de05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:42.086037 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca4ab9b-b5f5-4226-969f-a4380160de05 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:42.086566 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084df825-a7a4-474a-abd7-8be8b87ee4a7 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:42.088912 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 113/239] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:13:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:42.090443 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116cc2c-d6bf-4c25-972c-6216968abca9 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:42.090887 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116cc2c-d6bf-4c25-972c-6216968abca9 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:42.091311 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116cc2c-d6bf-4c25-972c-6216968abca9 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:42.093049 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 114/240] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:13:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:13:42.093977 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c116cc2c-d6bf-4c25-972c-6216968abca9 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:42.131261 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f82cb-000f-4b16-9f76-850d7b177b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:42.131945 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f82cb-000f-4b16-9f76-850d7b177b79 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:42.132227 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f82cb-000f-4b16-9f76-850d7b177b79 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:42.132525 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f82cb-000f-4b16-9f76-850d7b177b79 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:42.146682 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526f82cb-000f-4b16-9f76-850d7b177b79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:13:42.152938 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-526f82cb-000f-4b16-9f76-850d7b177b79 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:13:42.152938 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:13:42.152938 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:13:42.152938 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:13:42.152938 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:13:42.152938 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:13:42.152938 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:13:42.152938 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:13:42.152938 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:13:42.152938 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:13:42.152938 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:13:42.152938 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:13:42.152938 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:13:42.152938 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:13:42.152938 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:13:42.152938 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:13:42.153808 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:13:42.153808 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:13:42.153808 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:13:42.153808 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:13:42.153808 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:13:42.153808 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:13:42.153808 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:13:42.153808 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:13:42.153808 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:13:42.153808 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:13:42.153808 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:13:42.153808 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:13:42.153808 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:13:42.153808 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:13:42.153808 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:13:42.153808 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:13:42.155162 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:13:42.155162 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:13:42.155162 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:13:42.155162 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:13:42.155162 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:13:42.155162 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:13:42.155162 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:13:42.155162 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:13:42.155162 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:13:42.155162 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:13:42.155162 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:13:42.155162 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:13:42.155162 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 127/241] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:13:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:13:42.155827 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243655b8-3535-4654-8f02-ca5d3d0fc01f None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:42.155900 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243655b8-3535-4654-8f02-ca5d3d0fc01f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:42.156148 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243655b8-3535-4654-8f02-ca5d3d0fc01f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:42.179272 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-243655b8-3535-4654-8f02-ca5d3d0fc01f None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:13:42.180524 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-243655b8-3535-4654-8f02-ca5d3d0fc01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:13:42.184871 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:42.207801 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c116cc2c-d6bf-4c25-972c-6216968abca9 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:42.220181 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:42.250498 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b808f758-8231-496b-8a4b-2cb18f9b9630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:42.251258 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808f758-8231-496b-8a4b-2cb18f9b9630 None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:42.251430 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808f758-8231-496b-8a4b-2cb18f9b9630 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:42.251654 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808f758-8231-496b-8a4b-2cb18f9b9630 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:42.252319 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b808f758-8231-496b-8a4b-2cb18f9b9630 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:42.253820 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b808f758-8231-496b-8a4b-2cb18f9b9630 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:42.283189 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 128/242] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:13:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:13:42.283189 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243655b8-3535-4654-8f02-ca5d3d0fc01f None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:42.292491 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 115/243] 10.222.0.36 () {60 vars in 1132 bytes} [Mon Aug 29 22:13:42 2022] POST /identity/v3/users => generated 293 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:13:42.435489 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243655b8-3535-4654-8f02-ca5d3d0fc01f None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:42.486890 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689bac40-9782-4d77-93c7-6c7c341e1a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:42.487774 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689bac40-9782-4d77-93c7-6c7c341e1a04 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:42.488179 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689bac40-9782-4d77-93c7-6c7c341e1a04 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:42.488637 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689bac40-9782-4d77-93c7-6c7c341e1a04 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:42.489792 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689bac40-9782-4d77-93c7-6c7c341e1a04 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:42.490192 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689bac40-9782-4d77-93c7-6c7c341e1a04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:42.491880 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689bac40-9782-4d77-93c7-6c7c341e1a04 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:42.505151 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 129/244] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Aug 29 22:13:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:42.513890 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b808f758-8231-496b-8a4b-2cb18f9b9630 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:42.555197 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37d6c5-8777-4abb-af31-b1bd524f3693 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:42.555520 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37d6c5-8777-4abb-af31-b1bd524f3693 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:42.555883 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37d6c5-8777-4abb-af31-b1bd524f3693 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:42.557616 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 130/245] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:13:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:13:42.563118 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820dc18d-09ed-4df8-867c-744afe542a6b None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:42.563392 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820dc18d-09ed-4df8-867c-744afe542a6b None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:42.563669 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820dc18d-09ed-4df8-867c-744afe542a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:42.590808 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-820dc18d-09ed-4df8-867c-744afe542a6b None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:13:42.592009 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-820dc18d-09ed-4df8-867c-744afe542a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:13:42.621564 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:42.666985 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b808f758-8231-496b-8a4b-2cb18f9b9630 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:42.685764 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 131/246] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:13:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:13:42.687179 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5ccf8-6872-4df6-9bab-8bd25169d9fd None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:42.687529 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5ccf8-6872-4df6-9bab-8bd25169d9fd None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:42.687808 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5ccf8-6872-4df6-9bab-8bd25169d9fd None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:42.689366 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 132/247] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:13:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:13:42.690080 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5ccf8-6872-4df6-9bab-8bd25169d9fd None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:42.695565 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:42.707330 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613cc0a4-1aa4-4772-9ded-3f1fa1dfe6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:42.707982 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613cc0a4-1aa4-4772-9ded-3f1fa1dfe6c9 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:42.708240 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613cc0a4-1aa4-4772-9ded-3f1fa1dfe6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:42.709606 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613cc0a4-1aa4-4772-9ded-3f1fa1dfe6c9 None admin] PATH_INFO: `/v3/users/9379dd972a2a4a518b88e10780fd5416` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:42.726280 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613cc0a4-1aa4-4772-9ded-3f1fa1dfe6c9 None admin] RBAC: Authorizing `identity:get_user(user_id=9379dd972a2a4a518b88e10780fd5416)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:42.728019 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613cc0a4-1aa4-4772-9ded-3f1fa1dfe6c9 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:42.730745 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 116/248] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Aug 29 22:13:42 2022] GET /identity/v3/users/9379dd972a2a4a518b88e10780fd5416 => generated 297 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:42.731158 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cab4f2-1c1d-4d3b-b2f0-6cb9784e76de None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:42.731437 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cab4f2-1c1d-4d3b-b2f0-6cb9784e76de None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:42.732716 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cab4f2-1c1d-4d3b-b2f0-6cb9784e76de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:42.755978 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-03cab4f2-1c1d-4d3b-b2f0-6cb9784e76de None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:13:42.757219 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-03cab4f2-1c1d-4d3b-b2f0-6cb9784e76de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:13:42.839201 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5ccf8-6872-4df6-9bab-8bd25169d9fd None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:42.851570 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 117/249] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:13:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:13:42.852476 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cab4f2-1c1d-4d3b-b2f0-6cb9784e76de None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:42.892304 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb642bd-ef71-4fbd-b009-473af0f9550a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:42.892304 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb642bd-ef71-4fbd-b009-473af0f9550a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:42.892304 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb642bd-ef71-4fbd-b009-473af0f9550a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:42.892304 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb642bd-ef71-4fbd-b009-473af0f9550a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:42.909671 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb642bd-ef71-4fbd-b009-473af0f9550a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:13:42.916428 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-3bb642bd-ef71-4fbd-b009-473af0f9550a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:13:42.916428 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:13:42.916428 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:13:42.916428 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:13:42.916428 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:13:42.916428 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:13:42.916428 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:13:42.916428 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:13:42.916428 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:13:42.916428 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:13:42.916428 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:13:42.916428 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:13:42.916428 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:13:42.916428 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:13:42.916428 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:13:42.916428 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:13:42.917365 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:13:42.917365 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:13:42.917365 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:13:42.917365 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:13:42.917365 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:13:42.917365 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:13:42.917365 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:13:42.917365 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:13:42.917365 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:13:42.917365 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:13:42.917365 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:13:42.917365 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:13:42.917365 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:13:42.917365 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:13:42.917365 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:13:42.917365 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:13:42.918171 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:13:42.918171 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:13:42.918171 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:13:42.918171 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:13:42.918171 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:13:42.918171 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:13:42.918171 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:13:42.918171 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:13:42.918171 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:13:42.918171 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:13:42.918171 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:13:42.918171 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:13:42.920719 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 133/250] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:13:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:13:42.928473 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb642bd-ef71-4fbd-b009-473af0f9550a None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:42.964501 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:43.013181 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cab4f2-1c1d-4d3b-b2f0-6cb9784e76de None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:43.048742 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:43.081171 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf3130-7589-4fd5-84af-52dba8b4e8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:43.084501 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf3130-7589-4fd5-84af-52dba8b4e8d5 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:43.084783 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf3130-7589-4fd5-84af-52dba8b4e8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:43.085055 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf3130-7589-4fd5-84af-52dba8b4e8d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:43.109987 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb642bd-ef71-4fbd-b009-473af0f9550a None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:43.173018 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f121c42e-4823-4d7a-8d64-ff2d521d6e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:43.173635 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121c42e-4823-4d7a-8d64-ff2d521d6e94 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:43.173910 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121c42e-4823-4d7a-8d64-ff2d521d6e94 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:43.174177 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121c42e-4823-4d7a-8d64-ff2d521d6e94 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:43.174944 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f121c42e-4823-4d7a-8d64-ff2d521d6e94 None admin] RBAC: Adding query filter params (name=member) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:43.175268 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f121c42e-4823-4d7a-8d64-ff2d521d6e94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:43.176679 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f121c42e-4823-4d7a-8d64-ff2d521d6e94 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:43.190179 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 134/251] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Aug 29 22:13:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:43.191261 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f121c42e-4823-4d7a-8d64-ff2d521d6e94 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:43.200797 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bf3130-7589-4fd5-84af-52dba8b4e8d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:43.202557 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bf3130-7589-4fd5-84af-52dba8b4e8d5 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:43.275274 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:43.307107 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f121c42e-4823-4d7a-8d64-ff2d521d6e94 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:43.323364 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 118/252] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:13:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:13:43.324850 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf3130-7589-4fd5-84af-52dba8b4e8d5 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:43.351040 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c59c6-a883-4da7-a8b3-f4edc896bd42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:43.351679 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c59c6-a883-4da7-a8b3-f4edc896bd42 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:43.351957 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c59c6-a883-4da7-a8b3-f4edc896bd42 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:43.352227 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c59c6-a883-4da7-a8b3-f4edc896bd42 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:43.360838 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:43.365843 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276c59c6-a883-4da7-a8b3-f4edc896bd42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:13:43.371697 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-276c59c6-a883-4da7-a8b3-f4edc896bd42 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:13:43.371697 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:13:43.371697 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:13:43.371697 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:13:43.371697 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:13:43.371697 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:13:43.371697 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:13:43.371697 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:13:43.371697 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:13:43.371697 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:13:43.371697 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:13:43.371697 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:13:43.371697 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:13:43.371697 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:13:43.371697 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:13:43.371697 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:13:43.372630 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:13:43.372630 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:13:43.372630 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:13:43.372630 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:13:43.372630 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:13:43.372630 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:13:43.372630 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:13:43.372630 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:13:43.372630 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:13:43.372630 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:13:43.372630 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:13:43.372630 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:13:43.372630 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:13:43.372630 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:13:43.372630 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:13:43.372630 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:13:43.373450 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:13:43.373450 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:13:43.373450 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:13:43.373450 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:13:43.373450 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:13:43.373450 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:13:43.373450 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:13:43.373450 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:13:43.373450 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:13:43.373450 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:13:43.373450 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:13:43.373450 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:13:43.380219 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 135/253] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Aug 29 22:13:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:13:43.380219 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c59c6-a883-4da7-a8b3-f4edc896bd42 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:43.441619 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf3130-7589-4fd5-84af-52dba8b4e8d5 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:43.477743 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5bf9b-962b-4472-8cfb-50aa433ed54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:43.478432 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5bf9b-962b-4472-8cfb-50aa433ed54b None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:43.478799 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5bf9b-962b-4472-8cfb-50aa433ed54b None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:43.479124 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5bf9b-962b-4472-8cfb-50aa433ed54b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:43.491898 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f5bf9b-962b-4472-8cfb-50aa433ed54b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:13:43.497020 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-38f5bf9b-962b-4472-8cfb-50aa433ed54b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:13:43.497020 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:13:43.497020 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:13:43.497020 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:13:43.497020 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:13:43.497020 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:13:43.497020 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:13:43.497020 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:13:43.497020 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:13:43.497020 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:13:43.497020 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:13:43.497020 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:13:43.497020 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:13:43.497020 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:13:43.497020 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:13:43.497020 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:13:43.497925 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:13:43.497925 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:13:43.497925 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:13:43.497925 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:13:43.497925 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:13:43.497925 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:13:43.497925 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:13:43.497925 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:13:43.497925 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:13:43.497925 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:13:43.497925 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:13:43.497925 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:13:43.497925 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:13:43.497925 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:13:43.497925 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:13:43.497925 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:13:43.498717 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:13:43.498717 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:13:43.498717 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:13:43.498717 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:13:43.498717 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:13:43.498717 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:13:43.498717 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:13:43.498717 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:13:43.498717 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:13:43.498717 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:13:43.498717 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:13:43.498717 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:13:43.502964 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 119/254] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Aug 29 22:13:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:13:43.503813 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5bf9b-962b-4472-8cfb-50aa433ed54b None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:43.525702 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c59c6-a883-4da7-a8b3-f4edc896bd42 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:43.572850 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35221f5-23fa-41d9-b9b8-39cdaecdd429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:43.574394 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35221f5-23fa-41d9-b9b8-39cdaecdd429 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:43.575137 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35221f5-23fa-41d9-b9b8-39cdaecdd429 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:43.575603 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35221f5-23fa-41d9-b9b8-39cdaecdd429 None admin] PATH_INFO: `/v3/users/c2d65f8ea2d34ce9ad379851cb2eb672` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:43.578071 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35221f5-23fa-41d9-b9b8-39cdaecdd429 None admin] RBAC: Authorizing `identity:get_user(user_id=c2d65f8ea2d34ce9ad379851cb2eb672)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:43.579714 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35221f5-23fa-41d9-b9b8-39cdaecdd429 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:43.581656 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 136/255] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Aug 29 22:13:43 2022] GET /identity/v3/users/c2d65f8ea2d34ce9ad379851cb2eb672 => generated 297 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:43.582647 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35221f5-23fa-41d9-b9b8-39cdaecdd429 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:43.586913 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:43.589604 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:43.621623 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5bf9b-962b-4472-8cfb-50aa433ed54b None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:43.662919 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae022ae-f24d-476d-9679-fe4ae0475627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:43.663982 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae022ae-f24d-476d-9679-fe4ae0475627 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:43.664480 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae022ae-f24d-476d-9679-fe4ae0475627 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:43.665600 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae022ae-f24d-476d-9679-fe4ae0475627 None admin] PATH_INFO: `/v3/projects/e0b257f7f1874d8483a2453331254e1a` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:43.667504 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae022ae-f24d-476d-9679-fe4ae0475627 None admin] RBAC: Authorizing `identity:get_project(project_id=e0b257f7f1874d8483a2453331254e1a)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:43.670151 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae022ae-f24d-476d-9679-fe4ae0475627 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:43.672744 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 120/256] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Aug 29 22:13:43 2022] GET /identity/v3/projects/e0b257f7f1874d8483a2453331254e1a => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:43.673977 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae022ae-f24d-476d-9679-fe4ae0475627 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:43.716503 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35221f5-23fa-41d9-b9b8-39cdaecdd429 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:43.751718 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb91cc4-a932-4922-acce-b9517ddd5cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:43.752328 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb91cc4-a932-4922-acce-b9517ddd5cd6 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:43.752696 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb91cc4-a932-4922-acce-b9517ddd5cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:43.752978 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb91cc4-a932-4922-acce-b9517ddd5cd6 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:43.753775 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb91cc4-a932-4922-acce-b9517ddd5cd6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:43.754100 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb91cc4-a932-4922-acce-b9517ddd5cd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:43.756076 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb91cc4-a932-4922-acce-b9517ddd5cd6 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:43.771410 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 137/257] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:13:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:43.771410 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb91cc4-a932-4922-acce-b9517ddd5cd6 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:43.811217 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae022ae-f24d-476d-9679-fe4ae0475627 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:43.857082 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:43.862537 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295e3a63-c738-4a38-bfd1-879e2841b1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:43.863385 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e3a63-c738-4a38-bfd1-879e2841b1ca None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:43.863662 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e3a63-c738-4a38-bfd1-879e2841b1ca None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:43.863952 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e3a63-c738-4a38-bfd1-879e2841b1ca None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:43.864659 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295e3a63-c738-4a38-bfd1-879e2841b1ca None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:43.864959 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295e3a63-c738-4a38-bfd1-879e2841b1ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:43.866418 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295e3a63-c738-4a38-bfd1-879e2841b1ca None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:43.875665 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 121/258] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Aug 29 22:13:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:43.881807 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295e3a63-c738-4a38-bfd1-879e2841b1ca None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:43.893639 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:43.910355 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb91cc4-a932-4922-acce-b9517ddd5cd6 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:43.951873 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13f3ed-8874-4c09-9132-a57ed9df7acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:43.953156 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13f3ed-8874-4c09-9132-a57ed9df7acd None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:43.953664 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13f3ed-8874-4c09-9132-a57ed9df7acd None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:43.954200 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13f3ed-8874-4c09-9132-a57ed9df7acd None admin] PATH_INFO: `/v3/projects/e0b257f7f1874d8483a2453331254e1a` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:43.955713 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d13f3ed-8874-4c09-9132-a57ed9df7acd None admin] RBAC: Authorizing `identity:get_project(project_id=e0b257f7f1874d8483a2453331254e1a)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:43.957847 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d13f3ed-8874-4c09-9132-a57ed9df7acd None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:43.959942 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 138/259] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Aug 29 22:13:43 2022] GET /identity/v3/projects/e0b257f7f1874d8483a2453331254e1a => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:43.960948 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13f3ed-8874-4c09-9132-a57ed9df7acd None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:43.994963 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295e3a63-c738-4a38-bfd1-879e2841b1ca None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:44.029547 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a34f9-3b46-439d-baf3-58a402b7311c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:44.030163 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a34f9-3b46-439d-baf3-58a402b7311c None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:44.030440 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a34f9-3b46-439d-baf3-58a402b7311c None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:44.030707 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a34f9-3b46-439d-baf3-58a402b7311c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:44.031484 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a34f9-3b46-439d-baf3-58a402b7311c None admin] RBAC: Adding query filter params (role.id=750444f301bf44c59183e4c5470a0dc5, scope.project.id=e0b257f7f1874d8483a2453331254e1a, user.id=9379dd972a2a4a518b88e10780fd5416) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:44.031790 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a34f9-3b46-439d-baf3-58a402b7311c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:44.033251 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a34f9-3b46-439d-baf3-58a402b7311c None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:44.039247 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 122/260] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Aug 29 22:13:43 2022] GET /identity/v3/role_assignments?user.id=9379dd972a2a4a518b88e10780fd5416&scope.project.id=e0b257f7f1874d8483a2453331254e1a&role.id=750444f301bf44c59183e4c5470a0dc5 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:44.040147 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a34f9-3b46-439d-baf3-58a402b7311c None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:44.083022 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13f3ed-8874-4c09-9132-a57ed9df7acd None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:44.112761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:44.126387 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de34895-956a-4e93-ab31-5af155f2e52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:44.127450 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de34895-956a-4e93-ab31-5af155f2e52d None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:44.127924 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de34895-956a-4e93-ab31-5af155f2e52d None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:44.128506 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de34895-956a-4e93-ab31-5af155f2e52d None admin] PATH_INFO: `/v3/users/f00ea433bb35435c80365d30c3f58e0e` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:44.129991 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de34895-956a-4e93-ab31-5af155f2e52d None admin] RBAC: Authorizing `identity:get_user(user_id=f00ea433bb35435c80365d30c3f58e0e)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:44.131801 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de34895-956a-4e93-ab31-5af155f2e52d None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:44.134433 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 139/261] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Aug 29 22:13:43 2022] GET /identity/v3/users/f00ea433bb35435c80365d30c3f58e0e => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:44.135523 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de34895-956a-4e93-ab31-5af155f2e52d None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:44.144094 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:44.151964 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a34f9-3b46-439d-baf3-58a402b7311c None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:44.188906 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec43d82c-6a4c-4b80-8c43-45b030ab25b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:44.189550 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec43d82c-6a4c-4b80-8c43-45b030ab25b2 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:44.189825 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec43d82c-6a4c-4b80-8c43-45b030ab25b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:44.190094 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec43d82c-6a4c-4b80-8c43-45b030ab25b2 None admin] PATH_INFO: `/v3/users/f00ea433bb35435c80365d30c3f58e0e` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:44.191672 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec43d82c-6a4c-4b80-8c43-45b030ab25b2 None admin] RBAC: Authorizing `identity:get_user(user_id=f00ea433bb35435c80365d30c3f58e0e)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:44.192818 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec43d82c-6a4c-4b80-8c43-45b030ab25b2 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:44.199435 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 123/262] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Aug 29 22:13:44 2022] GET /identity/v3/users/f00ea433bb35435c80365d30c3f58e0e => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:44.200757 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec43d82c-6a4c-4b80-8c43-45b030ab25b2 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:44.263161 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de34895-956a-4e93-ab31-5af155f2e52d None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:44.303794 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ceba3-6e07-4479-b26e-875282749975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:44.305085 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ceba3-6e07-4479-b26e-875282749975 None admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:44.305561 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ceba3-6e07-4479-b26e-875282749975 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:44.306060 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec43d82c-6a4c-4b80-8c43-45b030ab25b2 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:44.306319 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ceba3-6e07-4479-b26e-875282749975 None admin] PATH_INFO: `/v3/projects/e0b257f7f1874d8483a2453331254e1a/users/c2d65f8ea2d34ce9ad379851cb2eb672/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:44.308757 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ceba3-6e07-4479-b26e-875282749975 None admin] RBAC: Authorizing `identity:create_grant(project_id=e0b257f7f1874d8483a2453331254e1a, user_id=c2d65f8ea2d34ce9ad379851cb2eb672, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:44.310528 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ceba3-6e07-4479-b26e-875282749975 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:44.331217 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 140/263] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Aug 29 22:13:44 2022] PUT /identity/v3/projects/e0b257f7f1874d8483a2453331254e1a/users/c2d65f8ea2d34ce9ad379851cb2eb672/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:13:44.332497 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ceba3-6e07-4479-b26e-875282749975 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:44.361699 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46687a1-97d9-4031-b504-3a150612bb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:44.362327 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46687a1-97d9-4031-b504-3a150612bb77 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:44.362644 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46687a1-97d9-4031-b504-3a150612bb77 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:44.362970 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46687a1-97d9-4031-b504-3a150612bb77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:44.381328 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:44.416027 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:44.467712 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ceba3-6e07-4479-b26e-875282749975 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:44.510872 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3449785c-562a-40e4-9fc2-2d2029236601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:44.511912 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3449785c-562a-40e4-9fc2-2d2029236601 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:44.512389 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3449785c-562a-40e4-9fc2-2d2029236601 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:44.512895 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3449785c-562a-40e4-9fc2-2d2029236601 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:44.582198 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46687a1-97d9-4031-b504-3a150612bb77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:44.583745 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46687a1-97d9-4031-b504-3a150612bb77 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:44.600304 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3449785c-562a-40e4-9fc2-2d2029236601 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:44.603806 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3449785c-562a-40e4-9fc2-2d2029236601 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:44.677543 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:44.723213 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 141/264] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:13:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:13:44.732084 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3449785c-562a-40e4-9fc2-2d2029236601 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:44.828329 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 124/265] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:13:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:13:44.835605 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46687a1-97d9-4031-b504-3a150612bb77 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:44.930847 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:44.952398 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3449785c-562a-40e4-9fc2-2d2029236601 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:45.040230 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46687a1-97d9-4031-b504-3a150612bb77 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:45.065762 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c5a5f-7509-4c6a-97e6-03887ac39197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:45.066580 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c5a5f-7509-4c6a-97e6-03887ac39197 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:45.066856 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c5a5f-7509-4c6a-97e6-03887ac39197 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:45.067121 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c5a5f-7509-4c6a-97e6-03887ac39197 None admin] PATH_INFO: `/v3/projects/e0b257f7f1874d8483a2453331254e1a` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:45.073249 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4c5a5f-7509-4c6a-97e6-03887ac39197 None admin] RBAC: Authorizing `identity:get_project(project_id=e0b257f7f1874d8483a2453331254e1a)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:45.074773 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4c5a5f-7509-4c6a-97e6-03887ac39197 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:45.083398 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 142/266] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Aug 29 22:13:44 2022] GET /identity/v3/projects/e0b257f7f1874d8483a2453331254e1a => generated 302 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:13:45.083398 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c075d9-0c52-4fa2-909b-19cb50aedfa4 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:45.083398 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c075d9-0c52-4fa2-909b-19cb50aedfa4 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:45.083398 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c075d9-0c52-4fa2-909b-19cb50aedfa4 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:45.083398 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 143/267] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:13:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:13:45.083398 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af481c-71e0-48fe-ba34-4acf08c6e9b0 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:45.083866 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af481c-71e0-48fe-ba34-4acf08c6e9b0 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:45.083866 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af481c-71e0-48fe-ba34-4acf08c6e9b0 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:45.088185 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294aafc8-9fe9-4d8d-a5bc-b84f1f1686db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:45.088338 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 144/268] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:13:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:13:45.089209 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294aafc8-9fe9-4d8d-a5bc-b84f1f1686db None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:45.089579 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5163499-a467-4350-8f9c-ee050c038c81 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:45.089859 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5163499-a467-4350-8f9c-ee050c038c81 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:45.090098 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294aafc8-9fe9-4d8d-a5bc-b84f1f1686db None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:45.090205 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5163499-a467-4350-8f9c-ee050c038c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:45.090666 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294aafc8-9fe9-4d8d-a5bc-b84f1f1686db None admin] PATH_INFO: `/v3/projects/e0b257f7f1874d8483a2453331254e1a` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:45.092362 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294aafc8-9fe9-4d8d-a5bc-b84f1f1686db None admin] RBAC: Authorizing `identity:get_project(project_id=e0b257f7f1874d8483a2453331254e1a)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:45.094200 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294aafc8-9fe9-4d8d-a5bc-b84f1f1686db None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:45.096256 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 125/269] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Aug 29 22:13:44 2022] GET /identity/v3/projects/e0b257f7f1874d8483a2453331254e1a => generated 302 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:13:45.098799 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a23196-dc51-4cae-af5d-d736b8e8c700 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:45.099286 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a23196-dc51-4cae-af5d-d736b8e8c700 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:45.099748 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a23196-dc51-4cae-af5d-d736b8e8c700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:45.109112 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-b5163499-a467-4350-8f9c-ee050c038c81 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:13:45.110303 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b5163499-a467-4350-8f9c-ee050c038c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:13:45.123161 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-d1a23196-dc51-4cae-af5d-d736b8e8c700 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:13:45.125302 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-d1a23196-dc51-4cae-af5d-d736b8e8c700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:13:45.134533 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:45.181913 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 145/270] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:13:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:13:45.182735 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5163499-a467-4350-8f9c-ee050c038c81 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:45.221079 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 126/271] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:13:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:13:45.222998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a23196-dc51-4cae-af5d-d736b8e8c700 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:45.275193 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:45.290348 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5163499-a467-4350-8f9c-ee050c038c81 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:45.362077 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466fed51-70a7-47e1-9bb0-f6be0281d73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:45.362704 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466fed51-70a7-47e1-9bb0-f6be0281d73e None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:45.362979 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466fed51-70a7-47e1-9bb0-f6be0281d73e None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:45.363245 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466fed51-70a7-47e1-9bb0-f6be0281d73e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:45.363982 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466fed51-70a7-47e1-9bb0-f6be0281d73e None admin] RBAC: Adding query filter params (role.id=8767fe0bd994478fac741fc8c76f649e, scope.project.id=e0b257f7f1874d8483a2453331254e1a, user.id=f00ea433bb35435c80365d30c3f58e0e) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:45.364285 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466fed51-70a7-47e1-9bb0-f6be0281d73e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:45.366940 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a23196-dc51-4cae-af5d-d736b8e8c700 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:45.369607 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466fed51-70a7-47e1-9bb0-f6be0281d73e None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:45.380943 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 146/272] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Aug 29 22:13:45 2022] GET /identity/v3/role_assignments?user.id=f00ea433bb35435c80365d30c3f58e0e&scope.project.id=e0b257f7f1874d8483a2453331254e1a&role.id=8767fe0bd994478fac741fc8c76f649e => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:45.410632 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6169c632-1e0e-4dc6-86e7-742cf2449e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:45.411624 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169c632-1e0e-4dc6-86e7-742cf2449e3e None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:45.412097 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169c632-1e0e-4dc6-86e7-742cf2449e3e None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:45.412614 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169c632-1e0e-4dc6-86e7-742cf2449e3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:45.413544 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6169c632-1e0e-4dc6-86e7-742cf2449e3e None admin] RBAC: Adding query filter params (role.id=ff59a239a50b4bd899a83bf3c3fd1f63, scope.project.id=e0b257f7f1874d8483a2453331254e1a, user.id=f00ea433bb35435c80365d30c3f58e0e) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:45.414048 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6169c632-1e0e-4dc6-86e7-742cf2449e3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:45.415974 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6169c632-1e0e-4dc6-86e7-742cf2449e3e None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:45.423315 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 127/273] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Aug 29 22:13:45 2022] GET /identity/v3/role_assignments?user.id=f00ea433bb35435c80365d30c3f58e0e&scope.project.id=e0b257f7f1874d8483a2453331254e1a&role.id=ff59a239a50b4bd899a83bf3c3fd1f63 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:45.632708 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466fed51-70a7-47e1-9bb0-f6be0281d73e None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:45.662586 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6169c632-1e0e-4dc6-86e7-742cf2449e3e None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:45.667980 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:45.759456 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466fed51-70a7-47e1-9bb0-f6be0281d73e None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:45.800095 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d76503-91d0-4674-b628-a1aea7442b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:45.800804 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d76503-91d0-4674-b628-a1aea7442b16 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:45.801081 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d76503-91d0-4674-b628-a1aea7442b16 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:45.801350 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d76503-91d0-4674-b628-a1aea7442b16 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:45.801776 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:45.807337 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6169c632-1e0e-4dc6-86e7-742cf2449e3e None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:45.815422 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d76503-91d0-4674-b628-a1aea7442b16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:13:45.822339 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-83d76503-91d0-4674-b628-a1aea7442b16 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:13:45.822339 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:13:45.822339 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:13:45.822339 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:13:45.822339 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:13:45.822339 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:13:45.822339 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:13:45.822339 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:13:45.822339 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:13:45.822339 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:13:45.822339 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:13:45.822339 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:13:45.822339 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:13:45.822339 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:13:45.822339 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:13:45.822339 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:13:45.823724 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:13:45.823724 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:13:45.823724 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:13:45.823724 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:13:45.823724 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:13:45.823724 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:13:45.823724 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:13:45.823724 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:13:45.823724 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:13:45.823724 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:13:45.823724 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:13:45.823724 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:13:45.823724 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:13:45.823724 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:13:45.823724 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:13:45.823724 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:13:45.824976 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:13:45.824976 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:13:45.824976 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:13:45.824976 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:13:45.824976 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:13:45.824976 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:13:45.824976 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:13:45.824976 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:13:45.824976 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:13:45.824976 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:13:45.824976 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:13:45.824976 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:13:45.826486 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 147/274] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:13:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:13:45.832926 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d76503-91d0-4674-b628-a1aea7442b16 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:45.872207 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd564c5-8d5f-4db9-a5e4-528e049f5df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:45.873755 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd564c5-8d5f-4db9-a5e4-528e049f5df0 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:45.874205 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd564c5-8d5f-4db9-a5e4-528e049f5df0 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:45.874686 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd564c5-8d5f-4db9-a5e4-528e049f5df0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:45.876748 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd564c5-8d5f-4db9-a5e4-528e049f5df0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:45.879307 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd564c5-8d5f-4db9-a5e4-528e049f5df0 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:45.881084 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 128/275] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:13:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:13:45.888405 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd564c5-8d5f-4db9-a5e4-528e049f5df0 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:45.955203 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:45.975230 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d76503-91d0-4674-b628-a1aea7442b16 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:46.020795 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f5b58-7fa3-46dd-a434-9899f8085dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:46.022319 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f5b58-7fa3-46dd-a434-9899f8085dd1 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:46.022319 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f5b58-7fa3-46dd-a434-9899f8085dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:46.022493 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f5b58-7fa3-46dd-a434-9899f8085dd1 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:46.023227 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7f5b58-7fa3-46dd-a434-9899f8085dd1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:46.023605 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7f5b58-7fa3-46dd-a434-9899f8085dd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:46.026788 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7f5b58-7fa3-46dd-a434-9899f8085dd1 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:46.036626 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 148/276] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Aug 29 22:13:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:13:46.041266 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f5b58-7fa3-46dd-a434-9899f8085dd1 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:46.060431 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd564c5-8d5f-4db9-a5e4-528e049f5df0 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:46.100122 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e35473a-ee93-441d-9117-528a7fbea265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:46.100786 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35473a-ee93-441d-9117-528a7fbea265 None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:46.101068 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35473a-ee93-441d-9117-528a7fbea265 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:46.101341 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35473a-ee93-441d-9117-528a7fbea265 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:46.102002 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e35473a-ee93-441d-9117-528a7fbea265 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:46.103609 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e35473a-ee93-441d-9117-528a7fbea265 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:46.128344 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 129/277] 10.222.0.36 () {60 vars in 1132 bytes} [Mon Aug 29 22:13:45 2022] POST /identity/v3/users => generated 293 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:13:46.182094 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f5b58-7fa3-46dd-a434-9899f8085dd1 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:46.232252 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d6c0e2-42b7-424c-b431-ea0e48d43496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:46.233130 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d6c0e2-42b7-424c-b431-ea0e48d43496 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:46.233467 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d6c0e2-42b7-424c-b431-ea0e48d43496 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:46.233796 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d6c0e2-42b7-424c-b431-ea0e48d43496 None admin] PATH_INFO: `/v3/users/102c7ea3db9642cc89ed68e9aa4c81e0` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:46.254668 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d6c0e2-42b7-424c-b431-ea0e48d43496 None admin] RBAC: Authorizing `identity:get_user(user_id=102c7ea3db9642cc89ed68e9aa4c81e0)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:46.256853 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d6c0e2-42b7-424c-b431-ea0e48d43496 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:46.260323 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 149/278] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Aug 29 22:13:46 2022] GET /identity/v3/users/102c7ea3db9642cc89ed68e9aa4c81e0 => generated 293 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:46.270755 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e35473a-ee93-441d-9117-528a7fbea265 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:46.309200 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:46.409456 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e35473a-ee93-441d-9117-528a7fbea265 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:46.456226 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691b085-694b-4c66-8230-e4d8ac049cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:46.456828 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691b085-694b-4c66-8230-e4d8ac049cc2 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:46.457110 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691b085-694b-4c66-8230-e4d8ac049cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:46.457377 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691b085-694b-4c66-8230-e4d8ac049cc2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:46.458135 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9691b085-694b-4c66-8230-e4d8ac049cc2 None admin] RBAC: Adding query filter params (role.id=c358a37c24fe42bca4a93331f2c99d90, user.id=102c7ea3db9642cc89ed68e9aa4c81e0, scope.system=all) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:46.458447 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9691b085-694b-4c66-8230-e4d8ac049cc2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:46.460695 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9691b085-694b-4c66-8230-e4d8ac049cc2 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:46.470680 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 130/279] 10.222.0.36 () {56 vars in 1308 bytes} [Mon Aug 29 22:13:46 2022] GET /identity/v3/role_assignments?user.id=102c7ea3db9642cc89ed68e9aa4c81e0&scope.system=all&role.id=c358a37c24fe42bca4a93331f2c99d90 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:46.705212 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762fd2f-e703-420d-ab55-2845e23087db None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:46.705726 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762fd2f-e703-420d-ab55-2845e23087db None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:46.705890 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762fd2f-e703-420d-ab55-2845e23087db None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:46.707523 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 150/280] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:13:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:13:46.713676 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd71e8-4f50-41d9-94eb-8dac3a34db73 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:46.714232 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd71e8-4f50-41d9-94eb-8dac3a34db73 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:46.714762 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd71e8-4f50-41d9-94eb-8dac3a34db73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:46.742482 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-cabd71e8-4f50-41d9-94eb-8dac3a34db73 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:13:46.744088 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-cabd71e8-4f50-41d9-94eb-8dac3a34db73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:13:46.850871 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 131/281] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:13:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:13:47.252335 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762fd2f-e703-420d-ab55-2845e23087db None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:47.260020 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:47.319653 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfa5a5-0ef6-48a2-9e02-9844722eef49 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:47.320162 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfa5a5-0ef6-48a2-9e02-9844722eef49 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:47.320271 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfa5a5-0ef6-48a2-9e02-9844722eef49 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:47.323496 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 132/282] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:13:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:13:47.327560 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b5a7e-ebe4-4a8d-bcb5-2809f54e9972 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:47.327853 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b5a7e-ebe4-4a8d-bcb5-2809f54e9972 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:47.328132 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b5a7e-ebe4-4a8d-bcb5-2809f54e9972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:47.373543 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-cb4b5a7e-ebe4-4a8d-bcb5-2809f54e9972 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:13:47.374756 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-cb4b5a7e-ebe4-4a8d-bcb5-2809f54e9972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:13:47.406601 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:47.430953 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762fd2f-e703-420d-ab55-2845e23087db None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:47.482071 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b409e95-6379-4252-822c-7cd0e1ef9724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:47.482931 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b409e95-6379-4252-822c-7cd0e1ef9724 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:47.483585 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b409e95-6379-4252-822c-7cd0e1ef9724 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:47.483862 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b409e95-6379-4252-822c-7cd0e1ef9724 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:47.497726 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b409e95-6379-4252-822c-7cd0e1ef9724 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:13:47.505634 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-9b409e95-6379-4252-822c-7cd0e1ef9724 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:13:47.505634 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:13:47.505634 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:13:47.505634 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:13:47.505634 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:13:47.505634 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:13:47.505634 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:13:47.505634 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:13:47.505634 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:13:47.505634 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:13:47.505634 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:13:47.505634 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:13:47.505634 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:13:47.505634 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:13:47.505634 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:13:47.505634 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:13:47.506778 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:13:47.506778 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:13:47.506778 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:13:47.506778 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:13:47.506778 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:13:47.506778 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:13:47.506778 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:13:47.506778 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:13:47.506778 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:13:47.506778 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:13:47.506778 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:13:47.506778 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:13:47.506778 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:13:47.506778 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:13:47.506778 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:13:47.506778 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:13:47.507720 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:13:47.507720 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:13:47.507720 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:13:47.507720 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:13:47.507720 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:13:47.507720 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:13:47.507720 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:13:47.507720 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:13:47.507720 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:13:47.507720 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:13:47.507720 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:13:47.507720 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:13:47.507720 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 151/283] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:13:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:13:47.515710 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b409e95-6379-4252-822c-7cd0e1ef9724 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:47.535471 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 133/284] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:13:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:13:47.616856 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:47.681314 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b409e95-6379-4252-822c-7cd0e1ef9724 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:47.750583 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97bdfcb-172e-42ad-86c0-5282d8f4037a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:47.751439 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97bdfcb-172e-42ad-86c0-5282d8f4037a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:47.751828 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97bdfcb-172e-42ad-86c0-5282d8f4037a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:47.752206 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97bdfcb-172e-42ad-86c0-5282d8f4037a None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:47.753190 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97bdfcb-172e-42ad-86c0-5282d8f4037a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:47.753618 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97bdfcb-172e-42ad-86c0-5282d8f4037a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:47.755753 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97bdfcb-172e-42ad-86c0-5282d8f4037a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:47.768188 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 152/285] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Aug 29 22:13:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:47.774154 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b5a7e-ebe4-4a8d-bcb5-2809f54e9972 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:47.928884 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97bdfcb-172e-42ad-86c0-5282d8f4037a None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:47.985082 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b5a7e-ebe4-4a8d-bcb5-2809f54e9972 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:48.042431 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e700b3-9ac2-454e-b090-4f6eb60401e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:48.043087 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e700b3-9ac2-454e-b090-4f6eb60401e9 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:48.043377 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e700b3-9ac2-454e-b090-4f6eb60401e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:48.043684 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e700b3-9ac2-454e-b090-4f6eb60401e9 None admin] PATH_INFO: `/v3/users/9379dd972a2a4a518b88e10780fd5416` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:48.045431 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e700b3-9ac2-454e-b090-4f6eb60401e9 None admin] RBAC: Authorizing `identity:get_user(user_id=9379dd972a2a4a518b88e10780fd5416)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:48.047073 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e700b3-9ac2-454e-b090-4f6eb60401e9 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:48.049039 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 134/286] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Aug 29 22:13:47 2022] GET /identity/v3/users/9379dd972a2a4a518b88e10780fd5416 => generated 297 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:48.060610 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e700b3-9ac2-454e-b090-4f6eb60401e9 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:48.112901 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:48.160741 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97bdfcb-172e-42ad-86c0-5282d8f4037a None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:48.228968 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:48.248489 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e700b3-9ac2-454e-b090-4f6eb60401e9 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:48.252528 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78725ca-c1e9-4bad-b468-56a563723fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:48.253518 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78725ca-c1e9-4bad-b468-56a563723fbf None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:48.253892 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78725ca-c1e9-4bad-b468-56a563723fbf None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:48.254340 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78725ca-c1e9-4bad-b468-56a563723fbf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:48.282517 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78725ca-c1e9-4bad-b468-56a563723fbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:13:48.292707 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-b78725ca-c1e9-4bad-b468-56a563723fbf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:13:48.292707 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:13:48.292707 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:13:48.292707 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:13:48.292707 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:13:48.292707 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:13:48.292707 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:13:48.292707 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:13:48.292707 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:13:48.292707 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:13:48.292707 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:13:48.292707 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:13:48.292707 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:13:48.292707 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:13:48.292707 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:13:48.292707 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:13:48.294161 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:13:48.294161 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:13:48.294161 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:13:48.294161 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:13:48.294161 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:13:48.294161 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:13:48.294161 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:13:48.294161 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:13:48.294161 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:13:48.294161 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:13:48.294161 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:13:48.294161 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:13:48.294161 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:13:48.294161 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:13:48.294161 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:13:48.294161 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:13:48.295453 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:13:48.295453 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:13:48.295453 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:13:48.295453 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:13:48.295453 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:13:48.295453 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:13:48.295453 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:13:48.295453 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:13:48.295453 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:13:48.295453 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:13:48.295453 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:13:48.295453 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:13:48.297238 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 153/287] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:13:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:13:48.303091 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78725ca-c1e9-4bad-b468-56a563723fbf None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:48.340198 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28fd79f-c796-40e4-9947-878a376fd78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:48.341127 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28fd79f-c796-40e4-9947-878a376fd78c None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:48.341521 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28fd79f-c796-40e4-9947-878a376fd78c None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:48.341910 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28fd79f-c796-40e4-9947-878a376fd78c None admin] PATH_INFO: `/v3/projects/e0b257f7f1874d8483a2453331254e1a` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:48.343522 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28fd79f-c796-40e4-9947-878a376fd78c None admin] RBAC: Authorizing `identity:get_project(project_id=e0b257f7f1874d8483a2453331254e1a)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:48.346193 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28fd79f-c796-40e4-9947-878a376fd78c None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:48.349096 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 135/288] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Aug 29 22:13:48 2022] GET /identity/v3/projects/e0b257f7f1874d8483a2453331254e1a => generated 302 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:13:48.359800 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28fd79f-c796-40e4-9947-878a376fd78c None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:48.462178 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:48.480822 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78725ca-c1e9-4bad-b468-56a563723fbf None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:48.496474 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28fd79f-c796-40e4-9947-878a376fd78c None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:48.527872 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b565bdd-0e19-437d-a84b-99d01e3673f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:48.528615 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b565bdd-0e19-437d-a84b-99d01e3673f9 None admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:48.528886 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b565bdd-0e19-437d-a84b-99d01e3673f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:48.529200 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b565bdd-0e19-437d-a84b-99d01e3673f9 None admin] PATH_INFO: `/v3/projects/e0b257f7f1874d8483a2453331254e1a/users/9379dd972a2a4a518b88e10780fd5416/roles/750444f301bf44c59183e4c5470a0dc5` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:48.531201 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b565bdd-0e19-437d-a84b-99d01e3673f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=e0b257f7f1874d8483a2453331254e1a, user_id=9379dd972a2a4a518b88e10780fd5416, role_id=750444f301bf44c59183e4c5470a0dc5)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:48.532839 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b565bdd-0e19-437d-a84b-99d01e3673f9 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:48.546793 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 136/289] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Aug 29 22:13:48 2022] PUT /identity/v3/projects/e0b257f7f1874d8483a2453331254e1a/users/9379dd972a2a4a518b88e10780fd5416/roles/750444f301bf44c59183e4c5470a0dc5 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:13:48.559214 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3e49a8-b2b1-4072-a633-644a0f25adb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:48.560233 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e49a8-b2b1-4072-a633-644a0f25adb5 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:48.560824 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e49a8-b2b1-4072-a633-644a0f25adb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:48.561291 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e49a8-b2b1-4072-a633-644a0f25adb5 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:48.562188 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3e49a8-b2b1-4072-a633-644a0f25adb5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:48.562781 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3e49a8-b2b1-4072-a633-644a0f25adb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:48.564432 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3e49a8-b2b1-4072-a633-644a0f25adb5 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:48.592405 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 154/290] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Aug 29 22:13:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:48.601315 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b565bdd-0e19-437d-a84b-99d01e3673f9 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:48.751158 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b565bdd-0e19-437d-a84b-99d01e3673f9 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:48.781848 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ee9d2-887e-4554-9a5d-3b0458341395 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:48.782360 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ee9d2-887e-4554-9a5d-3b0458341395 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:48.782831 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ee9d2-887e-4554-9a5d-3b0458341395 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:48.785712 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 155/291] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:13:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:13:48.794105 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cacf744-e713-4b82-96c0-13ca1b1b8830 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:48.794105 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cacf744-e713-4b82-96c0-13ca1b1b8830 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:48.794105 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cacf744-e713-4b82-96c0-13ca1b1b8830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:48.795219 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed46520-2e37-41ef-a168-0227d7e2b8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:48.796081 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed46520-2e37-41ef-a168-0227d7e2b8e4 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:48.796568 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed46520-2e37-41ef-a168-0227d7e2b8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:48.797099 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed46520-2e37-41ef-a168-0227d7e2b8e4 None admin] PATH_INFO: `/v3/users/c2d65f8ea2d34ce9ad379851cb2eb672` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:48.798495 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed46520-2e37-41ef-a168-0227d7e2b8e4 None admin] RBAC: Authorizing `identity:get_user(user_id=c2d65f8ea2d34ce9ad379851cb2eb672)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:48.800131 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed46520-2e37-41ef-a168-0227d7e2b8e4 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:48.802258 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 137/292] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Aug 29 22:13:48 2022] GET /identity/v3/users/c2d65f8ea2d34ce9ad379851cb2eb672 => generated 297 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:13:48.814524 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed46520-2e37-41ef-a168-0227d7e2b8e4 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:48.831332 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:48.843752 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-6cacf744-e713-4b82-96c0-13ca1b1b8830 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:13:48.845832 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-6cacf744-e713-4b82-96c0-13ca1b1b8830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:13:48.949672 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:48.952138 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed46520-2e37-41ef-a168-0227d7e2b8e4 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:48.996776 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 156/293] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:13:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:13:48.998154 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a705c0b1-12ce-4f63-8793-9361348dda14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:48.998917 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a705c0b1-12ce-4f63-8793-9361348dda14 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:48.999262 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a705c0b1-12ce-4f63-8793-9361348dda14 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:48.999601 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a705c0b1-12ce-4f63-8793-9361348dda14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:49.001171 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc3695-be86-4a69-9154-dc1d21730767 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:49.001446 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc3695-be86-4a69-9154-dc1d21730767 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:49.001712 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc3695-be86-4a69-9154-dc1d21730767 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:49.003035 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 157/294] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:13:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:13:49.016423 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d6e72-0e03-4837-9e1c-b26d9bdf200c None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:49.016769 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d6e72-0e03-4837-9e1c-b26d9bdf200c None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:49.016985 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d6e72-0e03-4837-9e1c-b26d9bdf200c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:49.050394 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-9b7d6e72-0e03-4837-9e1c-b26d9bdf200c None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:13:49.052630 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-9b7d6e72-0e03-4837-9e1c-b26d9bdf200c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:13:49.154172 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a705c0b1-12ce-4f63-8793-9361348dda14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:49.156919 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a705c0b1-12ce-4f63-8793-9361348dda14 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:49.199458 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:49.215880 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 158/295] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:13:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 29 22:13:49.383254 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d6e72-0e03-4837-9e1c-b26d9bdf200c None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:49.406658 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 138/296] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:13:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 22:13:49.413907 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a705c0b1-12ce-4f63-8793-9361348dda14 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:49.556998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a705c0b1-12ce-4f63-8793-9361348dda14 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:49.575150 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:49.594607 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d6e72-0e03-4837-9e1c-b26d9bdf200c None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:49.607186 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:49.612300 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced2cb7b-f5c9-4db4-b630-8c909220cf8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:49.613758 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2cb7b-f5c9-4db4-b630-8c909220cf8c None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:49.614270 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2cb7b-f5c9-4db4-b630-8c909220cf8c None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:49.614744 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2cb7b-f5c9-4db4-b630-8c909220cf8c None admin] PATH_INFO: `/v3/projects/e0b257f7f1874d8483a2453331254e1a` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:49.616238 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced2cb7b-f5c9-4db4-b630-8c909220cf8c None admin] RBAC: Authorizing `identity:get_project(project_id=e0b257f7f1874d8483a2453331254e1a)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:49.618748 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced2cb7b-f5c9-4db4-b630-8c909220cf8c None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:49.621602 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 139/297] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Aug 29 22:13:49 2022] GET /identity/v3/projects/e0b257f7f1874d8483a2453331254e1a => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:49.623732 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9733225-893f-45b2-8b7a-02d8009e75a8 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:49.624380 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9733225-893f-45b2-8b7a-02d8009e75a8 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:49.625029 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9733225-893f-45b2-8b7a-02d8009e75a8 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:49.627193 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 140/298] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:13:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:13:49.628578 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9733225-893f-45b2-8b7a-02d8009e75a8 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:49.647184 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34893a-7fca-4a7d-b2de-d38934080bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:49.647746 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34893a-7fca-4a7d-b2de-d38934080bbe None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:49.648023 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34893a-7fca-4a7d-b2de-d38934080bbe None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:49.648296 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34893a-7fca-4a7d-b2de-d38934080bbe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:49.663993 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd34893a-7fca-4a7d-b2de-d38934080bbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:13:49.673260 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-fd34893a-7fca-4a7d-b2de-d38934080bbe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:13:49.673260 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:13:49.673260 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:13:49.673260 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:13:49.673260 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:13:49.673260 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:13:49.673260 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:13:49.673260 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:13:49.673260 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:13:49.673260 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:13:49.673260 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:13:49.673260 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:13:49.673260 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:13:49.673260 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:13:49.673260 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:13:49.673260 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:13:49.674209 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:13:49.674209 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:13:49.674209 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:13:49.674209 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:13:49.674209 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:13:49.674209 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:13:49.674209 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:13:49.674209 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:13:49.674209 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:13:49.674209 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:13:49.674209 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:13:49.674209 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:13:49.674209 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:13:49.674209 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:13:49.674209 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:13:49.674209 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:13:49.675061 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:13:49.675061 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:13:49.675061 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:13:49.675061 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:13:49.675061 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:13:49.675061 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:13:49.675061 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:13:49.675061 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:13:49.675061 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:13:49.675061 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:13:49.675061 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:13:49.675061 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:13:49.677851 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 159/299] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:13:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:13:49.680174 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee9a86-9d7f-4ad3-acd5-9db5b3ad7b96 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:49.680174 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee9a86-9d7f-4ad3-acd5-9db5b3ad7b96 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:49.680174 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee9a86-9d7f-4ad3-acd5-9db5b3ad7b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:49.698701 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-50ee9a86-9d7f-4ad3-acd5-9db5b3ad7b96 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:13:49.699910 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-50ee9a86-9d7f-4ad3-acd5-9db5b3ad7b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:13:49.776230 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9733225-893f-45b2-8b7a-02d8009e75a8 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:49.803306 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 160/300] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:13:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:13:49.804218 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ee9a86-9d7f-4ad3-acd5-9db5b3ad7b96 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:49.824785 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b66a3-20a7-4483-9e7f-0ac82abcc2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:49.825514 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b66a3-20a7-4483-9e7f-0ac82abcc2ae None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:49.825795 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b66a3-20a7-4483-9e7f-0ac82abcc2ae None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:49.826065 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b66a3-20a7-4483-9e7f-0ac82abcc2ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:49.826793 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22b66a3-20a7-4483-9e7f-0ac82abcc2ae None admin] RBAC: Adding query filter params (role.id=c358a37c24fe42bca4a93331f2c99d90, scope.project.id=e0b257f7f1874d8483a2453331254e1a, user.id=c2d65f8ea2d34ce9ad379851cb2eb672) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:49.827152 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22b66a3-20a7-4483-9e7f-0ac82abcc2ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:49.828743 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22b66a3-20a7-4483-9e7f-0ac82abcc2ae None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:49.835334 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 141/301] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Aug 29 22:13:49 2022] GET /identity/v3/role_assignments?user.id=c2d65f8ea2d34ce9ad379851cb2eb672&scope.project.id=e0b257f7f1874d8483a2453331254e1a&role.id=c358a37c24fe42bca4a93331f2c99d90 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:49.836239 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b66a3-20a7-4483-9e7f-0ac82abcc2ae None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:49.909851 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:49.966676 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:49.971894 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ee9a86-9d7f-4ad3-acd5-9db5b3ad7b96 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:50.000763 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b66a3-20a7-4483-9e7f-0ac82abcc2ae None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:50.017858 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddfd892-b27f-4b78-b8dd-347dc2bee2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:50.018767 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddfd892-b27f-4b78-b8dd-347dc2bee2a7 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:50.019061 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddfd892-b27f-4b78-b8dd-347dc2bee2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:50.019422 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddfd892-b27f-4b78-b8dd-347dc2bee2a7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:50.032319 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddfd892-b27f-4b78-b8dd-347dc2bee2a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:13:50.037596 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-5ddfd892-b27f-4b78-b8dd-347dc2bee2a7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:13:50.037596 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:13:50.037596 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:13:50.037596 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:13:50.037596 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:13:50.037596 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:13:50.037596 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:13:50.037596 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:13:50.037596 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:13:50.037596 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:13:50.037596 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:13:50.037596 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:13:50.037596 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:13:50.037596 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:13:50.037596 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:13:50.037596 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:13:50.038769 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:13:50.038769 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:13:50.038769 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:13:50.038769 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:13:50.038769 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:13:50.038769 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:13:50.038769 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:13:50.038769 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:13:50.038769 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:13:50.038769 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:13:50.038769 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:13:50.038769 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:13:50.038769 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:13:50.038769 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:13:50.038769 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:13:50.038769 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:13:50.039759 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:13:50.039759 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:13:50.039759 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:13:50.039759 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:13:50.039759 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:13:50.039759 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:13:50.039759 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:13:50.039759 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:13:50.039759 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:13:50.039759 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:13:50.039759 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:13:50.039759 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:13:50.041832 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 161/302] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:13:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:13:50.055874 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb49e6a3-cf06-4dbc-8472-5e10fd3d695c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:50.057022 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49e6a3-cf06-4dbc-8472-5e10fd3d695c None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:50.058890 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddfd892-b27f-4b78-b8dd-347dc2bee2a7 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:50.064907 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49e6a3-cf06-4dbc-8472-5e10fd3d695c None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:50.064907 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49e6a3-cf06-4dbc-8472-5e10fd3d695c None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:50.071375 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb49e6a3-cf06-4dbc-8472-5e10fd3d695c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:50.071783 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb49e6a3-cf06-4dbc-8472-5e10fd3d695c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:50.075434 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb49e6a3-cf06-4dbc-8472-5e10fd3d695c None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:50.096961 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 142/303] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Aug 29 22:13:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:50.104583 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb49e6a3-cf06-4dbc-8472-5e10fd3d695c None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:50.220698 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddfd892-b27f-4b78-b8dd-347dc2bee2a7 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:50.228922 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb49e6a3-cf06-4dbc-8472-5e10fd3d695c None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:50.238034 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:50.275814 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52f5f52-8e4e-49b7-a7fc-fcc3f5755987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:50.278211 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f5f52-8e4e-49b7-a7fc-fcc3f5755987 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:50.278322 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a87d3d3-a599-4025-9871-618682e1a809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:50.278410 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f5f52-8e4e-49b7-a7fc-fcc3f5755987 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:50.278410 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f5f52-8e4e-49b7-a7fc-fcc3f5755987 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:50.278561 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a87d3d3-a599-4025-9871-618682e1a809 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:50.278561 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a87d3d3-a599-4025-9871-618682e1a809 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:50.278561 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a87d3d3-a599-4025-9871-618682e1a809 None admin] PATH_INFO: `/v3/users/9082451e8ff144a597f4b666fd09efea` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:50.278733 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52f5f52-8e4e-49b7-a7fc-fcc3f5755987 None admin] RBAC: Adding query filter params (name=member) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:50.279063 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52f5f52-8e4e-49b7-a7fc-fcc3f5755987 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:50.287745 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52f5f52-8e4e-49b7-a7fc-fcc3f5755987 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:50.297272 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a87d3d3-a599-4025-9871-618682e1a809 None admin] RBAC: Authorizing `identity:get_user(user_id=9082451e8ff144a597f4b666fd09efea)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:50.299383 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a87d3d3-a599-4025-9871-618682e1a809 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:50.300120 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 162/304] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Aug 29 22:13:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:13:50.301567 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52f5f52-8e4e-49b7-a7fc-fcc3f5755987 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:50.302120 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 143/305] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Aug 29 22:13:50 2022] GET /identity/v3/users/9082451e8ff144a597f4b666fd09efea => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:50.307635 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a87d3d3-a599-4025-9871-618682e1a809 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:50.348967 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:50.460785 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52f5f52-8e4e-49b7-a7fc-fcc3f5755987 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:50.467874 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a87d3d3-a599-4025-9871-618682e1a809 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:50.512123 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db84d92-d8cc-4bd2-9ec1-80cc0aeccaf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:50.513125 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db84d92-d8cc-4bd2-9ec1-80cc0aeccaf1 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:50.513541 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db84d92-d8cc-4bd2-9ec1-80cc0aeccaf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:50.513933 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db84d92-d8cc-4bd2-9ec1-80cc0aeccaf1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:50.515558 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db84d92-d8cc-4bd2-9ec1-80cc0aeccaf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:50.517066 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db84d92-d8cc-4bd2-9ec1-80cc0aeccaf1 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:50.518820 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 163/306] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:13:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:50.520600 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f01d6-1a21-4bba-8bdc-07659ee6f985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:50.521466 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f01d6-1a21-4bba-8bdc-07659ee6f985 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:50.521965 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db84d92-d8cc-4bd2-9ec1-80cc0aeccaf1 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:50.522229 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f01d6-1a21-4bba-8bdc-07659ee6f985 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:50.522685 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f01d6-1a21-4bba-8bdc-07659ee6f985 None admin] PATH_INFO: `/v3/users/102c7ea3db9642cc89ed68e9aa4c81e0` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:50.524651 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f01d6-1a21-4bba-8bdc-07659ee6f985 None admin] RBAC: Authorizing `identity:get_user(user_id=102c7ea3db9642cc89ed68e9aa4c81e0)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:50.526460 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f01d6-1a21-4bba-8bdc-07659ee6f985 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:50.528418 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 144/307] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Aug 29 22:13:50 2022] GET /identity/v3/users/102c7ea3db9642cc89ed68e9aa4c81e0 => generated 293 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:13:50.529432 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f01d6-1a21-4bba-8bdc-07659ee6f985 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:50.579307 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:50.652837 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:50.665366 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f01d6-1a21-4bba-8bdc-07659ee6f985 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:50.671338 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db84d92-d8cc-4bd2-9ec1-80cc0aeccaf1 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:50.709825 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5fbeb2-daff-40b8-9f3a-d091eba54b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:50.710450 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5fbeb2-daff-40b8-9f3a-d091eba54b84 None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:50.710737 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5fbeb2-daff-40b8-9f3a-d091eba54b84 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:50.711008 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5fbeb2-daff-40b8-9f3a-d091eba54b84 None admin] PATH_INFO: `/v3/groups` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:50.712019 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5fbeb2-daff-40b8-9f3a-d091eba54b84 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:50.713750 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5fbeb2-daff-40b8-9f3a-d091eba54b84 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:50.717487 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b441e-fc6a-4c8a-93b1-34fd94287939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:50.718212 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b441e-fc6a-4c8a-93b1-34fd94287939 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:50.718498 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b441e-fc6a-4c8a-93b1-34fd94287939 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:50.718957 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b441e-fc6a-4c8a-93b1-34fd94287939 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:50.719535 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78b441e-fc6a-4c8a-93b1-34fd94287939 None admin] RBAC: Adding query filter params (role.id=750444f301bf44c59183e4c5470a0dc5, user.id=9082451e8ff144a597f4b666fd09efea, scope.system=all) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:50.719845 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78b441e-fc6a-4c8a-93b1-34fd94287939 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:50.721325 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78b441e-fc6a-4c8a-93b1-34fd94287939 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:50.728319 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 164/308] 10.222.0.36 () {56 vars in 1308 bytes} [Mon Aug 29 22:13:50 2022] GET /identity/v3/role_assignments?user.id=9082451e8ff144a597f4b666fd09efea&scope.system=all&role.id=750444f301bf44c59183e4c5470a0dc5 => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:50.729064 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b441e-fc6a-4c8a-93b1-34fd94287939 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:50.753537 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 145/309] 10.222.0.36 () {60 vars in 1134 bytes} [Mon Aug 29 22:13:50 2022] POST /identity/v3/groups => generated 229 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:13:50.896483 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b441e-fc6a-4c8a-93b1-34fd94287939 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:50.938065 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd589ac0-110c-456a-8b4f-d4f4f0586b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:50.938750 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd589ac0-110c-456a-8b4f-d4f4f0586b17 None admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:50.939034 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd589ac0-110c-456a-8b4f-d4f4f0586b17 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:50.939310 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd589ac0-110c-456a-8b4f-d4f4f0586b17 None admin] PATH_INFO: `/v3/system/users/102c7ea3db9642cc89ed68e9aa4c81e0/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:50.940846 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd589ac0-110c-456a-8b4f-d4f4f0586b17 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=102c7ea3db9642cc89ed68e9aa4c81e0, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:50.942324 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd589ac0-110c-456a-8b4f-d4f4f0586b17 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:50.955221 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 165/310] 10.222.0.36 () {58 vars in 1334 bytes} [Mon Aug 29 22:13:50 2022] PUT /identity/v3/system/users/102c7ea3db9642cc89ed68e9aa4c81e0/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:13:51.323833 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0dfaf-3d03-4e15-9d26-a06f60b08061 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:51.324253 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0dfaf-3d03-4e15-9d26-a06f60b08061 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:51.324423 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0dfaf-3d03-4e15-9d26-a06f60b08061 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:51.325765 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 146/311] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:13:51.331236 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7e97b-6060-4f6d-b6f4-18a93ca8b8df None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:51.331526 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7e97b-6060-4f6d-b6f4-18a93ca8b8df None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:51.331802 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7e97b-6060-4f6d-b6f4-18a93ca8b8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:51.352749 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-22a7e97b-6060-4f6d-b6f4-18a93ca8b8df None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:13:51.354117 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-22a7e97b-6060-4f6d-b6f4-18a93ca8b8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:13:51.366383 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:51.448626 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 166/312] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:13:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:13:51.719642 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc0dfaf-3d03-4e15-9d26-a06f60b08061 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:51.842734 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:51.858438 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc0dfaf-3d03-4e15-9d26-a06f60b08061 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:51.898264 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9f23d-4e10-4802-8f78-dc142259e7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:51.898897 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9f23d-4e10-4802-8f78-dc142259e7db None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:51.899168 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9f23d-4e10-4802-8f78-dc142259e7db None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:51.899483 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9f23d-4e10-4802-8f78-dc142259e7db None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:51.910454 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a9f23d-4e10-4802-8f78-dc142259e7db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:13:51.915784 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-a3a9f23d-4e10-4802-8f78-dc142259e7db None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:13:51.915784 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:13:51.915784 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:13:51.915784 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:13:51.915784 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:13:51.915784 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:13:51.915784 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:13:51.915784 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:13:51.915784 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:13:51.915784 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:13:51.915784 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:13:51.915784 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:13:51.915784 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:13:51.915784 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:13:51.915784 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:13:51.915784 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:13:51.916890 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:13:51.916890 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:13:51.916890 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:13:51.916890 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:13:51.916890 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:13:51.916890 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:13:51.916890 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:13:51.916890 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:13:51.916890 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:13:51.916890 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:13:51.916890 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:13:51.916890 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:13:51.916890 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:13:51.916890 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:13:51.916890 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:13:51.916890 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:13:51.917683 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:13:51.917683 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:13:51.917683 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:13:51.917683 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:13:51.917683 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:13:51.917683 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:13:51.917683 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:13:51.917683 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:13:51.917683 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:13:51.917683 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:13:51.917683 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:13:51.917683 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:13:51.917683 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 147/313] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:13:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:13:51.925040 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a7e97b-6060-4f6d-b6f4-18a93ca8b8df None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:52.048030 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a7e97b-6060-4f6d-b6f4-18a93ca8b8df None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:52.096831 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c123c23-360d-4528-b0b6-1bf0760b08ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:52.097454 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c123c23-360d-4528-b0b6-1bf0760b08ab None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:52.097733 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c123c23-360d-4528-b0b6-1bf0760b08ab None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:52.098004 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c123c23-360d-4528-b0b6-1bf0760b08ab None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:52.098675 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c123c23-360d-4528-b0b6-1bf0760b08ab None admin] RBAC: Adding query filter params (name=reader) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:52.098976 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c123c23-360d-4528-b0b6-1bf0760b08ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:52.100343 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c123c23-360d-4528-b0b6-1bf0760b08ab None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:52.109758 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 167/314] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Aug 29 22:13:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:52.115275 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9f23d-4e10-4802-8f78-dc142259e7db None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:52.251061 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9f23d-4e10-4802-8f78-dc142259e7db None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:52.293302 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4202c-e177-4e7b-a575-fd2fe2a4e4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:52.293950 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4202c-e177-4e7b-a575-fd2fe2a4e4b2 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:52.294229 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4202c-e177-4e7b-a575-fd2fe2a4e4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:52.294496 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4202c-e177-4e7b-a575-fd2fe2a4e4b2 None admin] PATH_INFO: `/v3/users/9379dd972a2a4a518b88e10780fd5416` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:52.295624 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef4202c-e177-4e7b-a575-fd2fe2a4e4b2 None admin] RBAC: Authorizing `identity:get_user(user_id=9379dd972a2a4a518b88e10780fd5416)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:52.297107 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef4202c-e177-4e7b-a575-fd2fe2a4e4b2 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:52.299097 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 148/315] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Aug 29 22:13:52 2022] GET /identity/v3/users/9379dd972a2a4a518b88e10780fd5416 => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:52.304888 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c123c23-360d-4528-b0b6-1bf0760b08ab None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:52.320856 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:52.457334 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c123c23-360d-4528-b0b6-1bf0760b08ab None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:52.495552 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dd1848-ac95-40a4-89e6-4f99d74c0519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:52.496613 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd1848-ac95-40a4-89e6-4f99d74c0519 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:52.497120 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd1848-ac95-40a4-89e6-4f99d74c0519 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:52.497584 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd1848-ac95-40a4-89e6-4f99d74c0519 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:52.577209 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dd1848-ac95-40a4-89e6-4f99d74c0519 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:52.579072 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dd1848-ac95-40a4-89e6-4f99d74c0519 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:52.590345 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:52.701403 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 168/316] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:13:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:13:52.707402 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4202c-e177-4e7b-a575-fd2fe2a4e4b2 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:52.732753 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:52.821099 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4202c-e177-4e7b-a575-fd2fe2a4e4b2 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:52.856357 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dd8b3b-005a-4009-b886-7cfe9d86c3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:52.856949 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd8b3b-005a-4009-b886-7cfe9d86c3b2 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:52.857222 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd8b3b-005a-4009-b886-7cfe9d86c3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:52.857489 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd8b3b-005a-4009-b886-7cfe9d86c3b2 None admin] PATH_INFO: `/v3/projects/e0b257f7f1874d8483a2453331254e1a` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:52.858601 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dd8b3b-005a-4009-b886-7cfe9d86c3b2 None admin] RBAC: Authorizing `identity:get_project(project_id=e0b257f7f1874d8483a2453331254e1a)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:52.860056 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dd8b3b-005a-4009-b886-7cfe9d86c3b2 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:52.862040 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 149/317] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Aug 29 22:13:52 2022] GET /identity/v3/projects/e0b257f7f1874d8483a2453331254e1a => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:52.869958 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dd1848-ac95-40a4-89e6-4f99d74c0519 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:52.904291 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a521c-041c-4a8b-90e3-9fc43484c1a7 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:52.904614 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a521c-041c-4a8b-90e3-9fc43484c1a7 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:52.904890 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a521c-041c-4a8b-90e3-9fc43484c1a7 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:52.906543 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 150/318] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:13:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:13:52.911365 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f38660-de41-4b48-937e-bfbcc5a85d46 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:52.911647 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f38660-de41-4b48-937e-bfbcc5a85d46 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:52.911919 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f38660-de41-4b48-937e-bfbcc5a85d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:52.932690 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-84f38660-de41-4b48-937e-bfbcc5a85d46 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:13:52.934377 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-84f38660-de41-4b48-937e-bfbcc5a85d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:13:52.981946 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dd1848-ac95-40a4-89e6-4f99d74c0519 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:52.995214 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:53.028479 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 151/319] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:13:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:13:53.028479 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd2826-e4db-4e81-bb04-b9ebc8867632 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:53.028479 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd2826-e4db-4e81-bb04-b9ebc8867632 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:53.028479 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd2826-e4db-4e81-bb04-b9ebc8867632 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:53.028479 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 152/320] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:13:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:13:53.028941 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97df13-f7dd-41c4-8ec2-ed5306cd111a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:53.028941 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97df13-f7dd-41c4-8ec2-ed5306cd111a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:53.028941 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97df13-f7dd-41c4-8ec2-ed5306cd111a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:53.028941 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97df13-f7dd-41c4-8ec2-ed5306cd111a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:53.029200 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a97df13-f7dd-41c4-8ec2-ed5306cd111a None admin] RBAC: Adding query filter params (role.id=750444f301bf44c59183e4c5470a0dc5, scope.project.id=e0b257f7f1874d8483a2453331254e1a, user.id=9379dd972a2a4a518b88e10780fd5416) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:53.029200 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a97df13-f7dd-41c4-8ec2-ed5306cd111a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:53.029200 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a97df13-f7dd-41c4-8ec2-ed5306cd111a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:53.029774 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a2595-c8b8-43ff-93a9-e914fec93ee6 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:53.030117 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a2595-c8b8-43ff-93a9-e914fec93ee6 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:53.030385 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a2595-c8b8-43ff-93a9-e914fec93ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:53.035875 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 169/321] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Aug 29 22:13:52 2022] GET /identity/v3/role_assignments?user.id=9379dd972a2a4a518b88e10780fd5416&scope.project.id=e0b257f7f1874d8483a2453331254e1a&role.id=750444f301bf44c59183e4c5470a0dc5 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:53.050864 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-4a5a2595-c8b8-43ff-93a9-e914fec93ee6 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:13:53.052230 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-4a5a2595-c8b8-43ff-93a9-e914fec93ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:13:53.068900 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:53.087529 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c07ea-7bf4-459b-9614-8c61b18bef21 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:53.087847 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c07ea-7bf4-459b-9614-8c61b18bef21 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:53.088221 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c07ea-7bf4-459b-9614-8c61b18bef21 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:53.090034 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 170/322] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:13:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:13:53.096311 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52374d4-373e-42e3-a498-06b31f4e4156 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:53.096592 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52374d4-373e-42e3-a498-06b31f4e4156 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:53.096854 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52374d4-373e-42e3-a498-06b31f4e4156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:53.120158 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-f52374d4-373e-42e3-a498-06b31f4e4156 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:13:53.121875 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f52374d4-373e-42e3-a498-06b31f4e4156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:13:53.145821 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 153/323] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:13:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:13:53.206627 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 171/324] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:13:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:13:53.342352 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a2595-c8b8-43ff-93a9-e914fec93ee6 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:53.407656 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52374d4-373e-42e3-a498-06b31f4e4156 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:53.461602 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a2595-c8b8-43ff-93a9-e914fec93ee6 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:53.502148 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d692e-25e8-4cb5-aa29-bacee1dff825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:53.502769 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d692e-25e8-4cb5-aa29-bacee1dff825 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:53.503055 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d692e-25e8-4cb5-aa29-bacee1dff825 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:53.503331 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d692e-25e8-4cb5-aa29-bacee1dff825 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:53.504631 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d692e-25e8-4cb5-aa29-bacee1dff825 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:53.506130 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d692e-25e8-4cb5-aa29-bacee1dff825 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:53.507719 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 154/325] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:13:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:53.513465 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d692e-25e8-4cb5-aa29-bacee1dff825 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:53.526291 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52374d4-373e-42e3-a498-06b31f4e4156 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:53.527831 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:53.532795 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:53.562518 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9bdff0-9507-4a05-85c0-f5fa8fa8afbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:53.563152 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9bdff0-9507-4a05-85c0-f5fa8fa8afbe None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:53.563426 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9bdff0-9507-4a05-85c0-f5fa8fa8afbe None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:53.563690 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9bdff0-9507-4a05-85c0-f5fa8fa8afbe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:53.573812 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9bdff0-9507-4a05-85c0-f5fa8fa8afbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:13:53.578607 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-ba9bdff0-9507-4a05-85c0-f5fa8fa8afbe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:13:53.578607 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:13:53.578607 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:13:53.578607 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:13:53.578607 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:13:53.578607 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:13:53.578607 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:13:53.578607 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:13:53.578607 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:13:53.578607 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:13:53.578607 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:13:53.578607 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:13:53.578607 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:13:53.578607 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:13:53.578607 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:13:53.578607 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:13:53.579683 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:13:53.579683 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:13:53.579683 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:13:53.579683 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:13:53.579683 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:13:53.579683 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:13:53.579683 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:13:53.579683 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:13:53.579683 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:13:53.579683 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:13:53.579683 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:13:53.579683 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:13:53.579683 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:13:53.579683 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:13:53.579683 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:13:53.579683 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:13:53.580531 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:13:53.580531 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:13:53.580531 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:13:53.580531 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:13:53.580531 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:13:53.580531 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:13:53.580531 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:13:53.580531 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:13:53.580531 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:13:53.580531 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:13:53.580531 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:13:53.580531 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:13:53.580531 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 172/326] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:13:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:13:53.585194 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9bdff0-9507-4a05-85c0-f5fa8fa8afbe None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:53.618391 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d692e-25e8-4cb5-aa29-bacee1dff825 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:53.651534 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f112cac-4bd2-4110-81ba-da4b7e13e941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:53.652136 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f112cac-4bd2-4110-81ba-da4b7e13e941 None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:53.652415 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f112cac-4bd2-4110-81ba-da4b7e13e941 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:53.652710 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f112cac-4bd2-4110-81ba-da4b7e13e941 None admin] PATH_INFO: `/v3/groups` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:53.653330 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f112cac-4bd2-4110-81ba-da4b7e13e941 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:53.654759 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f112cac-4bd2-4110-81ba-da4b7e13e941 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:53.671489 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 155/327] 10.222.0.36 () {60 vars in 1134 bytes} [Mon Aug 29 22:13:53 2022] POST /identity/v3/groups => generated 226 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:13:53.672570 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f112cac-4bd2-4110-81ba-da4b7e13e941 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:53.703002 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9bdff0-9507-4a05-85c0-f5fa8fa8afbe None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:53.750523 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28790547-815d-465f-8c9b-01b50383b427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:53.751313 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28790547-815d-465f-8c9b-01b50383b427 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:53.751587 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28790547-815d-465f-8c9b-01b50383b427 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:53.751848 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28790547-815d-465f-8c9b-01b50383b427 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:53.761786 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:53.767088 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28790547-815d-465f-8c9b-01b50383b427 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:13:53.772195 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-28790547-815d-465f-8c9b-01b50383b427 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:13:53.772195 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:13:53.772195 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:13:53.772195 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:13:53.772195 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:13:53.772195 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:13:53.772195 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:13:53.772195 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:13:53.772195 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:13:53.772195 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:13:53.772195 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:13:53.772195 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:13:53.772195 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:13:53.772195 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:13:53.772195 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:13:53.772195 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:13:53.773187 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:13:53.773187 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:13:53.773187 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:13:53.773187 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:13:53.773187 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:13:53.773187 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:13:53.773187 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:13:53.773187 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:13:53.773187 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:13:53.773187 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:13:53.773187 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:13:53.773187 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:13:53.773187 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:13:53.773187 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:13:53.773187 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:13:53.773187 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:13:53.774046 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:13:53.774046 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:13:53.774046 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:13:53.774046 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:13:53.774046 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:13:53.774046 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:13:53.774046 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:13:53.774046 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:13:53.774046 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:13:53.774046 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:13:53.774046 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:13:53.774046 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:13:53.774046 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 173/328] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:13:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:13:53.781330 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28790547-815d-465f-8c9b-01b50383b427 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:53.794267 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f112cac-4bd2-4110-81ba-da4b7e13e941 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:53.812495 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:53.832051 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021f296-c480-4091-8600-0c2c1b88a62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:53.832718 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021f296-c480-4091-8600-0c2c1b88a62a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:53.832996 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021f296-c480-4091-8600-0c2c1b88a62a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:53.833269 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021f296-c480-4091-8600-0c2c1b88a62a None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:53.834406 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f021f296-c480-4091-8600-0c2c1b88a62a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:53.834713 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f021f296-c480-4091-8600-0c2c1b88a62a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:53.836471 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f021f296-c480-4091-8600-0c2c1b88a62a None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:53.847206 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 156/329] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Aug 29 22:13:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:53.853129 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021f296-c480-4091-8600-0c2c1b88a62a None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:53.906502 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28790547-815d-465f-8c9b-01b50383b427 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:53.950089 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d8f556-5df3-4d71-97cc-7f6a2e9b0247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:53.950756 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d8f556-5df3-4d71-97cc-7f6a2e9b0247 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:53.950928 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d8f556-5df3-4d71-97cc-7f6a2e9b0247 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:53.951162 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d8f556-5df3-4d71-97cc-7f6a2e9b0247 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:53.952122 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d8f556-5df3-4d71-97cc-7f6a2e9b0247 None admin] RBAC: Adding query filter params (name=member) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:53.952238 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d8f556-5df3-4d71-97cc-7f6a2e9b0247 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:53.954211 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d8f556-5df3-4d71-97cc-7f6a2e9b0247 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:53.964627 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 174/330] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Aug 29 22:13:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:13:53.969980 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d8f556-5df3-4d71-97cc-7f6a2e9b0247 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:53.985307 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021f296-c480-4091-8600-0c2c1b88a62a None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:54.023003 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad5f78-87ab-41a0-8d9e-186209feec6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:54.023941 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad5f78-87ab-41a0-8d9e-186209feec6a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:54.024644 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad5f78-87ab-41a0-8d9e-186209feec6a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:54.026009 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad5f78-87ab-41a0-8d9e-186209feec6a None admin] PATH_INFO: `/v3/users/9082451e8ff144a597f4b666fd09efea` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:54.027749 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad5f78-87ab-41a0-8d9e-186209feec6a None admin] RBAC: Authorizing `identity:get_user(user_id=9082451e8ff144a597f4b666fd09efea)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:54.029450 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad5f78-87ab-41a0-8d9e-186209feec6a None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:54.031311 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 157/331] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Aug 29 22:13:53 2022] GET /identity/v3/users/9082451e8ff144a597f4b666fd09efea => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:54.037808 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad5f78-87ab-41a0-8d9e-186209feec6a None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:54.049656 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:54.082463 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:54.102893 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d8f556-5df3-4d71-97cc-7f6a2e9b0247 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:54.146806 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d5c19-6d7d-4ca2-9057-c459852aa520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:54.147541 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d5c19-6d7d-4ca2-9057-c459852aa520 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:54.147887 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d5c19-6d7d-4ca2-9057-c459852aa520 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:54.148167 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d5c19-6d7d-4ca2-9057-c459852aa520 None admin] PATH_INFO: `/v3/users/102c7ea3db9642cc89ed68e9aa4c81e0` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:54.149408 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40d5c19-6d7d-4ca2-9057-c459852aa520 None admin] RBAC: Authorizing `identity:get_user(user_id=102c7ea3db9642cc89ed68e9aa4c81e0)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:54.151121 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40d5c19-6d7d-4ca2-9057-c459852aa520 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:54.153853 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 175/332] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Aug 29 22:13:53 2022] GET /identity/v3/users/102c7ea3db9642cc89ed68e9aa4c81e0 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:13:54.160612 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d5c19-6d7d-4ca2-9057-c459852aa520 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:54.177956 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad5f78-87ab-41a0-8d9e-186209feec6a None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:54.222531 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39eafd-1db2-4a71-8e38-c55620ec90c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:54.223738 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39eafd-1db2-4a71-8e38-c55620ec90c1 None admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:54.224161 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39eafd-1db2-4a71-8e38-c55620ec90c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:54.224765 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39eafd-1db2-4a71-8e38-c55620ec90c1 None admin] PATH_INFO: `/v3/system/users/9082451e8ff144a597f4b666fd09efea/roles/750444f301bf44c59183e4c5470a0dc5` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:54.227019 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a39eafd-1db2-4a71-8e38-c55620ec90c1 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9082451e8ff144a597f4b666fd09efea, role_id=750444f301bf44c59183e4c5470a0dc5)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:54.229332 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a39eafd-1db2-4a71-8e38-c55620ec90c1 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:54.245212 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 158/333] 10.222.0.36 () {58 vars in 1334 bytes} [Mon Aug 29 22:13:54 2022] PUT /identity/v3/system/users/9082451e8ff144a597f4b666fd09efea/roles/750444f301bf44c59183e4c5470a0dc5 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:13:54.280868 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d5c19-6d7d-4ca2-9057-c459852aa520 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:54.319627 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab6961-240b-479b-8cb9-fcd683e904c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:54.320524 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab6961-240b-479b-8cb9-fcd683e904c3 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:54.320978 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab6961-240b-479b-8cb9-fcd683e904c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:54.321637 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab6961-240b-479b-8cb9-fcd683e904c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:54.322574 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab6961-240b-479b-8cb9-fcd683e904c3 None admin] RBAC: Adding query filter params (role.id=c358a37c24fe42bca4a93331f2c99d90, user.id=102c7ea3db9642cc89ed68e9aa4c81e0, scope.system=all) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:54.323044 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab6961-240b-479b-8cb9-fcd683e904c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:54.324777 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab6961-240b-479b-8cb9-fcd683e904c3 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:54.338631 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 176/334] 10.222.0.36 () {56 vars in 1308 bytes} [Mon Aug 29 22:13:54 2022] GET /identity/v3/role_assignments?user.id=102c7ea3db9642cc89ed68e9aa4c81e0&scope.system=all&role.id=c358a37c24fe42bca4a93331f2c99d90 => generated 510 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:13:56.421509 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd298ec-e38f-4653-82ca-d524a0c3d62f None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:56.422043 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd298ec-e38f-4653-82ca-d524a0c3d62f None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:56.422043 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd298ec-e38f-4653-82ca-d524a0c3d62f None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:56.423723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 159/335] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:13:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:13:56.440091 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441c171-7247-44fe-a0b4-66e873e9b863 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:56.440654 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441c171-7247-44fe-a0b4-66e873e9b863 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:56.440857 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441c171-7247-44fe-a0b4-66e873e9b863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:56.465648 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-8441c171-7247-44fe-a0b4-66e873e9b863 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:13:56.466920 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-8441c171-7247-44fe-a0b4-66e873e9b863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:13:56.470178 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:56.549730 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fae0d-121c-44b1-9e23-d9cf5e56afa3 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:56.550050 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fae0d-121c-44b1-9e23-d9cf5e56afa3 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:56.550270 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fae0d-121c-44b1-9e23-d9cf5e56afa3 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:56.551849 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 160/336] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:13:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:13:56.554924 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 177/337] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:13:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:13:56.557245 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be55b5a-fd55-439d-8a04-ace55c386fd8 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:56.557529 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be55b5a-fd55-439d-8a04-ace55c386fd8 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:56.557803 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be55b5a-fd55-439d-8a04-ace55c386fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:56.595135 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-2be55b5a-fd55-439d-8a04-ace55c386fd8 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:13:56.596367 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-2be55b5a-fd55-439d-8a04-ace55c386fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:13:56.647662 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a841fa-ef02-434f-be2f-ffa15a32ff8b None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:56.647983 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a841fa-ef02-434f-be2f-ffa15a32ff8b None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:56.648215 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a841fa-ef02-434f-be2f-ffa15a32ff8b None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:56.651422 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 178/338] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:13:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:13:56.655597 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7191573-354a-47b1-8ba8-5aab95b0df90 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:56.655879 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7191573-354a-47b1-8ba8-5aab95b0df90 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:56.656154 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7191573-354a-47b1-8ba8-5aab95b0df90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:56.681443 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:56.686934 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 161/339] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:13:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:13:56.688043 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-b7191573-354a-47b1-8ba8-5aab95b0df90 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:13:56.689953 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b7191573-354a-47b1-8ba8-5aab95b0df90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:13:56.731422 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ffb02-2d78-4191-887d-e9ac95f91a1e None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:56.731744 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ffb02-2d78-4191-887d-e9ac95f91a1e None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:56.731965 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ffb02-2d78-4191-887d-e9ac95f91a1e None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:56.733325 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 162/340] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:13:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:13:56.739801 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f87cad-8952-4979-845f-b0818315826a None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:56.740080 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f87cad-8952-4979-845f-b0818315826a None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:56.740352 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f87cad-8952-4979-845f-b0818315826a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:56.769594 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-a6f87cad-8952-4979-845f-b0818315826a None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:13:56.770843 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a6f87cad-8952-4979-845f-b0818315826a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:13:56.795906 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 179/341] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:13:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:13:56.863408 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 163/342] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:13:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:13:57.044643 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7191573-354a-47b1-8ba8-5aab95b0df90 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:57.129003 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:57.164584 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7191573-354a-47b1-8ba8-5aab95b0df90 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:57.207135 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22221a51-eab2-4a01-9edc-32417a50477b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:57.207795 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22221a51-eab2-4a01-9edc-32417a50477b None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:57.208074 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22221a51-eab2-4a01-9edc-32417a50477b None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:57.208346 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22221a51-eab2-4a01-9edc-32417a50477b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:57.221193 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22221a51-eab2-4a01-9edc-32417a50477b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:13:57.227370 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-22221a51-eab2-4a01-9edc-32417a50477b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:13:57.227370 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:13:57.227370 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:13:57.227370 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:13:57.227370 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:13:57.227370 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:13:57.227370 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:13:57.227370 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:13:57.227370 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:13:57.227370 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:13:57.227370 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:13:57.227370 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:13:57.227370 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:13:57.227370 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:13:57.227370 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:13:57.227370 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:13:57.228962 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:13:57.228962 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:13:57.228962 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:13:57.228962 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:13:57.228962 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:13:57.228962 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:13:57.228962 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:13:57.228962 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:13:57.228962 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:13:57.228962 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:13:57.228962 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:13:57.228962 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:13:57.228962 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:13:57.228962 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:13:57.228962 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:13:57.228962 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:13:57.229884 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:13:57.229884 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:13:57.229884 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:13:57.229884 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:13:57.229884 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:13:57.229884 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:13:57.229884 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:13:57.229884 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:13:57.229884 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:13:57.229884 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:13:57.229884 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:13:57.229884 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:13:57.232615 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 180/343] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:13:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:13:57.235538 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f87cad-8952-4979-845f-b0818315826a None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:57.245719 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22221a51-eab2-4a01-9edc-32417a50477b None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:57.382702 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22221a51-eab2-4a01-9edc-32417a50477b None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:57.404148 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f87cad-8952-4979-845f-b0818315826a None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:57.424990 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:57.435595 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a10ad0-5df7-4bdf-bd0f-62c4089c1a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:57.436481 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a10ad0-5df7-4bdf-bd0f-62c4089c1a42 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:57.436776 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a10ad0-5df7-4bdf-bd0f-62c4089c1a42 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:57.437046 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a10ad0-5df7-4bdf-bd0f-62c4089c1a42 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:57.443260 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:57.450897 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70138a3-e2e5-4f49-a76e-5394d2f53892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:57.451732 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70138a3-e2e5-4f49-a76e-5394d2f53892 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:57.452587 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70138a3-e2e5-4f49-a76e-5394d2f53892 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:57.452953 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70138a3-e2e5-4f49-a76e-5394d2f53892 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:57.453735 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70138a3-e2e5-4f49-a76e-5394d2f53892 None admin] RBAC: Adding query filter params (name=member) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:57.454132 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70138a3-e2e5-4f49-a76e-5394d2f53892 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:57.455889 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70138a3-e2e5-4f49-a76e-5394d2f53892 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:57.456186 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a10ad0-5df7-4bdf-bd0f-62c4089c1a42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:13:57.462310 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-78a10ad0-5df7-4bdf-bd0f-62c4089c1a42 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:13:57.462310 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:13:57.462310 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:13:57.462310 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:13:57.462310 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:13:57.462310 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:13:57.462310 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:13:57.462310 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:13:57.462310 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:13:57.462310 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:13:57.462310 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:13:57.462310 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:13:57.462310 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:13:57.462310 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:13:57.462310 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:13:57.462310 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:13:57.463227 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:13:57.463227 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:13:57.463227 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:13:57.463227 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:13:57.463227 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:13:57.463227 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:13:57.463227 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:13:57.463227 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:13:57.463227 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:13:57.463227 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:13:57.463227 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:13:57.463227 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:13:57.463227 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:13:57.463227 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:13:57.463227 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:13:57.463227 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:13:57.464026 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:13:57.464026 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:13:57.464026 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:13:57.464026 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:13:57.464026 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:13:57.464026 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:13:57.464026 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:13:57.464026 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:13:57.464026 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:13:57.464026 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:13:57.464026 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:13:57.464026 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:13:57.470601 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 164/344] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Aug 29 22:13:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:57.470601 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70138a3-e2e5-4f49-a76e-5394d2f53892 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:57.472190 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 181/345] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:13:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:13:57.473355 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a10ad0-5df7-4bdf-bd0f-62c4089c1a42 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:57.604655 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70138a3-e2e5-4f49-a76e-5394d2f53892 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:57.612300 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a10ad0-5df7-4bdf-bd0f-62c4089c1a42 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:57.644534 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb76ab-1a60-4aa5-b372-834a3e2ac0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:57.645536 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb76ab-1a60-4aa5-b372-834a3e2ac0ed None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:57.646025 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb76ab-1a60-4aa5-b372-834a3e2ac0ed None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:57.646599 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb76ab-1a60-4aa5-b372-834a3e2ac0ed None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:57.655370 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf089a-1ce9-4a46-ac75-4d5b6ec1dfd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:57.656009 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf089a-1ce9-4a46-ac75-4d5b6ec1dfd0 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:57.656288 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf089a-1ce9-4a46-ac75-4d5b6ec1dfd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:57.656582 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf089a-1ce9-4a46-ac75-4d5b6ec1dfd0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:57.659743 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcb76ab-1a60-4aa5-b372-834a3e2ac0ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:13:57.666298 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-fbcb76ab-1a60-4aa5-b372-834a3e2ac0ed None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:13:57.666298 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:13:57.666298 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:13:57.666298 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:13:57.666298 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:13:57.666298 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:13:57.666298 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:13:57.666298 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:13:57.666298 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:13:57.666298 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:13:57.666298 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:13:57.666298 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:13:57.666298 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:13:57.666298 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:13:57.666298 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:13:57.666298 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:13:57.667350 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:13:57.667350 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:13:57.667350 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:13:57.667350 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:13:57.667350 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:13:57.667350 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:13:57.667350 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:13:57.667350 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:13:57.667350 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:13:57.667350 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:13:57.667350 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:13:57.667350 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:13:57.667350 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:13:57.667350 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:13:57.667350 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:13:57.667350 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:13:57.668181 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:13:57.668181 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:13:57.668181 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:13:57.668181 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:13:57.668181 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:13:57.668181 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:13:57.668181 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:13:57.668181 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:13:57.668181 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:13:57.668181 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:13:57.668181 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:13:57.668181 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:13:57.668840 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cf089a-1ce9-4a46-ac75-4d5b6ec1dfd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:13:57.670935 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 165/346] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Aug 29 22:13:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:13:57.671985 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb76ab-1a60-4aa5-b372-834a3e2ac0ed None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:57.676996 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-06cf089a-1ce9-4a46-ac75-4d5b6ec1dfd0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:13:57.676996 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:13:57.676996 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:13:57.676996 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:13:57.676996 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:13:57.676996 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:13:57.676996 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:13:57.676996 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:13:57.676996 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:13:57.676996 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:13:57.676996 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:13:57.676996 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:13:57.676996 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:13:57.676996 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:13:57.676996 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:13:57.676996 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:13:57.677956 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:13:57.677956 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:13:57.677956 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:13:57.677956 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:13:57.677956 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:13:57.677956 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:13:57.677956 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:13:57.677956 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:13:57.677956 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:13:57.677956 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:13:57.677956 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:13:57.677956 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:13:57.677956 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:13:57.677956 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:13:57.677956 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:13:57.677956 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:13:57.679164 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:13:57.679164 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:13:57.679164 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:13:57.679164 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:13:57.679164 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:13:57.679164 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:13:57.679164 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:13:57.679164 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:13:57.679164 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:13:57.679164 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:13:57.679164 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:13:57.679164 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:13:57.679164 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 182/347] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:13:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:13:57.679164 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf089a-1ce9-4a46-ac75-4d5b6ec1dfd0 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:57.740767 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:57.744603 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:57.795696 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb76ab-1a60-4aa5-b372-834a3e2ac0ed None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:57.798212 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf089a-1ce9-4a46-ac75-4d5b6ec1dfd0 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:57.833565 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92720739-baa9-4771-b1bd-5e49c3c86d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:57.834607 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92720739-baa9-4771-b1bd-5e49c3c86d0f None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:57.835086 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92720739-baa9-4771-b1bd-5e49c3c86d0f None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:57.835276 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd9670-0aec-4adc-ae11-e5e234932daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:57.835780 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92720739-baa9-4771-b1bd-5e49c3c86d0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:57.835881 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd9670-0aec-4adc-ae11-e5e234932daa None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:57.836088 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd9670-0aec-4adc-ae11-e5e234932daa None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:57.836360 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd9670-0aec-4adc-ae11-e5e234932daa None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:57.837147 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bd9670-0aec-4adc-ae11-e5e234932daa None admin] RBAC: Adding query filter params (name=reader) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:57.837447 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bd9670-0aec-4adc-ae11-e5e234932daa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:57.838945 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bd9670-0aec-4adc-ae11-e5e234932daa None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:57.848074 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 183/348] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Aug 29 22:13:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:57.848798 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd9670-0aec-4adc-ae11-e5e234932daa None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:57.946333 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92720739-baa9-4771-b1bd-5e49c3c86d0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:57.948178 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92720739-baa9-4771-b1bd-5e49c3c86d0f None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:57.985631 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd9670-0aec-4adc-ae11-e5e234932daa None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:58.008382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:58.015774 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:58.048021 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1513aab2-bafb-4c2a-9ae3-24b814b03bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:58.048683 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513aab2-bafb-4c2a-9ae3-24b814b03bf4 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:58.048967 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513aab2-bafb-4c2a-9ae3-24b814b03bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:58.050040 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513aab2-bafb-4c2a-9ae3-24b814b03bf4 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:58.050040 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1513aab2-bafb-4c2a-9ae3-24b814b03bf4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:58.050275 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1513aab2-bafb-4c2a-9ae3-24b814b03bf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:58.051652 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1513aab2-bafb-4c2a-9ae3-24b814b03bf4 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:58.065437 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 184/349] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Aug 29 22:13:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:58.070653 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1513aab2-bafb-4c2a-9ae3-24b814b03bf4 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:58.085022 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 166/350] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:13:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:13:58.085762 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92720739-baa9-4771-b1bd-5e49c3c86d0f None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:58.205496 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1513aab2-bafb-4c2a-9ae3-24b814b03bf4 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:58.232367 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92720739-baa9-4771-b1bd-5e49c3c86d0f None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:58.246246 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9effb3-faf8-49ab-a715-274ff421b779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:58.247528 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9effb3-faf8-49ab-a715-274ff421b779 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:58.247528 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9effb3-faf8-49ab-a715-274ff421b779 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:58.247528 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9effb3-faf8-49ab-a715-274ff421b779 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:58.248186 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9effb3-faf8-49ab-a715-274ff421b779 None admin] RBAC: Adding query filter params (name=member) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:58.249074 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9effb3-faf8-49ab-a715-274ff421b779 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:58.249957 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9effb3-faf8-49ab-a715-274ff421b779 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:58.259386 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 185/351] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Aug 29 22:13:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:58.260766 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1cb38d-dcd5-4e34-a40e-77e63d624020 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:58.261062 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1cb38d-dcd5-4e34-a40e-77e63d624020 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:58.261340 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1cb38d-dcd5-4e34-a40e-77e63d624020 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:58.263817 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 186/352] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:13:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:13:58.263817 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1cb38d-dcd5-4e34-a40e-77e63d624020 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:58.282968 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f391fa42-06a8-43e2-9e42-e80afb564f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:58.283726 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391fa42-06a8-43e2-9e42-e80afb564f99 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:58.284067 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391fa42-06a8-43e2-9e42-e80afb564f99 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:58.284424 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391fa42-06a8-43e2-9e42-e80afb564f99 None admin] PATH_INFO: `/v3/users/9082451e8ff144a597f4b666fd09efea` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:58.285802 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f391fa42-06a8-43e2-9e42-e80afb564f99 None admin] RBAC: Authorizing `identity:get_user(user_id=9082451e8ff144a597f4b666fd09efea)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:58.287330 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f391fa42-06a8-43e2-9e42-e80afb564f99 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:58.289422 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 167/353] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Aug 29 22:13:58 2022] GET /identity/v3/users/9082451e8ff144a597f4b666fd09efea => generated 293 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:58.289851 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f391fa42-06a8-43e2-9e42-e80afb564f99 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:58.309455 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:58.318216 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:58.393404 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1cb38d-dcd5-4e34-a40e-77e63d624020 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:58.414303 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f391fa42-06a8-43e2-9e42-e80afb564f99 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:58.433884 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0c45b-61e2-4be9-adfc-b2fad5f6e48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:58.434618 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0c45b-61e2-4be9-adfc-b2fad5f6e48e None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:58.434892 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0c45b-61e2-4be9-adfc-b2fad5f6e48e None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:58.435169 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0c45b-61e2-4be9-adfc-b2fad5f6e48e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:58.456720 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c15d8-1366-49b5-8ef7-db01fc118c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:58.457356 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c15d8-1366-49b5-8ef7-db01fc118c65 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:58.457573 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c15d8-1366-49b5-8ef7-db01fc118c65 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:58.457848 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c15d8-1366-49b5-8ef7-db01fc118c65 None admin] PATH_INFO: `/v3/projects/72e0b172f95b4686aa832057c998ddbe` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:58.459363 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4c15d8-1366-49b5-8ef7-db01fc118c65 None admin] RBAC: Authorizing `identity:get_project(project_id=72e0b172f95b4686aa832057c998ddbe)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:58.461047 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4c15d8-1366-49b5-8ef7-db01fc118c65 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:58.463074 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 168/354] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Aug 29 22:13:58 2022] GET /identity/v3/projects/72e0b172f95b4686aa832057c998ddbe => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:58.468301 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c15d8-1366-49b5-8ef7-db01fc118c65 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:58.516346 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b0c45b-61e2-4be9-adfc-b2fad5f6e48e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:58.517912 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b0c45b-61e2-4be9-adfc-b2fad5f6e48e None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:58.563069 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:58.575428 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:58.590285 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c15d8-1366-49b5-8ef7-db01fc118c65 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:58.637352 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 187/355] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:13:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:13:58.638143 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01cd61-b389-4484-8023-6680b397b5b6 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:58.638425 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01cd61-b389-4484-8023-6680b397b5b6 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:58.638695 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01cd61-b389-4484-8023-6680b397b5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:58.643854 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053bf9b-9d50-439a-be55-098fa31036e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:58.644527 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053bf9b-9d50-439a-be55-098fa31036e8 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:58.644815 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053bf9b-9d50-439a-be55-098fa31036e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:58.645091 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053bf9b-9d50-439a-be55-098fa31036e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:58.664860 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-1f01cd61-b389-4484-8023-6680b397b5b6 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:13:58.666637 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-1f01cd61-b389-4484-8023-6680b397b5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:13:58.731348 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c053bf9b-9d50-439a-be55-098fa31036e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:58.733072 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c053bf9b-9d50-439a-be55-098fa31036e8 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:58.750826 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 188/356] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:13:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:13:58.751699 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f01cd61-b389-4484-8023-6680b397b5b6 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:58.836913 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:58.837696 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:58.859708 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 169/357] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:13:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:13:58.860376 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4b92d-5726-4a08-83f2-7c2521f372af None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:58.860376 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4b92d-5726-4a08-83f2-7c2521f372af None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:58.860734 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4b92d-5726-4a08-83f2-7c2521f372af None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:58.862326 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 170/358] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:13:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:13:58.862828 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4b92d-5726-4a08-83f2-7c2521f372af None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:58.890955 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f01cd61-b389-4484-8023-6680b397b5b6 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:58.933609 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb11d23-dbb9-41de-a4a9-6ac04cc95dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:58.934220 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb11d23-dbb9-41de-a4a9-6ac04cc95dac None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:58.934499 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb11d23-dbb9-41de-a4a9-6ac04cc95dac None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:58.934767 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb11d23-dbb9-41de-a4a9-6ac04cc95dac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:58.935627 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb11d23-dbb9-41de-a4a9-6ac04cc95dac None admin] RBAC: Adding query filter params (role.id=750444f301bf44c59183e4c5470a0dc5, user.id=9082451e8ff144a597f4b666fd09efea, scope.system=all) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:58.935934 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb11d23-dbb9-41de-a4a9-6ac04cc95dac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:58.937401 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb11d23-dbb9-41de-a4a9-6ac04cc95dac None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:58.953770 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 189/359] 10.222.0.36 () {56 vars in 1308 bytes} [Mon Aug 29 22:13:58 2022] GET /identity/v3/role_assignments?user.id=9082451e8ff144a597f4b666fd09efea&scope.system=all&role.id=750444f301bf44c59183e4c5470a0dc5 => generated 510 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:58.954607 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb11d23-dbb9-41de-a4a9-6ac04cc95dac None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:58.994860 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4b92d-5726-4a08-83f2-7c2521f372af None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:59.038108 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf91743-6430-4945-8e1d-f7c9caa0e122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:59.038451 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf91743-6430-4945-8e1d-f7c9caa0e122 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:59.038732 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf91743-6430-4945-8e1d-f7c9caa0e122 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:59.039006 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf91743-6430-4945-8e1d-f7c9caa0e122 None admin] PATH_INFO: `/v3/groups/2ef9c744e8974e5486ceaf0f4268bec1` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:59.047406 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf91743-6430-4945-8e1d-f7c9caa0e122 None admin] RBAC: Authorizing `identity:get_group(group_id=2ef9c744e8974e5486ceaf0f4268bec1)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:59.049035 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf91743-6430-4945-8e1d-f7c9caa0e122 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:59.051030 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 171/360] 10.222.0.36 () {56 vars in 1180 bytes} [Mon Aug 29 22:13:58 2022] GET /identity/v3/groups/2ef9c744e8974e5486ceaf0f4268bec1 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:59.051992 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf91743-6430-4945-8e1d-f7c9caa0e122 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:59.097004 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb11d23-dbb9-41de-a4a9-6ac04cc95dac None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:59.121398 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:59.128202 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:59.143236 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235ff4a-440c-4f8f-a9ed-982ffcd6f13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:59.144111 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235ff4a-440c-4f8f-a9ed-982ffcd6f13d None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:59.144561 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235ff4a-440c-4f8f-a9ed-982ffcd6f13d None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:59.144975 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235ff4a-440c-4f8f-a9ed-982ffcd6f13d None admin] PATH_INFO: `/v3/projects/72e0b172f95b4686aa832057c998ddbe` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:59.146294 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8235ff4a-440c-4f8f-a9ed-982ffcd6f13d None admin] RBAC: Authorizing `identity:get_project(project_id=72e0b172f95b4686aa832057c998ddbe)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:59.147756 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8235ff4a-440c-4f8f-a9ed-982ffcd6f13d None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:59.149519 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 190/361] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Aug 29 22:13:58 2022] GET /identity/v3/projects/72e0b172f95b4686aa832057c998ddbe => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:59.151068 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487fc7a6-f420-4cac-9b83-a98c0413e8db None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:59.151353 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487fc7a6-f420-4cac-9b83-a98c0413e8db None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:59.151630 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487fc7a6-f420-4cac-9b83-a98c0413e8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:59.172281 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-487fc7a6-f420-4cac-9b83-a98c0413e8db None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:13:59.173531 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-487fc7a6-f420-4cac-9b83-a98c0413e8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:13:59.182348 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf91743-6430-4945-8e1d-f7c9caa0e122 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:59.225638 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d76e1-a3de-42a7-98ae-915e2fe16854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:59.226281 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d76e1-a3de-42a7-98ae-915e2fe16854 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:59.226560 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d76e1-a3de-42a7-98ae-915e2fe16854 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:59.226835 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d76e1-a3de-42a7-98ae-915e2fe16854 None admin] PATH_INFO: `/v3/projects/e0b257f7f1874d8483a2453331254e1a` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:59.228956 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0d76e1-a3de-42a7-98ae-915e2fe16854 None admin] RBAC: Authorizing `identity:get_project(project_id=e0b257f7f1874d8483a2453331254e1a)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:59.230407 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0d76e1-a3de-42a7-98ae-915e2fe16854 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:59.232049 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 172/362] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Aug 29 22:13:59 2022] GET /identity/v3/projects/e0b257f7f1874d8483a2453331254e1a => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:59.233881 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d76e1-a3de-42a7-98ae-915e2fe16854 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:59.251057 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 191/363] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:13:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:13:59.251950 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487fc7a6-f420-4cac-9b83-a98c0413e8db None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:59.359957 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d76e1-a3de-42a7-98ae-915e2fe16854 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:59.376203 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487fc7a6-f420-4cac-9b83-a98c0413e8db None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:59.390934 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:59.405447 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:59.415793 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d8e04-bf2a-4f6d-be90-8b87e42935ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:59.416518 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d8e04-bf2a-4f6d-be90-8b87e42935ae None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:59.416806 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d8e04-bf2a-4f6d-be90-8b87e42935ae None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:59.417291 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d8e04-bf2a-4f6d-be90-8b87e42935ae None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:59.425542 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bddb9f9-7ffd-4dcc-b7ec-40e016c824d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:59.426159 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bddb9f9-7ffd-4dcc-b7ec-40e016c824d0 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:59.426444 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bddb9f9-7ffd-4dcc-b7ec-40e016c824d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:59.426718 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bddb9f9-7ffd-4dcc-b7ec-40e016c824d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:59.427459 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bddb9f9-7ffd-4dcc-b7ec-40e016c824d0 None admin] RBAC: Adding query filter params (group.id=2ef9c744e8974e5486ceaf0f4268bec1, role.id=c358a37c24fe42bca4a93331f2c99d90, scope.project.id=72e0b172f95b4686aa832057c998ddbe) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:59.427769 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bddb9f9-7ffd-4dcc-b7ec-40e016c824d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:59.432494 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bddb9f9-7ffd-4dcc-b7ec-40e016c824d0 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:59.432625 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247d8e04-bf2a-4f6d-be90-8b87e42935ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:13:59.436627 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-247d8e04-bf2a-4f6d-be90-8b87e42935ae None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:13:59.436627 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:13:59.436627 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:13:59.436627 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:13:59.436627 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:13:59.436627 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:13:59.436627 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:13:59.436627 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:13:59.436627 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:13:59.436627 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:13:59.436627 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:13:59.436627 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:13:59.436627 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:13:59.436627 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:13:59.436627 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:13:59.436627 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:13:59.437520 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:13:59.437520 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:13:59.437520 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:13:59.437520 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:13:59.437520 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:13:59.437520 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:13:59.437520 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:13:59.437520 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:13:59.437520 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:13:59.437520 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:13:59.437520 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:13:59.437520 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:13:59.437520 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:13:59.437520 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:13:59.437520 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:13:59.437520 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:13:59.438720 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:13:59.438720 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:13:59.438720 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:13:59.438720 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:13:59.438720 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:13:59.438720 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:13:59.438720 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:13:59.438720 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:13:59.438720 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:13:59.438720 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:13:59.438720 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:13:59.438720 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:13:59.438720 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 173/364] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Aug 29 22:13:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:13:59.439637 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d8e04-bf2a-4f6d-be90-8b87e42935ae None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:59.440594 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 192/365] 10.222.0.36 () {56 vars in 1376 bytes} [Mon Aug 29 22:13:59 2022] GET /identity/v3/role_assignments?group.id=2ef9c744e8974e5486ceaf0f4268bec1&scope.project.id=72e0b172f95b4686aa832057c998ddbe&role.id=c358a37c24fe42bca4a93331f2c99d90 => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:59.441699 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bddb9f9-7ffd-4dcc-b7ec-40e016c824d0 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:59.553206 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d8e04-bf2a-4f6d-be90-8b87e42935ae None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:59.569676 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bddb9f9-7ffd-4dcc-b7ec-40e016c824d0 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:59.612116 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d702a68-b531-4e98-a95f-82c48b07f519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:59.612807 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d702a68-b531-4e98-a95f-82c48b07f519 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:59.613089 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d702a68-b531-4e98-a95f-82c48b07f519 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:59.613362 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d702a68-b531-4e98-a95f-82c48b07f519 None admin] PATH_INFO: `/v3/groups/2ef9c744e8974e5486ceaf0f4268bec1` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:59.614511 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d702a68-b531-4e98-a95f-82c48b07f519 None admin] RBAC: Authorizing `identity:get_group(group_id=2ef9c744e8974e5486ceaf0f4268bec1)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:59.615110 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c8b38-0cec-40ba-b7c2-bae7d9497e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:59.615769 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c8b38-0cec-40ba-b7c2-bae7d9497e73 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:59.616037 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d702a68-b531-4e98-a95f-82c48b07f519 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:59.616134 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c8b38-0cec-40ba-b7c2-bae7d9497e73 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:59.616308 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c8b38-0cec-40ba-b7c2-bae7d9497e73 None admin] PATH_INFO: `/v3/groups/2ef9c744e8974e5486ceaf0f4268bec1` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:59.617488 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c8b38-0cec-40ba-b7c2-bae7d9497e73 None admin] RBAC: Authorizing `identity:get_group(group_id=2ef9c744e8974e5486ceaf0f4268bec1)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:59.618254 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 174/366] 10.222.0.36 () {56 vars in 1180 bytes} [Mon Aug 29 22:13:59 2022] GET /identity/v3/groups/2ef9c744e8974e5486ceaf0f4268bec1 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:59.619081 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c8b38-0cec-40ba-b7c2-bae7d9497e73 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:59.619274 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d702a68-b531-4e98-a95f-82c48b07f519 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:59.621074 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 193/367] 10.222.0.36 () {56 vars in 1180 bytes} [Mon Aug 29 22:13:59 2022] GET /identity/v3/groups/2ef9c744e8974e5486ceaf0f4268bec1 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:59.621850 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c8b38-0cec-40ba-b7c2-bae7d9497e73 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:59.691805 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:59.697938 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:13:59.762372 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c8b38-0cec-40ba-b7c2-bae7d9497e73 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:59.769842 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d702a68-b531-4e98-a95f-82c48b07f519 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:59.815200 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e873d1-3732-44f5-b272-434db42f8879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:59.816045 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e873d1-3732-44f5-b272-434db42f8879 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:59.816322 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e873d1-3732-44f5-b272-434db42f8879 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:59.816742 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e873d1-3732-44f5-b272-434db42f8879 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:59.822748 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a0cd4-3446-4a47-afa0-2588de265f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:13:59.823854 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a0cd4-3446-4a47-afa0-2588de265f53 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:13:59.824200 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a0cd4-3446-4a47-afa0-2588de265f53 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:13:59.827532 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a0cd4-3446-4a47-afa0-2588de265f53 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:13:59.827532 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a0cd4-3446-4a47-afa0-2588de265f53 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:13:59.827532 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a0cd4-3446-4a47-afa0-2588de265f53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:13:59.827532 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a0cd4-3446-4a47-afa0-2588de265f53 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:13:59.837822 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e873d1-3732-44f5-b272-434db42f8879 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:13:59.842551 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 175/368] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Aug 29 22:13:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:13:59.843640 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-33e873d1-3732-44f5-b272-434db42f8879 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:13:59.843640 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:13:59.843640 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:13:59.843640 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:13:59.843640 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:13:59.843640 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:13:59.843640 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:13:59.843640 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:13:59.843640 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:13:59.843640 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:13:59.843640 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:13:59.843640 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:13:59.843640 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:13:59.843640 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:13:59.843640 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:13:59.843640 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:13:59.844537 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:13:59.844537 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:13:59.844537 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:13:59.844537 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:13:59.844537 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:13:59.844537 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:13:59.844537 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:13:59.844537 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:13:59.844537 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:13:59.844537 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:13:59.844537 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:13:59.844537 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:13:59.844537 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:13:59.844537 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:13:59.844537 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:13:59.844537 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:13:59.845365 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:13:59.845365 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:13:59.845365 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:13:59.845365 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:13:59.845365 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:13:59.845365 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:13:59.845365 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:13:59.845365 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:13:59.845365 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:13:59.845365 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:13:59.845365 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:13:59.845365 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:13:59.845969 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a0cd4-3446-4a47-afa0-2588de265f53 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:59.846037 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 194/369] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Aug 29 22:13:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:13:59.846037 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e873d1-3732-44f5-b272-434db42f8879 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:13:59.984909 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e873d1-3732-44f5-b272-434db42f8879 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:13:59.986361 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a0cd4-3446-4a47-afa0-2588de265f53 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:00.000080 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:00.000444 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:00.027177 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cddec44-bdc1-4214-94b4-d4875da216b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:00.027799 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cddec44-bdc1-4214-94b4-d4875da216b9 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:00.028079 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cddec44-bdc1-4214-94b4-d4875da216b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:00.028346 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cddec44-bdc1-4214-94b4-d4875da216b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:00.029129 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cddec44-bdc1-4214-94b4-d4875da216b9 None admin] RBAC: Adding query filter params (group.id=2ef9c744e8974e5486ceaf0f4268bec1, role.id=8767fe0bd994478fac741fc8c76f649e, scope.project.id=72e0b172f95b4686aa832057c998ddbe) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:00.029441 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cddec44-bdc1-4214-94b4-d4875da216b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:00.029546 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326f5b95-b269-4868-ba64-b3f2f010f571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:00.030135 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f5b95-b269-4868-ba64-b3f2f010f571 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:00.030415 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f5b95-b269-4868-ba64-b3f2f010f571 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:00.030688 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f5b95-b269-4868-ba64-b3f2f010f571 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:00.030905 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cddec44-bdc1-4214-94b4-d4875da216b9 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:00.031424 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326f5b95-b269-4868-ba64-b3f2f010f571 None admin] RBAC: Adding query filter params (group.id=2ef9c744e8974e5486ceaf0f4268bec1, role.id=c358a37c24fe42bca4a93331f2c99d90, scope.project.id=e0b257f7f1874d8483a2453331254e1a) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:00.031734 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326f5b95-b269-4868-ba64-b3f2f010f571 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:00.033199 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326f5b95-b269-4868-ba64-b3f2f010f571 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:00.041193 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 195/370] 10.222.0.36 () {56 vars in 1376 bytes} [Mon Aug 29 22:13:59 2022] GET /identity/v3/role_assignments?group.id=2ef9c744e8974e5486ceaf0f4268bec1&scope.project.id=72e0b172f95b4686aa832057c998ddbe&role.id=8767fe0bd994478fac741fc8c76f649e => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:00.041193 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cddec44-bdc1-4214-94b4-d4875da216b9 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:00.041464 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 176/371] 10.222.0.36 () {56 vars in 1376 bytes} [Mon Aug 29 22:13:59 2022] GET /identity/v3/role_assignments?group.id=2ef9c744e8974e5486ceaf0f4268bec1&scope.project.id=e0b257f7f1874d8483a2453331254e1a&role.id=c358a37c24fe42bca4a93331f2c99d90 => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:00.041464 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326f5b95-b269-4868-ba64-b3f2f010f571 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:00.173813 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326f5b95-b269-4868-ba64-b3f2f010f571 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:00.218259 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368cfa50-82b9-4191-9b80-4ea4b5ced0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:00.218886 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368cfa50-82b9-4191-9b80-4ea4b5ced0c4 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:00.219190 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368cfa50-82b9-4191-9b80-4ea4b5ced0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:00.220047 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368cfa50-82b9-4191-9b80-4ea4b5ced0c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:00.221376 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368cfa50-82b9-4191-9b80-4ea4b5ced0c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:00.221701 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368cfa50-82b9-4191-9b80-4ea4b5ced0c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:00.223538 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368cfa50-82b9-4191-9b80-4ea4b5ced0c4 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:00.235699 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 177/372] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:14:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:00.241454 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368cfa50-82b9-4191-9b80-4ea4b5ced0c4 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:00.253107 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cddec44-bdc1-4214-94b4-d4875da216b9 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:00.299776 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:00.344956 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19abfad-0df0-43d3-99e1-5c19016711a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:00.345592 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19abfad-0df0-43d3-99e1-5c19016711a1 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:00.345873 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19abfad-0df0-43d3-99e1-5c19016711a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:00.346147 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19abfad-0df0-43d3-99e1-5c19016711a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:00.377546 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368cfa50-82b9-4191-9b80-4ea4b5ced0c4 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:00.419616 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a27439-6c84-4fd6-8048-a1d8981c61ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:00.420238 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a27439-6c84-4fd6-8048-a1d8981c61ce None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:00.420544 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a27439-6c84-4fd6-8048-a1d8981c61ce None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:00.420821 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a27439-6c84-4fd6-8048-a1d8981c61ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:00.453927 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:00.503099 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a27439-6c84-4fd6-8048-a1d8981c61ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:00.504978 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a27439-6c84-4fd6-8048-a1d8981c61ce None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:00.515891 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19abfad-0df0-43d3-99e1-5c19016711a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:00.517409 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19abfad-0df0-43d3-99e1-5c19016711a1 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:00.546348 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:00.626754 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 178/373] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:14:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 22:14:00.632946 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a27439-6c84-4fd6-8048-a1d8981c61ce None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:00.699024 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 196/374] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:14:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 661 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:14:00.718454 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19abfad-0df0-43d3-99e1-5c19016711a1 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:00.747583 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a27439-6c84-4fd6-8048-a1d8981c61ce None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:00.788656 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c16563-59d9-4641-a2e5-4ae00ef52bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:00.789350 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c16563-59d9-4641-a2e5-4ae00ef52bf5 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:00.789660 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c16563-59d9-4641-a2e5-4ae00ef52bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:00.790000 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c16563-59d9-4641-a2e5-4ae00ef52bf5 None admin] PATH_INFO: `/v3/projects/174c552d34394032ba6a5f46a315abf1` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:00.791644 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c16563-59d9-4641-a2e5-4ae00ef52bf5 None admin] RBAC: Authorizing `identity:get_project(project_id=174c552d34394032ba6a5f46a315abf1)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:00.793135 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c16563-59d9-4641-a2e5-4ae00ef52bf5 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:00.795099 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 179/375] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Aug 29 22:14:00 2022] GET /identity/v3/projects/174c552d34394032ba6a5f46a315abf1 => generated 344 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:00.800366 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c16563-59d9-4641-a2e5-4ae00ef52bf5 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:00.804764 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:00.840343 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:00.890162 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19abfad-0df0-43d3-99e1-5c19016711a1 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:00.922890 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c16563-59d9-4641-a2e5-4ae00ef52bf5 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:00.957174 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d98a22d-5605-4079-b637-e4f41a614f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:00.957836 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98a22d-5605-4079-b637-e4f41a614f3f None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:00.958174 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d34b4-8b60-4a98-a160-ca2de1ab71f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:00.958404 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98a22d-5605-4079-b637-e4f41a614f3f None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:00.958688 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98a22d-5605-4079-b637-e4f41a614f3f None admin] PATH_INFO: `/v3/projects/e0b257f7f1874d8483a2453331254e1a` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:00.959278 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d34b4-8b60-4a98-a160-ca2de1ab71f7 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:00.959695 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d34b4-8b60-4a98-a160-ca2de1ab71f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:00.959864 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d98a22d-5605-4079-b637-e4f41a614f3f None admin] RBAC: Authorizing `identity:get_project(project_id=e0b257f7f1874d8483a2453331254e1a)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:00.960238 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d34b4-8b60-4a98-a160-ca2de1ab71f7 None admin] PATH_INFO: `/v3/groups/e63b53e0ac294827bdebd7d6b411ea78` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:00.961339 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d98a22d-5605-4079-b637-e4f41a614f3f None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:00.966186 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127d34b4-8b60-4a98-a160-ca2de1ab71f7 None admin] RBAC: Authorizing `identity:get_group(group_id=e63b53e0ac294827bdebd7d6b411ea78)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:00.968096 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 197/376] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Aug 29 22:14:00 2022] GET /identity/v3/projects/e0b257f7f1874d8483a2453331254e1a => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:00.968982 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127d34b4-8b60-4a98-a160-ca2de1ab71f7 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:00.969096 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d98a22d-5605-4079-b637-e4f41a614f3f None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:00.971288 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 180/377] 10.222.0.36 () {56 vars in 1180 bytes} [Mon Aug 29 22:14:00 2022] GET /identity/v3/groups/e63b53e0ac294827bdebd7d6b411ea78 => generated 229 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:14:00.977328 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d34b4-8b60-4a98-a160-ca2de1ab71f7 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:01.105529 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d98a22d-5605-4079-b637-e4f41a614f3f None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:01.108801 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:01.162515 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d34b4-8b60-4a98-a160-ca2de1ab71f7 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:01.178066 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b033b303-d7b0-4cb7-9655-fc78f3a5e230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:01.178722 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b033b303-d7b0-4cb7-9655-fc78f3a5e230 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:01.179006 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b033b303-d7b0-4cb7-9655-fc78f3a5e230 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:01.179279 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b033b303-d7b0-4cb7-9655-fc78f3a5e230 None admin] PATH_INFO: `/v3/groups/2ef9c744e8974e5486ceaf0f4268bec1` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:01.185260 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b033b303-d7b0-4cb7-9655-fc78f3a5e230 None admin] RBAC: Authorizing `identity:get_group(group_id=2ef9c744e8974e5486ceaf0f4268bec1)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:01.187482 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b033b303-d7b0-4cb7-9655-fc78f3a5e230 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:01.189945 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 198/378] 10.222.0.36 () {56 vars in 1180 bytes} [Mon Aug 29 22:14:00 2022] GET /identity/v3/groups/2ef9c744e8974e5486ceaf0f4268bec1 => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:14:01.195556 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b033b303-d7b0-4cb7-9655-fc78f3a5e230 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:01.202367 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca997b9-dc3c-4e55-a200-bfdc32c611cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:01.202993 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca997b9-dc3c-4e55-a200-bfdc32c611cf None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:01.203279 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca997b9-dc3c-4e55-a200-bfdc32c611cf None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:01.203554 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca997b9-dc3c-4e55-a200-bfdc32c611cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:01.204425 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca997b9-dc3c-4e55-a200-bfdc32c611cf None admin] RBAC: Adding query filter params (group.id=e63b53e0ac294827bdebd7d6b411ea78, role.id=ff59a239a50b4bd899a83bf3c3fd1f63, scope.project.id=174c552d34394032ba6a5f46a315abf1) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:01.204784 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca997b9-dc3c-4e55-a200-bfdc32c611cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:01.206237 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca997b9-dc3c-4e55-a200-bfdc32c611cf None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:01.212936 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 181/379] 10.222.0.36 () {56 vars in 1376 bytes} [Mon Aug 29 22:14:00 2022] GET /identity/v3/role_assignments?group.id=e63b53e0ac294827bdebd7d6b411ea78&scope.project.id=174c552d34394032ba6a5f46a315abf1&role.id=ff59a239a50b4bd899a83bf3c3fd1f63 => generated 260 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:01.232965 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:01.317371 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b033b303-d7b0-4cb7-9655-fc78f3a5e230 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:01.356781 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce4d63-5500-48d1-8f3f-befad9289b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:01.357419 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce4d63-5500-48d1-8f3f-befad9289b8a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:01.357700 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce4d63-5500-48d1-8f3f-befad9289b8a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:01.357969 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce4d63-5500-48d1-8f3f-befad9289b8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:01.358729 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce4d63-5500-48d1-8f3f-befad9289b8a None admin] RBAC: Adding query filter params (group.id=2ef9c744e8974e5486ceaf0f4268bec1, role.id=8767fe0bd994478fac741fc8c76f649e, scope.project.id=e0b257f7f1874d8483a2453331254e1a) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:01.359039 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce4d63-5500-48d1-8f3f-befad9289b8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:01.360567 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce4d63-5500-48d1-8f3f-befad9289b8a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:01.369420 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 199/380] 10.222.0.36 () {56 vars in 1376 bytes} [Mon Aug 29 22:14:01 2022] GET /identity/v3/role_assignments?group.id=2ef9c744e8974e5486ceaf0f4268bec1&scope.project.id=e0b257f7f1874d8483a2453331254e1a&role.id=8767fe0bd994478fac741fc8c76f649e => generated 260 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:01.793104 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb68ea6-1eb5-4a07-990d-0b2fe104e912 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:01.793729 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb68ea6-1eb5-4a07-990d-0b2fe104e912 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:01.793729 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb68ea6-1eb5-4a07-990d-0b2fe104e912 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:01.795487 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 182/381] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:14:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:14:01.807847 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950ddca-299e-4c4b-b0a6-9d0d587e9334 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:01.808329 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950ddca-299e-4c4b-b0a6-9d0d587e9334 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:01.808412 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950ddca-299e-4c4b-b0a6-9d0d587e9334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:01.839884 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-6950ddca-299e-4c4b-b0a6-9d0d587e9334 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:14:01.841190 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-6950ddca-299e-4c4b-b0a6-9d0d587e9334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:14:01.954928 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 200/382] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:14:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:14:02.282757 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb68ea6-1eb5-4a07-990d-0b2fe104e912 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:02.411783 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb68ea6-1eb5-4a07-990d-0b2fe104e912 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:02.441397 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:02.446743 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f82100-9c90-4f88-b9d9-f007a74473fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:02.447390 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f82100-9c90-4f88-b9d9-f007a74473fe None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:02.448054 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f82100-9c90-4f88-b9d9-f007a74473fe None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:02.448333 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f82100-9c90-4f88-b9d9-f007a74473fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:02.459322 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f82100-9c90-4f88-b9d9-f007a74473fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:14:02.464426 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-e4f82100-9c90-4f88-b9d9-f007a74473fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:14:02.464426 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:02.464426 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:02.464426 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:02.464426 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:02.464426 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:02.464426 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:02.464426 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:02.464426 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:02.464426 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:02.464426 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:02.464426 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:02.464426 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:14:02.464426 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:14:02.464426 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:14:02.464426 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:14:02.465409 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:14:02.465409 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:14:02.465409 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:14:02.465409 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:14:02.465409 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:02.465409 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:02.465409 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:02.465409 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:02.465409 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:02.465409 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:02.465409 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:02.465409 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:02.465409 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:02.465409 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:02.465409 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:02.465409 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:02.466277 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:02.466277 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:02.466277 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:02.466277 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:02.466277 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:14:02.466277 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:14:02.466277 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:14:02.466277 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:14:02.466277 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:14:02.466277 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:14:02.466277 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:14:02.466277 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:02.466277 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 183/383] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:14:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:02.471767 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6950ddca-299e-4c4b-b0a6-9d0d587e9334 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:02.482376 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:02.522272 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9930e47-eb8a-4a1a-860f-03cf50862bd8 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:02.522621 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9930e47-eb8a-4a1a-860f-03cf50862bd8 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:02.522819 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9930e47-eb8a-4a1a-860f-03cf50862bd8 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:02.524325 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 184/384] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:14:02.530002 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c11852-2084-4966-9f65-f1d0bfffc1ce None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:02.530273 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c11852-2084-4966-9f65-f1d0bfffc1ce None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:02.530586 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c11852-2084-4966-9f65-f1d0bfffc1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:02.560669 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-e7c11852-2084-4966-9f65-f1d0bfffc1ce None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:14:02.561873 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e7c11852-2084-4966-9f65-f1d0bfffc1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:14:02.642611 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6950ddca-299e-4c4b-b0a6-9d0d587e9334 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:02.657551 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 185/385] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:14:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:14:02.717814 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c8a4e-5614-427f-8b6c-9c9ef05e434a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:02.718433 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c8a4e-5614-427f-8b6c-9c9ef05e434a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:02.718710 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c8a4e-5614-427f-8b6c-9c9ef05e434a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:02.718982 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c8a4e-5614-427f-8b6c-9c9ef05e434a None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:02.719658 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2c8a4e-5614-427f-8b6c-9c9ef05e434a None admin] RBAC: Adding query filter params (name=member) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:02.719960 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2c8a4e-5614-427f-8b6c-9c9ef05e434a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:02.721579 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2c8a4e-5614-427f-8b6c-9c9ef05e434a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:02.735922 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 201/386] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Aug 29 22:14:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:14:02.741206 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c11852-2084-4966-9f65-f1d0bfffc1ce None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:02.748272 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab21bb-c75d-4a37-ad83-ac1c4ea834f1 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:02.748589 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab21bb-c75d-4a37-ad83-ac1c4ea834f1 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:02.748865 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab21bb-c75d-4a37-ad83-ac1c4ea834f1 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:02.750438 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 202/387] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:14:02.755449 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a65b1b-4291-4028-90e4-861ede689617 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:02.755738 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a65b1b-4291-4028-90e4-861ede689617 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:02.756016 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a65b1b-4291-4028-90e4-861ede689617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:02.784936 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-97a65b1b-4291-4028-90e4-861ede689617 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:14:02.786142 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-97a65b1b-4291-4028-90e4-861ede689617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:14:02.903005 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:02.909096 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 203/388] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:14:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:14:02.923669 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c11852-2084-4966-9f65-f1d0bfffc1ce None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:02.952857 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:02.960418 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cdbc3d-87fd-46c1-a96e-1d866bba9566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:02.961271 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cdbc3d-87fd-46c1-a96e-1d866bba9566 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:02.961705 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cdbc3d-87fd-46c1-a96e-1d866bba9566 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:02.962083 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cdbc3d-87fd-46c1-a96e-1d866bba9566 None admin] PATH_INFO: `/v3/groups/2ef9c744e8974e5486ceaf0f4268bec1` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:02.963661 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cdbc3d-87fd-46c1-a96e-1d866bba9566 None admin] RBAC: Authorizing `identity:get_group(group_id=2ef9c744e8974e5486ceaf0f4268bec1)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:02.964747 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a65b1b-4291-4028-90e4-861ede689617 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:02.965591 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cdbc3d-87fd-46c1-a96e-1d866bba9566 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:02.968545 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 186/389] 10.222.0.36 () {56 vars in 1180 bytes} [Mon Aug 29 22:14:02 2022] GET /identity/v3/groups/2ef9c744e8974e5486ceaf0f4268bec1 => generated 226 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:02.974218 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cdbc3d-87fd-46c1-a96e-1d866bba9566 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:03.105778 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a65b1b-4291-4028-90e4-861ede689617 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:03.124071 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cdbc3d-87fd-46c1-a96e-1d866bba9566 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:03.140143 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b657d97-3c64-41bf-bedd-a69e9d1ea78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:03.140830 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b657d97-3c64-41bf-bedd-a69e9d1ea78a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:03.141107 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b657d97-3c64-41bf-bedd-a69e9d1ea78a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:03.141379 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b657d97-3c64-41bf-bedd-a69e9d1ea78a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:03.162503 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b657d97-3c64-41bf-bedd-a69e9d1ea78a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:14:03.168382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-8b657d97-3c64-41bf-bedd-a69e9d1ea78a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:14:03.168382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:03.168382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:03.168382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:03.168382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:03.168382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:03.168382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:03.168382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:03.168382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:03.168382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:03.168382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:03.168382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:03.168382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:14:03.168382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:14:03.168382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:14:03.168382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:14:03.169347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:14:03.169347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:14:03.169347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:14:03.169347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:14:03.169347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:03.169347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:03.169347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:03.169347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:03.169347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:03.169347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:03.169347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:03.169347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:03.169347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:03.169347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:03.169347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:03.169347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:03.170135 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:03.170135 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:03.170135 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:03.170135 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:03.170135 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:14:03.170135 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:14:03.170135 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:14:03.170135 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:14:03.170135 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:14:03.170135 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:14:03.170135 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:14:03.170135 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:03.172636 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 204/390] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:14:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:14:03.186654 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b657d97-3c64-41bf-bedd-a69e9d1ea78a None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:03.194582 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9fa581-a30c-4f84-8d86-0c854c9b6355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:03.195450 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9fa581-a30c-4f84-8d86-0c854c9b6355 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:03.195925 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9fa581-a30c-4f84-8d86-0c854c9b6355 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:03.200625 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9fa581-a30c-4f84-8d86-0c854c9b6355 None admin] PATH_INFO: `/v3/projects/72e0b172f95b4686aa832057c998ddbe` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:03.202021 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9fa581-a30c-4f84-8d86-0c854c9b6355 None admin] RBAC: Authorizing `identity:get_project(project_id=72e0b172f95b4686aa832057c998ddbe)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:03.203618 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9fa581-a30c-4f84-8d86-0c854c9b6355 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:03.205414 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 187/391] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Aug 29 22:14:02 2022] GET /identity/v3/projects/72e0b172f95b4686aa832057c998ddbe => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:14:03.217421 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9fa581-a30c-4f84-8d86-0c854c9b6355 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:03.300939 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:03.313216 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:03.353426 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b657d97-3c64-41bf-bedd-a69e9d1ea78a None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:03.357943 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9fa581-a30c-4f84-8d86-0c854c9b6355 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:03.391760 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798e59a8-3e73-4b36-b36a-c48a49335dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:03.392771 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e59a8-3e73-4b36-b36a-c48a49335dae None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:03.392922 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b32dd03-f04b-403b-a569-2efa5df540f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:03.393485 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32dd03-f04b-403b-a569-2efa5df540f3 None admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:03.393729 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e59a8-3e73-4b36-b36a-c48a49335dae None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:03.393835 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32dd03-f04b-403b-a569-2efa5df540f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:03.394016 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32dd03-f04b-403b-a569-2efa5df540f3 None admin] PATH_INFO: `/v3/projects/72e0b172f95b4686aa832057c998ddbe/groups/2ef9c744e8974e5486ceaf0f4268bec1/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:03.394485 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e59a8-3e73-4b36-b36a-c48a49335dae None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:03.395353 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798e59a8-3e73-4b36-b36a-c48a49335dae None admin] RBAC: Adding query filter params (name=member) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:03.395839 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798e59a8-3e73-4b36-b36a-c48a49335dae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:03.395936 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b32dd03-f04b-403b-a569-2efa5df540f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=72e0b172f95b4686aa832057c998ddbe, group_id=2ef9c744e8974e5486ceaf0f4268bec1, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:03.397344 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b32dd03-f04b-403b-a569-2efa5df540f3 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:03.397755 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798e59a8-3e73-4b36-b36a-c48a49335dae None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:03.408294 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 205/392] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Aug 29 22:14:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:14:03.409544 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798e59a8-3e73-4b36-b36a-c48a49335dae None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:03.419273 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 188/393] 10.222.0.36 () {58 vars in 1442 bytes} [Mon Aug 29 22:14:03 2022] PUT /identity/v3/projects/72e0b172f95b4686aa832057c998ddbe/groups/2ef9c744e8974e5486ceaf0f4268bec1/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:14:03.426372 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b32dd03-f04b-403b-a569-2efa5df540f3 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:03.553659 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798e59a8-3e73-4b36-b36a-c48a49335dae None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:03.566805 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b32dd03-f04b-403b-a569-2efa5df540f3 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:03.585228 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:03.586512 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:03.608187 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd43eca-e3ca-4aec-9826-b55cc8d004e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:03.608870 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd43eca-e3ca-4aec-9826-b55cc8d004e0 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:03.609193 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd43eca-e3ca-4aec-9826-b55cc8d004e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:03.609439 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd43eca-e3ca-4aec-9826-b55cc8d004e0 None admin] PATH_INFO: `/v3/groups/2ef9c744e8974e5486ceaf0f4268bec1` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:03.610550 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd43eca-e3ca-4aec-9826-b55cc8d004e0 None admin] RBAC: Authorizing `identity:get_group(group_id=2ef9c744e8974e5486ceaf0f4268bec1)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:03.610844 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd03e4-611a-455a-bdab-db75b8e1a8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:03.611492 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd03e4-611a-455a-bdab-db75b8e1a8a8 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:03.611780 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd03e4-611a-455a-bdab-db75b8e1a8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:03.611985 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd43eca-e3ca-4aec-9826-b55cc8d004e0 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:03.612135 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd03e4-611a-455a-bdab-db75b8e1a8a8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:03.613606 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 189/394] 10.222.0.36 () {56 vars in 1180 bytes} [Mon Aug 29 22:14:03 2022] GET /identity/v3/groups/2ef9c744e8974e5486ceaf0f4268bec1 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:03.614814 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570604d4-7fcb-459f-9047-e9132b1100db None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:03.615169 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570604d4-7fcb-459f-9047-e9132b1100db None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:03.615376 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570604d4-7fcb-459f-9047-e9132b1100db None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:03.620625 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 190/395] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:14:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:14:03.621884 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570604d4-7fcb-459f-9047-e9132b1100db None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:03.638750 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd03e4-611a-455a-bdab-db75b8e1a8a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:14:03.649652 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-adfd03e4-611a-455a-bdab-db75b8e1a8a8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:14:03.649652 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:03.649652 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:03.649652 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:03.649652 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:03.649652 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:03.649652 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:03.649652 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:03.649652 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:03.649652 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:03.649652 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:03.649652 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:03.649652 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:14:03.649652 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:14:03.649652 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:14:03.649652 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:14:03.650716 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:14:03.650716 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:14:03.650716 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:14:03.650716 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:14:03.650716 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:03.650716 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:03.650716 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:03.650716 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:03.650716 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:03.650716 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:03.650716 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:03.650716 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:03.650716 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:03.650716 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:03.650716 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:03.650716 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:03.651517 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:03.651517 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:03.651517 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:03.651517 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:03.651517 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:14:03.651517 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:14:03.651517 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:14:03.651517 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:14:03.651517 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:14:03.651517 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:14:03.651517 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:14:03.651517 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:03.654511 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 206/396] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Aug 29 22:14:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:03.656030 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc897c96-7ffe-4ff3-8d61-78652debcc68 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:03.658235 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc897c96-7ffe-4ff3-8d61-78652debcc68 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:03.658750 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc897c96-7ffe-4ff3-8d61-78652debcc68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:03.733603 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-bc897c96-7ffe-4ff3-8d61-78652debcc68 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:14:03.735142 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-bc897c96-7ffe-4ff3-8d61-78652debcc68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:14:03.770701 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570604d4-7fcb-459f-9047-e9132b1100db None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:03.813866 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcab1519-89e4-4f4b-8a64-00862e6ab356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:03.814695 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab1519-89e4-4f4b-8a64-00862e6ab356 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:03.815037 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab1519-89e4-4f4b-8a64-00862e6ab356 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:03.815350 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab1519-89e4-4f4b-8a64-00862e6ab356 None admin] PATH_INFO: `/v3/projects/e0b257f7f1874d8483a2453331254e1a` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:03.820491 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcab1519-89e4-4f4b-8a64-00862e6ab356 None admin] RBAC: Authorizing `identity:get_project(project_id=e0b257f7f1874d8483a2453331254e1a)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:03.820491 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcab1519-89e4-4f4b-8a64-00862e6ab356 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:03.825675 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 191/397] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Aug 29 22:14:03 2022] GET /identity/v3/projects/e0b257f7f1874d8483a2453331254e1a => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:03.826736 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcab1519-89e4-4f4b-8a64-00862e6ab356 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:03.902657 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:03.928865 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 207/398] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:14:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:14:03.930681 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc897c96-7ffe-4ff3-8d61-78652debcc68 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:03.955169 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcab1519-89e4-4f4b-8a64-00862e6ab356 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:04.027700 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a61cd0-2873-4c12-a513-1ea400e9b376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:04.032471 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a61cd0-2873-4c12-a513-1ea400e9b376 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:04.032471 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a61cd0-2873-4c12-a513-1ea400e9b376 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:04.032471 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a61cd0-2873-4c12-a513-1ea400e9b376 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:04.032471 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a61cd0-2873-4c12-a513-1ea400e9b376 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:04.032471 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a61cd0-2873-4c12-a513-1ea400e9b376 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:04.032471 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a61cd0-2873-4c12-a513-1ea400e9b376 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:04.054879 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 192/399] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Aug 29 22:14:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:04.056958 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb1638-8ee3-48b4-bba9-92447807dc21 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:04.057454 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb1638-8ee3-48b4-bba9-92447807dc21 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:04.057914 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb1638-8ee3-48b4-bba9-92447807dc21 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:04.060632 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 193/400] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:14:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:14:04.061956 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb1638-8ee3-48b4-bba9-92447807dc21 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:04.109655 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc897c96-7ffe-4ff3-8d61-78652debcc68 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:04.126334 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:04.151986 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c4747-24cf-4896-b2db-72ccbe3d6cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:04.153016 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c4747-24cf-4896-b2db-72ccbe3d6cc5 None admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:04.153442 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c4747-24cf-4896-b2db-72ccbe3d6cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:04.153847 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c4747-24cf-4896-b2db-72ccbe3d6cc5 None admin] PATH_INFO: `/v3/projects/e0b257f7f1874d8483a2453331254e1a/groups/2ef9c744e8974e5486ceaf0f4268bec1/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:04.155945 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c4747-24cf-4896-b2db-72ccbe3d6cc5 None admin] RBAC: Authorizing `identity:create_grant(project_id=e0b257f7f1874d8483a2453331254e1a, group_id=2ef9c744e8974e5486ceaf0f4268bec1, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:04.157598 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c4747-24cf-4896-b2db-72ccbe3d6cc5 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:04.175008 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 208/401] 10.222.0.36 () {58 vars in 1442 bytes} [Mon Aug 29 22:14:03 2022] PUT /identity/v3/projects/e0b257f7f1874d8483a2453331254e1a/groups/2ef9c744e8974e5486ceaf0f4268bec1/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:14:04.177653 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e71c5-172d-4839-96f7-adb3f61dc09e None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:04.178129 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e71c5-172d-4839-96f7-adb3f61dc09e None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:04.178869 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e71c5-172d-4839-96f7-adb3f61dc09e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:04.207783 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb1638-8ee3-48b4-bba9-92447807dc21 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:04.226604 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-f18e71c5-172d-4839-96f7-adb3f61dc09e None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:14:04.228059 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f18e71c5-172d-4839-96f7-adb3f61dc09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:14:04.247856 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:04.280156 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87bf10f-6752-47d2-ab22-e11531583eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:04.281552 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87bf10f-6752-47d2-ab22-e11531583eb3 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:04.282092 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87bf10f-6752-47d2-ab22-e11531583eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:04.282639 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87bf10f-6752-47d2-ab22-e11531583eb3 None admin] PATH_INFO: `/v3/groups/2ef9c744e8974e5486ceaf0f4268bec1` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:04.284261 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87bf10f-6752-47d2-ab22-e11531583eb3 None admin] RBAC: Authorizing `identity:get_group(group_id=2ef9c744e8974e5486ceaf0f4268bec1)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:04.286930 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87bf10f-6752-47d2-ab22-e11531583eb3 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:04.289851 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 194/402] 10.222.0.36 () {56 vars in 1180 bytes} [Mon Aug 29 22:14:04 2022] GET /identity/v3/groups/2ef9c744e8974e5486ceaf0f4268bec1 => generated 226 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:04.291445 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87bf10f-6752-47d2-ab22-e11531583eb3 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:04.324417 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 209/403] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:14:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:14:04.325456 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e71c5-172d-4839-96f7-adb3f61dc09e None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:04.453997 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87bf10f-6752-47d2-ab22-e11531583eb3 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:04.469872 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e71c5-172d-4839-96f7-adb3f61dc09e None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:04.471874 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:04.503673 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a307c-5da0-47dd-b7a0-88b0c88cfede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:04.504858 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a307c-5da0-47dd-b7a0-88b0c88cfede None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:04.505155 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a307c-5da0-47dd-b7a0-88b0c88cfede None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:04.505485 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a307c-5da0-47dd-b7a0-88b0c88cfede None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:04.519045 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792a307c-5da0-47dd-b7a0-88b0c88cfede None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:14:04.526233 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-792a307c-5da0-47dd-b7a0-88b0c88cfede None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:14:04.526233 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:04.526233 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:04.526233 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:04.526233 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:04.526233 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:04.526233 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:04.526233 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:04.526233 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:04.526233 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:04.526233 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:04.526233 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:04.526233 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:14:04.526233 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:14:04.526233 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:14:04.526233 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:14:04.527207 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:14:04.527207 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:14:04.527207 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:14:04.527207 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:14:04.527207 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:04.527207 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:04.527207 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:04.527207 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:04.527207 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:04.527207 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:04.527207 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:04.527207 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:04.527207 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:04.527207 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:04.527207 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:04.527207 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:04.528008 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:04.528008 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:04.528008 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:04.528008 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:04.528008 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:14:04.528008 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:14:04.528008 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:14:04.528008 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:14:04.528008 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:14:04.528008 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:14:04.528008 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:14:04.528008 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:04.528008 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 195/404] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Aug 29 22:14:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:04.544245 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a307c-5da0-47dd-b7a0-88b0c88cfede None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:04.547627 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a912b05-2f81-4044-9b68-8b4320a3420c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:04.548564 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a912b05-2f81-4044-9b68-8b4320a3420c None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:04.549066 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a912b05-2f81-4044-9b68-8b4320a3420c None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:04.549541 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a912b05-2f81-4044-9b68-8b4320a3420c None admin] PATH_INFO: `/v3/projects/72e0b172f95b4686aa832057c998ddbe` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:04.550934 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a912b05-2f81-4044-9b68-8b4320a3420c None admin] RBAC: Authorizing `identity:get_project(project_id=72e0b172f95b4686aa832057c998ddbe)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:04.552612 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a912b05-2f81-4044-9b68-8b4320a3420c None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:04.554783 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 210/405] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Aug 29 22:14:04 2022] GET /identity/v3/projects/72e0b172f95b4686aa832057c998ddbe => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:04.561465 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a912b05-2f81-4044-9b68-8b4320a3420c None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:04.600690 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:04.661931 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a307c-5da0-47dd-b7a0-88b0c88cfede None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:04.669514 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a912b05-2f81-4044-9b68-8b4320a3420c None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:04.700543 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e47c6d-0e04-48ed-9579-929aeed65319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:04.701167 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e47c6d-0e04-48ed-9579-929aeed65319 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:04.701453 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e47c6d-0e04-48ed-9579-929aeed65319 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:04.701733 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e47c6d-0e04-48ed-9579-929aeed65319 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:04.702418 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e47c6d-0e04-48ed-9579-929aeed65319 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:04.703692 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e47c6d-0e04-48ed-9579-929aeed65319 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:04.704867 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e47c6d-0e04-48ed-9579-929aeed65319 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:04.714635 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 196/406] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:14:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:04.716026 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5eb98f-8cae-4b15-8196-0c30179e0ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:04.720703 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5eb98f-8cae-4b15-8196-0c30179e0ff0 None admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:04.720703 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5eb98f-8cae-4b15-8196-0c30179e0ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:04.720703 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5eb98f-8cae-4b15-8196-0c30179e0ff0 None admin] PATH_INFO: `/v3/projects/72e0b172f95b4686aa832057c998ddbe/groups/2ef9c744e8974e5486ceaf0f4268bec1/roles/8767fe0bd994478fac741fc8c76f649e` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:04.723882 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5eb98f-8cae-4b15-8196-0c30179e0ff0 None admin] RBAC: Authorizing `identity:create_grant(project_id=72e0b172f95b4686aa832057c998ddbe, group_id=2ef9c744e8974e5486ceaf0f4268bec1, role_id=8767fe0bd994478fac741fc8c76f649e)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:04.724870 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e47c6d-0e04-48ed-9579-929aeed65319 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:04.725372 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5eb98f-8cae-4b15-8196-0c30179e0ff0 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:04.746601 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 211/407] 10.222.0.36 () {58 vars in 1442 bytes} [Mon Aug 29 22:14:04 2022] PUT /identity/v3/projects/72e0b172f95b4686aa832057c998ddbe/groups/2ef9c744e8974e5486ceaf0f4268bec1/roles/8767fe0bd994478fac741fc8c76f649e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:14:04.748099 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5eb98f-8cae-4b15-8196-0c30179e0ff0 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:04.791236 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:04.849021 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e47c6d-0e04-48ed-9579-929aeed65319 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:04.858558 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:04.893063 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5eb98f-8cae-4b15-8196-0c30179e0ff0 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:04.897880 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf394a-38cd-4136-8674-6b20bf69136b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:04.898598 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf394a-38cd-4136-8674-6b20bf69136b None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:04.898892 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf394a-38cd-4136-8674-6b20bf69136b None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:04.899217 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf394a-38cd-4136-8674-6b20bf69136b None admin] PATH_INFO: `/v3/groups/e63b53e0ac294827bdebd7d6b411ea78` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:04.900737 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bf394a-38cd-4136-8674-6b20bf69136b None admin] RBAC: Authorizing `identity:get_group(group_id=e63b53e0ac294827bdebd7d6b411ea78)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:04.902194 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bf394a-38cd-4136-8674-6b20bf69136b None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:04.904088 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 197/408] 10.222.0.36 () {56 vars in 1180 bytes} [Mon Aug 29 22:14:04 2022] GET /identity/v3/groups/e63b53e0ac294827bdebd7d6b411ea78 => generated 229 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:04.909901 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf394a-38cd-4136-8674-6b20bf69136b None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:04.946032 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d838323-b6e7-4c54-a4b7-6cf1cfdec464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:04.947678 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d838323-b6e7-4c54-a4b7-6cf1cfdec464 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:04.948111 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d838323-b6e7-4c54-a4b7-6cf1cfdec464 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:04.948594 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d838323-b6e7-4c54-a4b7-6cf1cfdec464 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:04.971987 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d838323-b6e7-4c54-a4b7-6cf1cfdec464 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:14:04.982832 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-3d838323-b6e7-4c54-a4b7-6cf1cfdec464 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:14:04.982832 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:04.982832 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:04.982832 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:04.982832 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:04.982832 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:04.982832 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:04.982832 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:04.982832 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:04.982832 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:04.982832 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:04.982832 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:04.982832 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:14:04.982832 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:14:04.982832 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:14:04.982832 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:14:04.984040 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:14:04.984040 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:14:04.984040 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:14:04.984040 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:14:04.984040 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:04.984040 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:04.984040 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:04.984040 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:04.984040 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:04.984040 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:04.984040 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:04.984040 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:04.984040 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:04.984040 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:04.984040 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:04.984040 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:04.985135 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:04.985135 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:04.985135 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:04.985135 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:04.985135 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:14:04.985135 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:14:04.985135 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:14:04.985135 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:14:04.985135 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:14:04.985135 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:14:04.985135 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:14:04.985135 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:04.993164 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 212/409] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Aug 29 22:14:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:05.005892 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d838323-b6e7-4c54-a4b7-6cf1cfdec464 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:05.075581 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf394a-38cd-4136-8674-6b20bf69136b None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:05.116511 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:05.119961 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456d6dc0-e653-45c9-82f9-2368cd90265a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:05.120342 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d6dc0-e653-45c9-82f9-2368cd90265a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:05.120704 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d6dc0-e653-45c9-82f9-2368cd90265a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:05.120973 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d6dc0-e653-45c9-82f9-2368cd90265a None admin] PATH_INFO: `/v3/projects/174c552d34394032ba6a5f46a315abf1` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:05.122969 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456d6dc0-e653-45c9-82f9-2368cd90265a None admin] RBAC: Authorizing `identity:get_project(project_id=174c552d34394032ba6a5f46a315abf1)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:05.124412 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456d6dc0-e653-45c9-82f9-2368cd90265a None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:05.130659 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 198/410] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Aug 29 22:14:04 2022] GET /identity/v3/projects/174c552d34394032ba6a5f46a315abf1 => generated 344 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:05.138251 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d838323-b6e7-4c54-a4b7-6cf1cfdec464 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:05.154265 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456d6dc0-e653-45c9-82f9-2368cd90265a None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:05.200477 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ed1247-c640-4441-8c4d-5eea475f1dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:05.201503 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed1247-c640-4441-8c4d-5eea475f1dc4 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:05.201982 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed1247-c640-4441-8c4d-5eea475f1dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:05.202469 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed1247-c640-4441-8c4d-5eea475f1dc4 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:05.203405 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ed1247-c640-4441-8c4d-5eea475f1dc4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:05.203976 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ed1247-c640-4441-8c4d-5eea475f1dc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:05.205757 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ed1247-c640-4441-8c4d-5eea475f1dc4 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:05.213820 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:05.228495 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 213/411] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Aug 29 22:14:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:05.241676 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ed1247-c640-4441-8c4d-5eea475f1dc4 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:05.287126 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456d6dc0-e653-45c9-82f9-2368cd90265a None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:05.331079 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a5413-d1e0-462f-bbff-0ba78b4aeef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:05.333325 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a5413-d1e0-462f-bbff-0ba78b4aeef0 None admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:05.333609 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a5413-d1e0-462f-bbff-0ba78b4aeef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:05.333883 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a5413-d1e0-462f-bbff-0ba78b4aeef0 None admin] PATH_INFO: `/v3/projects/174c552d34394032ba6a5f46a315abf1/groups/e63b53e0ac294827bdebd7d6b411ea78/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:05.338435 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805a5413-d1e0-462f-bbff-0ba78b4aeef0 None admin] RBAC: Authorizing `identity:create_grant(project_id=174c552d34394032ba6a5f46a315abf1, group_id=e63b53e0ac294827bdebd7d6b411ea78, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:05.339902 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805a5413-d1e0-462f-bbff-0ba78b4aeef0 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:05.360963 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 199/412] 10.222.0.36 () {58 vars in 1442 bytes} [Mon Aug 29 22:14:05 2022] PUT /identity/v3/projects/174c552d34394032ba6a5f46a315abf1/groups/e63b53e0ac294827bdebd7d6b411ea78/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:14:05.417214 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ed1247-c640-4441-8c4d-5eea475f1dc4 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:05.470517 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d149d7-eae9-4f3f-ac5d-5cb544a97441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:05.471182 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d149d7-eae9-4f3f-ac5d-5cb544a97441 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:05.471464 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d149d7-eae9-4f3f-ac5d-5cb544a97441 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:05.471790 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d149d7-eae9-4f3f-ac5d-5cb544a97441 None admin] PATH_INFO: `/v3/groups/2ef9c744e8974e5486ceaf0f4268bec1` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:05.473017 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d149d7-eae9-4f3f-ac5d-5cb544a97441 None admin] RBAC: Authorizing `identity:get_group(group_id=2ef9c744e8974e5486ceaf0f4268bec1)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:05.474545 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d149d7-eae9-4f3f-ac5d-5cb544a97441 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:05.476674 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 214/413] 10.222.0.36 () {56 vars in 1180 bytes} [Mon Aug 29 22:14:05 2022] GET /identity/v3/groups/2ef9c744e8974e5486ceaf0f4268bec1 => generated 226 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:14:05.483839 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a5413-d1e0-462f-bbff-0ba78b4aeef0 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:05.574263 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24832294-42ab-4dfa-abfe-a2bfd145a3ad None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:05.574615 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24832294-42ab-4dfa-abfe-a2bfd145a3ad None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:05.574895 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24832294-42ab-4dfa-abfe-a2bfd145a3ad None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:05.576290 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 215/414] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:14:05.581765 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f912285-be01-4dbf-b46a-7b844455027f None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:05.582031 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f912285-be01-4dbf-b46a-7b844455027f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:05.583080 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f912285-be01-4dbf-b46a-7b844455027f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:05.608979 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a5413-d1e0-462f-bbff-0ba78b4aeef0 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:05.610701 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:05.621586 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-8f912285-be01-4dbf-b46a-7b844455027f None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:14:05.622878 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-8f912285-be01-4dbf-b46a-7b844455027f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:14:05.654783 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:05.670337 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2b512-096c-4e9d-9ea9-48e0a55df8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:05.670914 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2b512-096c-4e9d-9ea9-48e0a55df8d4 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:05.671193 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2b512-096c-4e9d-9ea9-48e0a55df8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:05.671461 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2b512-096c-4e9d-9ea9-48e0a55df8d4 None admin] PATH_INFO: `/v3/projects/e0b257f7f1874d8483a2453331254e1a` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:05.672634 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b2b512-096c-4e9d-9ea9-48e0a55df8d4 None admin] RBAC: Authorizing `identity:get_project(project_id=e0b257f7f1874d8483a2453331254e1a)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:05.674766 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b2b512-096c-4e9d-9ea9-48e0a55df8d4 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:05.676586 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 200/415] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Aug 29 22:14:05 2022] GET /identity/v3/projects/e0b257f7f1874d8483a2453331254e1a => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:05.682968 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2b512-096c-4e9d-9ea9-48e0a55df8d4 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:05.752562 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 216/416] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:14:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:14:05.821692 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2b512-096c-4e9d-9ea9-48e0a55df8d4 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:05.864038 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb32e9-1a4f-4fc1-b74d-43103e7891bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:05.864754 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb32e9-1a4f-4fc1-b74d-43103e7891bb None admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:05.865080 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb32e9-1a4f-4fc1-b74d-43103e7891bb None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:05.865352 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb32e9-1a4f-4fc1-b74d-43103e7891bb None admin] PATH_INFO: `/v3/projects/e0b257f7f1874d8483a2453331254e1a/groups/2ef9c744e8974e5486ceaf0f4268bec1/roles/8767fe0bd994478fac741fc8c76f649e` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:05.873207 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb32e9-1a4f-4fc1-b74d-43103e7891bb None admin] RBAC: Authorizing `identity:create_grant(project_id=e0b257f7f1874d8483a2453331254e1a, group_id=2ef9c744e8974e5486ceaf0f4268bec1, role_id=8767fe0bd994478fac741fc8c76f649e)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:05.874720 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb32e9-1a4f-4fc1-b74d-43103e7891bb None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:05.896191 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 201/417] 10.222.0.36 () {58 vars in 1442 bytes} [Mon Aug 29 22:14:05 2022] PUT /identity/v3/projects/e0b257f7f1874d8483a2453331254e1a/groups/2ef9c744e8974e5486ceaf0f4268bec1/roles/8767fe0bd994478fac741fc8c76f649e => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:14:06.094614 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f912285-be01-4dbf-b46a-7b844455027f None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:06.201618 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f912285-be01-4dbf-b46a-7b844455027f None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:06.238496 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322411b-8278-4a99-a16b-b54992d133ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:06.239142 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322411b-8278-4a99-a16b-b54992d133ac None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:06.239419 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322411b-8278-4a99-a16b-b54992d133ac None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:06.239690 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322411b-8278-4a99-a16b-b54992d133ac None admin] PATH_INFO: `/v3/roles/member` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:06.250646 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1322411b-8278-4a99-a16b-b54992d133ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:14:06.255483 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-1322411b-8278-4a99-a16b-b54992d133ac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:14:06.255483 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:06.255483 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:06.255483 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:06.255483 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:06.255483 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:06.255483 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:06.255483 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:06.255483 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:06.255483 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:06.255483 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:06.255483 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:06.255483 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:14:06.255483 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:14:06.255483 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:14:06.255483 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:14:06.256403 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:14:06.256403 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:14:06.256403 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:14:06.256403 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:14:06.256403 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:06.256403 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:06.256403 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:06.256403 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:06.256403 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:06.256403 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:06.256403 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:06.256403 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:06.256403 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:06.256403 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:06.256403 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:06.256403 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:06.257282 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:06.257282 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:06.257282 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:06.257282 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:06.257282 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:14:06.257282 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:14:06.257282 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:14:06.257282 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:14:06.257282 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:14:06.257282 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:14:06.257282 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:14:06.257282 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:06.257282 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 217/418] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:14:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:06.265047 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb32e9-1a4f-4fc1-b74d-43103e7891bb None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:06.309132 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:06.392243 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb32e9-1a4f-4fc1-b74d-43103e7891bb None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:06.437204 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a853a9-7242-4aea-89b5-1ca1b9c699ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:06.437843 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a853a9-7242-4aea-89b5-1ca1b9c699ec None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:06.438116 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a853a9-7242-4aea-89b5-1ca1b9c699ec None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:06.438382 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a853a9-7242-4aea-89b5-1ca1b9c699ec None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:06.439065 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a853a9-7242-4aea-89b5-1ca1b9c699ec None admin] RBAC: Adding query filter params (name=member) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:06.439365 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a853a9-7242-4aea-89b5-1ca1b9c699ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:06.440770 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a853a9-7242-4aea-89b5-1ca1b9c699ec None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:06.451065 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 202/419] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Aug 29 22:14:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:06.456661 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322411b-8278-4a99-a16b-b54992d133ac None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:06.481475 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:06.494007 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134822d9-17cf-4a52-b083-a06d4b212dec None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:06.494345 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134822d9-17cf-4a52-b083-a06d4b212dec None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:06.494545 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134822d9-17cf-4a52-b083-a06d4b212dec None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:06.496290 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 203/420] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:14:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:14:06.501303 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444e1b9-c117-4baa-9995-29f7583e8cf1 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:06.501589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444e1b9-c117-4baa-9995-29f7583e8cf1 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:06.501868 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444e1b9-c117-4baa-9995-29f7583e8cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:06.545519 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-7444e1b9-c117-4baa-9995-29f7583e8cf1 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:14:06.546736 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-7444e1b9-c117-4baa-9995-29f7583e8cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:14:06.600481 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322411b-8278-4a99-a16b-b54992d133ac None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:06.657818 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc4936c-60c5-405c-b6f5-470a87f44d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:06.659069 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4936c-60c5-405c-b6f5-470a87f44d95 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:06.659370 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4936c-60c5-405c-b6f5-470a87f44d95 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:06.659645 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4936c-60c5-405c-b6f5-470a87f44d95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:06.664988 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 204/421] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:14:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:14:06.758542 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc4936c-60c5-405c-b6f5-470a87f44d95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:06.760026 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc4936c-60c5-405c-b6f5-470a87f44d95 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:06.771501 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:06.861948 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 218/422] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:14:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:14:06.867681 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7444e1b9-c117-4baa-9995-29f7583e8cf1 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:06.893058 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:06.969937 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7444e1b9-c117-4baa-9995-29f7583e8cf1 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:07.006296 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468abf6f-422e-4a7f-b846-5cddf97a89b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:07.006942 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468abf6f-422e-4a7f-b846-5cddf97a89b9 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:07.007224 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468abf6f-422e-4a7f-b846-5cddf97a89b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:07.007496 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468abf6f-422e-4a7f-b846-5cddf97a89b9 None admin] PATH_INFO: `/v3/projects/72e0b172f95b4686aa832057c998ddbe` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:07.008763 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468abf6f-422e-4a7f-b846-5cddf97a89b9 None admin] RBAC: Authorizing `identity:get_project(project_id=72e0b172f95b4686aa832057c998ddbe)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:07.010352 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468abf6f-422e-4a7f-b846-5cddf97a89b9 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:07.012428 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 205/423] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Aug 29 22:14:06 2022] GET /identity/v3/projects/72e0b172f95b4686aa832057c998ddbe => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:14:07.018007 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc4936c-60c5-405c-b6f5-470a87f44d95 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:07.126223 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468abf6f-422e-4a7f-b846-5cddf97a89b9 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:07.183641 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc4936c-60c5-405c-b6f5-470a87f44d95 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:07.205144 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:07.249903 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bdb197-380e-4dfe-8bae-752a345acc53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:07.250451 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bdb197-380e-4dfe-8bae-752a345acc53 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:07.250722 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bdb197-380e-4dfe-8bae-752a345acc53 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:07.250987 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bdb197-380e-4dfe-8bae-752a345acc53 None admin] PATH_INFO: `/v3/groups/2ef9c744e8974e5486ceaf0f4268bec1` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:07.252328 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bdb197-380e-4dfe-8bae-752a345acc53 None admin] RBAC: Authorizing `identity:get_group(group_id=2ef9c744e8974e5486ceaf0f4268bec1)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:07.253795 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bdb197-380e-4dfe-8bae-752a345acc53 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:07.258496 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 219/424] 10.222.0.36 () {56 vars in 1180 bytes} [Mon Aug 29 22:14:07 2022] GET /identity/v3/groups/2ef9c744e8974e5486ceaf0f4268bec1 => generated 226 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:07.266189 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bdb197-380e-4dfe-8bae-752a345acc53 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:07.286995 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:07.299825 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468abf6f-422e-4a7f-b846-5cddf97a89b9 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:07.365246 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d7788-3372-4eb7-98ef-f56e533a9180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:07.365887 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d7788-3372-4eb7-98ef-f56e533a9180 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:07.366168 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d7788-3372-4eb7-98ef-f56e533a9180 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:07.366440 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d7788-3372-4eb7-98ef-f56e533a9180 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:07.397412 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2d7788-3372-4eb7-98ef-f56e533a9180 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:14:07.402643 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-5f2d7788-3372-4eb7-98ef-f56e533a9180 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:14:07.402643 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:07.402643 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:07.402643 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:07.402643 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:07.402643 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:07.402643 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:07.402643 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:07.402643 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:07.402643 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:07.402643 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:07.402643 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:07.402643 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:14:07.402643 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:14:07.402643 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:14:07.402643 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:14:07.403538 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:14:07.403538 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:14:07.403538 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:14:07.403538 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:14:07.403538 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:07.403538 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:07.403538 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:07.403538 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:07.403538 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:07.403538 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:07.403538 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:07.403538 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:07.403538 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:07.403538 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:07.403538 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:07.403538 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:07.404831 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:07.404831 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:07.404831 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:07.404831 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:07.404831 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:14:07.404831 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:14:07.404831 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:14:07.404831 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:14:07.404831 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:14:07.404831 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:14:07.404831 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:14:07.404831 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:07.404831 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 206/425] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:14:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:14:07.411370 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d7788-3372-4eb7-98ef-f56e533a9180 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:07.429875 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bdb197-380e-4dfe-8bae-752a345acc53 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:07.465416 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36629786-27b1-4cc9-99a8-b96cd50c7255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:07.466029 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36629786-27b1-4cc9-99a8-b96cd50c7255 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:07.466307 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36629786-27b1-4cc9-99a8-b96cd50c7255 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:07.466575 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36629786-27b1-4cc9-99a8-b96cd50c7255 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:07.467310 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36629786-27b1-4cc9-99a8-b96cd50c7255 None admin] RBAC: Adding query filter params (group.id=2ef9c744e8974e5486ceaf0f4268bec1, role.id=c358a37c24fe42bca4a93331f2c99d90, scope.project.id=72e0b172f95b4686aa832057c998ddbe) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:07.467616 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36629786-27b1-4cc9-99a8-b96cd50c7255 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:07.469110 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36629786-27b1-4cc9-99a8-b96cd50c7255 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:07.475712 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 220/426] 10.222.0.36 () {56 vars in 1376 bytes} [Mon Aug 29 22:14:07 2022] GET /identity/v3/role_assignments?group.id=2ef9c744e8974e5486ceaf0f4268bec1&scope.project.id=72e0b172f95b4686aa832057c998ddbe&role.id=c358a37c24fe42bca4a93331f2c99d90 => generated 611 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:07.534266 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b3de8-eb0a-4cca-92e4-8ff0ef63d4ad None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:07.534558 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b3de8-eb0a-4cca-92e4-8ff0ef63d4ad None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:07.534745 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b3de8-eb0a-4cca-92e4-8ff0ef63d4ad None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:07.536347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 221/427] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:14:07.542180 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ae6bf-5b16-4315-b547-2c2ce4397d16 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:07.542464 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ae6bf-5b16-4315-b547-2c2ce4397d16 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:07.542740 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ae6bf-5b16-4315-b547-2c2ce4397d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:07.580052 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-269ae6bf-5b16-4315-b547-2c2ce4397d16 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:14:07.581912 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-269ae6bf-5b16-4315-b547-2c2ce4397d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:14:07.588275 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d7788-3372-4eb7-98ef-f56e533a9180 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:07.626919 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:07.646597 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb1d05d-8ea5-4f0f-845b-15626c5917ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:07.647220 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1d05d-8ea5-4f0f-845b-15626c5917ae None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:07.647502 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1d05d-8ea5-4f0f-845b-15626c5917ae None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:07.647837 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1d05d-8ea5-4f0f-845b-15626c5917ae None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:07.648431 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb1d05d-8ea5-4f0f-845b-15626c5917ae None admin] RBAC: Adding query filter params (name=member) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:07.648767 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb1d05d-8ea5-4f0f-845b-15626c5917ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:07.650180 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb1d05d-8ea5-4f0f-845b-15626c5917ae None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:07.664718 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 207/428] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Aug 29 22:14:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:14:07.667675 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb1d05d-8ea5-4f0f-845b-15626c5917ae None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:07.671127 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 222/429] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:14:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:14:07.687665 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:07.781084 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb1d05d-8ea5-4f0f-845b-15626c5917ae None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:07.793221 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd4499-6ae5-4b05-8840-7f5ca8963d98 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:07.794208 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd4499-6ae5-4b05-8840-7f5ca8963d98 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:07.794936 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd4499-6ae5-4b05-8840-7f5ca8963d98 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:07.800473 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 223/430] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:14:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:14:07.806120 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d5085-c1a7-4894-a83b-ed62f7992bf3 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:07.806732 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d5085-c1a7-4894-a83b-ed62f7992bf3 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:07.807216 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d5085-c1a7-4894-a83b-ed62f7992bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:07.836050 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-e02d5085-c1a7-4894-a83b-ed62f7992bf3 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:14:07.837220 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11bc859-04e6-4d91-a9cd-2688bb86ab2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:07.837430 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-e02d5085-c1a7-4894-a83b-ed62f7992bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:14:07.838562 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11bc859-04e6-4d91-a9cd-2688bb86ab2d None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:07.839050 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11bc859-04e6-4d91-a9cd-2688bb86ab2d None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:07.839537 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11bc859-04e6-4d91-a9cd-2688bb86ab2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:07.936172 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11bc859-04e6-4d91-a9cd-2688bb86ab2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:07.937731 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11bc859-04e6-4d91-a9cd-2688bb86ab2d None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:07.951816 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 224/431] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:14:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:14:07.964093 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:08.010963 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d5085-c1a7-4894-a83b-ed62f7992bf3 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:08.075433 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 208/432] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:14:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:14:08.077188 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11bc859-04e6-4d91-a9cd-2688bb86ab2d None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:08.117242 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d5085-c1a7-4894-a83b-ed62f7992bf3 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:08.119222 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:08.159595 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de496d3a-6709-4baf-8bc1-c402fdffe75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:08.160230 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de496d3a-6709-4baf-8bc1-c402fdffe75a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:08.160544 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de496d3a-6709-4baf-8bc1-c402fdffe75a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:08.161021 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de496d3a-6709-4baf-8bc1-c402fdffe75a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:08.171607 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de496d3a-6709-4baf-8bc1-c402fdffe75a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:14:08.176882 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-de496d3a-6709-4baf-8bc1-c402fdffe75a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:14:08.176882 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:08.176882 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:08.176882 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:08.176882 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:08.176882 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:08.176882 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:08.176882 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:08.176882 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:08.176882 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:08.176882 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:08.176882 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:08.176882 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:14:08.176882 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:14:08.176882 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:14:08.176882 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:14:08.177788 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:14:08.177788 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:14:08.177788 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:14:08.177788 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:14:08.177788 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:08.177788 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:08.177788 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:08.177788 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:08.177788 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:08.177788 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:08.177788 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:08.177788 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:08.177788 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:08.177788 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:08.177788 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:08.177788 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:08.179150 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:08.179150 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:08.179150 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:08.179150 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:08.179150 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:14:08.179150 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:14:08.179150 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:14:08.179150 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:14:08.179150 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:14:08.179150 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:14:08.179150 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:14:08.179150 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:08.179150 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 225/433] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Aug 29 22:14:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:14:08.184175 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de496d3a-6709-4baf-8bc1-c402fdffe75a None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:08.212870 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11bc859-04e6-4d91-a9cd-2688bb86ab2d None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:08.229225 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:08.254679 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53467893-617d-4602-92b1-4edaaa42c2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:08.255758 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53467893-617d-4602-92b1-4edaaa42c2f7 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:08.256276 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53467893-617d-4602-92b1-4edaaa42c2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:08.256774 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53467893-617d-4602-92b1-4edaaa42c2f7 None admin] PATH_INFO: `/v3/projects/e0b257f7f1874d8483a2453331254e1a` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:08.258084 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53467893-617d-4602-92b1-4edaaa42c2f7 None admin] RBAC: Authorizing `identity:get_project(project_id=e0b257f7f1874d8483a2453331254e1a)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:08.260340 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53467893-617d-4602-92b1-4edaaa42c2f7 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:08.265571 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 209/434] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Aug 29 22:14:08 2022] GET /identity/v3/projects/e0b257f7f1874d8483a2453331254e1a => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:14:08.265705 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53467893-617d-4602-92b1-4edaaa42c2f7 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:08.295438 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de496d3a-6709-4baf-8bc1-c402fdffe75a None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:08.341822 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba48c7-c1a3-42d8-8ff9-68a67ac078a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:08.342128 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba48c7-c1a3-42d8-8ff9-68a67ac078a7 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:08.342352 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba48c7-c1a3-42d8-8ff9-68a67ac078a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:08.342624 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba48c7-c1a3-42d8-8ff9-68a67ac078a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:08.343355 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfba48c7-c1a3-42d8-8ff9-68a67ac078a7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:08.343654 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfba48c7-c1a3-42d8-8ff9-68a67ac078a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:08.345127 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfba48c7-c1a3-42d8-8ff9-68a67ac078a7 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:08.355553 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 226/435] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Aug 29 22:14:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:14:08.356397 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba48c7-c1a3-42d8-8ff9-68a67ac078a7 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:08.390384 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:08.401916 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53467893-617d-4602-92b1-4edaaa42c2f7 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:08.437856 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7078231-bb6a-4b78-916c-63c2143c5904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:08.438478 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7078231-bb6a-4b78-916c-63c2143c5904 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:08.438756 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7078231-bb6a-4b78-916c-63c2143c5904 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:08.439024 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7078231-bb6a-4b78-916c-63c2143c5904 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:08.449035 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7078231-bb6a-4b78-916c-63c2143c5904 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:14:08.453831 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-e7078231-bb6a-4b78-916c-63c2143c5904 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:14:08.453831 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:08.453831 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:08.453831 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:08.453831 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:08.453831 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:08.453831 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:08.453831 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:08.453831 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:08.453831 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:08.453831 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:08.453831 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:08.453831 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:14:08.453831 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:14:08.453831 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:14:08.453831 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:14:08.454876 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:14:08.454876 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:14:08.454876 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:14:08.454876 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:14:08.454876 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:08.454876 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:08.454876 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:08.454876 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:08.454876 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:08.454876 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:08.454876 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:08.454876 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:08.454876 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:08.454876 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:08.454876 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:08.454876 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:08.456237 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:08.456237 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:08.456237 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:08.456237 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:08.456237 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:14:08.456237 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:14:08.456237 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:14:08.456237 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:14:08.456237 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:14:08.456237 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:14:08.456237 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:14:08.456237 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:08.459727 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 210/436] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Aug 29 22:14:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:08.460542 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7078231-bb6a-4b78-916c-63c2143c5904 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:08.469531 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba48c7-c1a3-42d8-8ff9-68a67ac078a7 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:08.502501 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a1670-3b5e-4d99-b61e-f36049f19216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:08.502946 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a1670-3b5e-4d99-b61e-f36049f19216 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:08.503224 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a1670-3b5e-4d99-b61e-f36049f19216 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:08.503516 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a1670-3b5e-4d99-b61e-f36049f19216 None admin] PATH_INFO: `/v3/groups/2ef9c744e8974e5486ceaf0f4268bec1` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:08.503641 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:08.504654 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9a1670-3b5e-4d99-b61e-f36049f19216 None admin] RBAC: Authorizing `identity:get_group(group_id=2ef9c744e8974e5486ceaf0f4268bec1)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:08.506173 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9a1670-3b5e-4d99-b61e-f36049f19216 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:08.507730 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 227/437] 10.222.0.36 () {56 vars in 1180 bytes} [Mon Aug 29 22:14:08 2022] GET /identity/v3/groups/2ef9c744e8974e5486ceaf0f4268bec1 => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:08.509102 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f7801-40f9-400b-a466-aac6fd59cf50 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:08.509385 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f7801-40f9-400b-a466-aac6fd59cf50 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:08.509654 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f7801-40f9-400b-a466-aac6fd59cf50 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:08.515127 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 228/438] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:14:08.515127 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f7801-40f9-400b-a466-aac6fd59cf50 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:08.567663 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7078231-bb6a-4b78-916c-63c2143c5904 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:08.602669 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9c8ec-9ec0-4868-a80f-31ab70380598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:08.603213 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9c8ec-9ec0-4868-a80f-31ab70380598 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:08.603501 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9c8ec-9ec0-4868-a80f-31ab70380598 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:08.603768 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9c8ec-9ec0-4868-a80f-31ab70380598 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:08.607210 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:08.617364 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f7801-40f9-400b-a466-aac6fd59cf50 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:08.652215 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ad34a-e4ea-457f-8cc2-77d039ecfc33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:08.652874 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ad34a-e4ea-457f-8cc2-77d039ecfc33 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:08.653192 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ad34a-e4ea-457f-8cc2-77d039ecfc33 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:08.653425 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ad34a-e4ea-457f-8cc2-77d039ecfc33 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:08.654090 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ad34a-e4ea-457f-8cc2-77d039ecfc33 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:08.654425 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ad34a-e4ea-457f-8cc2-77d039ecfc33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:08.655782 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ad34a-e4ea-457f-8cc2-77d039ecfc33 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:08.664997 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 229/439] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:14:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:08.665684 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ad34a-e4ea-457f-8cc2-77d039ecfc33 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:08.678034 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b9c8ec-9ec0-4868-a80f-31ab70380598 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:08.679512 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b9c8ec-9ec0-4868-a80f-31ab70380598 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:08.719266 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:08.762642 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ad34a-e4ea-457f-8cc2-77d039ecfc33 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:08.779275 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 211/440] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:14:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:14:08.780536 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725fdc53-cfe8-4eec-80ae-325cddb014cd None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:08.780821 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725fdc53-cfe8-4eec-80ae-325cddb014cd None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:08.781090 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725fdc53-cfe8-4eec-80ae-325cddb014cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:08.796865 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2571e6-521d-4ab3-b49c-938be663db3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:08.797472 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2571e6-521d-4ab3-b49c-938be663db3c None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:08.797782 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2571e6-521d-4ab3-b49c-938be663db3c None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:08.798047 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2571e6-521d-4ab3-b49c-938be663db3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:08.798622 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-725fdc53-cfe8-4eec-80ae-325cddb014cd None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:14:08.798755 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2571e6-521d-4ab3-b49c-938be663db3c None admin] RBAC: Adding query filter params (group.id=2ef9c744e8974e5486ceaf0f4268bec1, role.id=c358a37c24fe42bca4a93331f2c99d90, scope.project.id=e0b257f7f1874d8483a2453331254e1a) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:08.799062 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2571e6-521d-4ab3-b49c-938be663db3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:08.799799 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-725fdc53-cfe8-4eec-80ae-325cddb014cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:14:08.800490 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2571e6-521d-4ab3-b49c-938be663db3c None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:08.806782 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 230/441] 10.222.0.36 () {56 vars in 1376 bytes} [Mon Aug 29 22:14:08 2022] GET /identity/v3/role_assignments?group.id=2ef9c744e8974e5486ceaf0f4268bec1&scope.project.id=e0b257f7f1874d8483a2453331254e1a&role.id=c358a37c24fe42bca4a93331f2c99d90 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:08.807576 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2571e6-521d-4ab3-b49c-938be663db3c None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:08.829920 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:08.897830 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 212/442] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:14:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:14:08.898509 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725fdc53-cfe8-4eec-80ae-325cddb014cd None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:08.942979 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2571e6-521d-4ab3-b49c-938be663db3c None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:08.992330 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d3a84-127d-4be4-8501-0fe461e8aaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:08.993395 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d3a84-127d-4be4-8501-0fe461e8aaa6 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:08.993897 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d3a84-127d-4be4-8501-0fe461e8aaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:08.994303 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d3a84-127d-4be4-8501-0fe461e8aaa6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:08.995759 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:09.037398 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725fdc53-cfe8-4eec-80ae-325cddb014cd None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:09.077271 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f560da-3edb-4a5a-b9d3-c85e7d0d6c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:09.078226 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f560da-3edb-4a5a-b9d3-c85e7d0d6c5e None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:09.078508 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f560da-3edb-4a5a-b9d3-c85e7d0d6c5e None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:09.078785 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f560da-3edb-4a5a-b9d3-c85e7d0d6c5e None admin] PATH_INFO: `/v3/projects/72e0b172f95b4686aa832057c998ddbe` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:09.079799 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46d3a84-127d-4be4-8501-0fe461e8aaa6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:09.079934 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f560da-3edb-4a5a-b9d3-c85e7d0d6c5e None admin] RBAC: Authorizing `identity:get_project(project_id=72e0b172f95b4686aa832057c998ddbe)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:09.081288 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46d3a84-127d-4be4-8501-0fe461e8aaa6 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:09.081389 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f560da-3edb-4a5a-b9d3-c85e7d0d6c5e None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:09.083314 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 213/443] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Aug 29 22:14:08 2022] GET /identity/v3/projects/72e0b172f95b4686aa832057c998ddbe => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:09.088391 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f560da-3edb-4a5a-b9d3-c85e7d0d6c5e None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:09.101761 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:09.188858 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 231/444] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:14:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:14:09.189549 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d3a84-127d-4be4-8501-0fe461e8aaa6 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:09.198770 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f560da-3edb-4a5a-b9d3-c85e7d0d6c5e None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:09.243681 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b6936-8c48-480f-bf4b-234b425a2a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:09.244321 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b6936-8c48-480f-bf4b-234b425a2a1a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:09.244638 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b6936-8c48-480f-bf4b-234b425a2a1a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:09.244916 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b6936-8c48-480f-bf4b-234b425a2a1a None admin] PATH_INFO: `/v3/groups/2ef9c744e8974e5486ceaf0f4268bec1` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:09.246064 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808b6936-8c48-480f-bf4b-234b425a2a1a None admin] RBAC: Authorizing `identity:get_group(group_id=2ef9c744e8974e5486ceaf0f4268bec1)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:09.247521 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808b6936-8c48-480f-bf4b-234b425a2a1a None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:09.249157 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 214/445] 10.222.0.36 () {56 vars in 1180 bytes} [Mon Aug 29 22:14:09 2022] GET /identity/v3/groups/2ef9c744e8974e5486ceaf0f4268bec1 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:14:09.249896 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b6936-8c48-480f-bf4b-234b425a2a1a None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:09.259397 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:09.301003 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d3a84-127d-4be4-8501-0fe461e8aaa6 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:09.318651 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:09.336068 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429ea24-f85e-4ab1-907e-79d2ddf31b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:09.336998 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429ea24-f85e-4ab1-907e-79d2ddf31b88 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:09.337462 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429ea24-f85e-4ab1-907e-79d2ddf31b88 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:09.337935 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429ea24-f85e-4ab1-907e-79d2ddf31b88 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:09.348085 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0429ea24-f85e-4ab1-907e-79d2ddf31b88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:14:09.353119 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-0429ea24-f85e-4ab1-907e-79d2ddf31b88 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:14:09.353119 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:09.353119 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:09.353119 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:09.353119 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:09.353119 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:09.353119 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:09.353119 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:09.353119 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:09.353119 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:09.353119 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:09.353119 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:09.353119 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:14:09.353119 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:14:09.353119 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:14:09.353119 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:14:09.354010 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:14:09.354010 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:14:09.354010 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:14:09.354010 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:14:09.354010 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:09.354010 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:09.354010 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:09.354010 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:09.354010 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:09.354010 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:09.354010 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:09.354010 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:09.354010 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:09.354010 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:09.354010 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:09.354010 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:09.354806 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:09.354806 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:09.354806 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:09.354806 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:09.354806 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:14:09.354806 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:14:09.354806 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:14:09.354806 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:14:09.354806 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:14:09.354806 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:14:09.354806 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:14:09.354806 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:09.354806 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 232/446] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Aug 29 22:14:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:09.355460 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b6936-8c48-480f-bf4b-234b425a2a1a None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:09.355537 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429ea24-f85e-4ab1-907e-79d2ddf31b88 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:09.394368 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a148e70-78ea-45e7-8523-c5986be07769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:09.395228 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a148e70-78ea-45e7-8523-c5986be07769 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:09.395627 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a148e70-78ea-45e7-8523-c5986be07769 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:09.395903 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a148e70-78ea-45e7-8523-c5986be07769 None admin] PATH_INFO: `/v3/projects/174c552d34394032ba6a5f46a315abf1` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:09.397299 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a148e70-78ea-45e7-8523-c5986be07769 None admin] RBAC: Authorizing `identity:get_project(project_id=174c552d34394032ba6a5f46a315abf1)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:09.400055 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a148e70-78ea-45e7-8523-c5986be07769 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:09.402099 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 215/447] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Aug 29 22:14:09 2022] GET /identity/v3/projects/174c552d34394032ba6a5f46a315abf1 => generated 344 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:09.402905 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a148e70-78ea-45e7-8523-c5986be07769 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:09.463922 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429ea24-f85e-4ab1-907e-79d2ddf31b88 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:09.481466 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:09.499377 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc82937-a41f-4b5a-b1d7-0ec75280364c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:09.500075 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc82937-a41f-4b5a-b1d7-0ec75280364c None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:09.500354 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc82937-a41f-4b5a-b1d7-0ec75280364c None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:09.500662 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc82937-a41f-4b5a-b1d7-0ec75280364c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:09.501396 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc82937-a41f-4b5a-b1d7-0ec75280364c None admin] RBAC: Adding query filter params (group.id=2ef9c744e8974e5486ceaf0f4268bec1, role.id=8767fe0bd994478fac741fc8c76f649e, scope.project.id=72e0b172f95b4686aa832057c998ddbe) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:09.501702 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc82937-a41f-4b5a-b1d7-0ec75280364c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:09.503133 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc82937-a41f-4b5a-b1d7-0ec75280364c None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:09.509028 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 233/448] 10.222.0.36 () {56 vars in 1376 bytes} [Mon Aug 29 22:14:09 2022] GET /identity/v3/role_assignments?group.id=2ef9c744e8974e5486ceaf0f4268bec1&scope.project.id=72e0b172f95b4686aa832057c998ddbe&role.id=8767fe0bd994478fac741fc8c76f649e => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:09.509246 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a148e70-78ea-45e7-8523-c5986be07769 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:09.509794 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc82937-a41f-4b5a-b1d7-0ec75280364c None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:09.566404 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:09.570894 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75024c97-19c3-42ff-b992-919e08cc1384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:09.571694 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75024c97-19c3-42ff-b992-919e08cc1384 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:09.572093 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75024c97-19c3-42ff-b992-919e08cc1384 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:09.572372 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75024c97-19c3-42ff-b992-919e08cc1384 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:09.573096 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75024c97-19c3-42ff-b992-919e08cc1384 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:09.573400 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75024c97-19c3-42ff-b992-919e08cc1384 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:09.574874 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75024c97-19c3-42ff-b992-919e08cc1384 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:09.585106 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 216/449] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Aug 29 22:14:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:09.591368 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75024c97-19c3-42ff-b992-919e08cc1384 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:09.633508 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc82937-a41f-4b5a-b1d7-0ec75280364c None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:09.673113 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f04988-b3a9-49cb-be01-ff39fac6b303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:09.673762 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f04988-b3a9-49cb-be01-ff39fac6b303 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:09.674045 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f04988-b3a9-49cb-be01-ff39fac6b303 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:09.674321 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f04988-b3a9-49cb-be01-ff39fac6b303 None admin] PATH_INFO: `/v3/groups/e63b53e0ac294827bdebd7d6b411ea78` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:09.676656 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f04988-b3a9-49cb-be01-ff39fac6b303 None admin] RBAC: Authorizing `identity:get_group(group_id=e63b53e0ac294827bdebd7d6b411ea78)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:09.678156 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f04988-b3a9-49cb-be01-ff39fac6b303 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:09.679552 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 234/450] 10.222.0.36 () {56 vars in 1180 bytes} [Mon Aug 29 22:14:09 2022] GET /identity/v3/groups/e63b53e0ac294827bdebd7d6b411ea78 => generated 229 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:09.685835 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f04988-b3a9-49cb-be01-ff39fac6b303 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:09.722582 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75024c97-19c3-42ff-b992-919e08cc1384 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:09.778857 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8027620-d085-4db1-9a63-0beb078090ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:09.779485 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8027620-d085-4db1-9a63-0beb078090ee None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:09.779765 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8027620-d085-4db1-9a63-0beb078090ee None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:09.780036 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8027620-d085-4db1-9a63-0beb078090ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:09.783959 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:09.813530 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f04988-b3a9-49cb-be01-ff39fac6b303 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:09.826438 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:09.860716 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9c338-b49f-4654-b456-33caf912ff3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:09.861340 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9c338-b49f-4654-b456-33caf912ff3b None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:09.862265 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9c338-b49f-4654-b456-33caf912ff3b None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:09.862265 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9c338-b49f-4654-b456-33caf912ff3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:09.862628 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d9c338-b49f-4654-b456-33caf912ff3b None admin] RBAC: Adding query filter params (group.id=e63b53e0ac294827bdebd7d6b411ea78, role.id=ff59a239a50b4bd899a83bf3c3fd1f63, scope.project.id=174c552d34394032ba6a5f46a315abf1) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:09.862938 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d9c338-b49f-4654-b456-33caf912ff3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:09.864411 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d9c338-b49f-4654-b456-33caf912ff3b None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:09.874186 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 235/451] 10.222.0.36 () {56 vars in 1376 bytes} [Mon Aug 29 22:14:09 2022] GET /identity/v3/role_assignments?group.id=e63b53e0ac294827bdebd7d6b411ea78&scope.project.id=174c552d34394032ba6a5f46a315abf1&role.id=ff59a239a50b4bd899a83bf3c3fd1f63 => generated 611 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:14:09.878820 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8027620-d085-4db1-9a63-0beb078090ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:09.880373 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8027620-d085-4db1-9a63-0beb078090ee None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:10.026649 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 217/452] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:14:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:14:10.032716 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9c338-b49f-4654-b456-33caf912ff3b None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:10.159108 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9c338-b49f-4654-b456-33caf912ff3b None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:10.194335 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e5212-dfbc-43e5-a009-9b40daeccfbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:10.195009 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e5212-dfbc-43e5-a009-9b40daeccfbf None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:10.195245 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e5212-dfbc-43e5-a009-9b40daeccfbf None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:10.195519 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e5212-dfbc-43e5-a009-9b40daeccfbf None admin] PATH_INFO: `/v3/projects/e0b257f7f1874d8483a2453331254e1a` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:10.197749 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078e5212-dfbc-43e5-a009-9b40daeccfbf None admin] RBAC: Authorizing `identity:get_project(project_id=e0b257f7f1874d8483a2453331254e1a)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:10.198268 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078e5212-dfbc-43e5-a009-9b40daeccfbf None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:10.199954 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 236/453] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Aug 29 22:14:10 2022] GET /identity/v3/projects/e0b257f7f1874d8483a2453331254e1a => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:10.205970 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8027620-d085-4db1-9a63-0beb078090ee None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:10.242548 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:10.314448 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8027620-d085-4db1-9a63-0beb078090ee None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:10.356135 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac3211-f231-4ddf-ba27-9001b48456a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:10.356810 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac3211-f231-4ddf-ba27-9001b48456a4 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:10.357088 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac3211-f231-4ddf-ba27-9001b48456a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:10.357359 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac3211-f231-4ddf-ba27-9001b48456a4 None admin] PATH_INFO: `/v3/groups/2ef9c744e8974e5486ceaf0f4268bec1` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:10.358502 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dac3211-f231-4ddf-ba27-9001b48456a4 None admin] RBAC: Authorizing `identity:get_group(group_id=2ef9c744e8974e5486ceaf0f4268bec1)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:10.359955 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dac3211-f231-4ddf-ba27-9001b48456a4 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:10.361631 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 218/454] 10.222.0.36 () {56 vars in 1180 bytes} [Mon Aug 29 22:14:10 2022] GET /identity/v3/groups/2ef9c744e8974e5486ceaf0f4268bec1 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:10.368098 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e5212-dfbc-43e5-a009-9b40daeccfbf None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:10.413061 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:10.482276 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e5212-dfbc-43e5-a009-9b40daeccfbf None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:10.518387 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a4432b-1c92-420a-8106-7df412821c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:10.518988 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4432b-1c92-420a-8106-7df412821c7b None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:10.519267 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4432b-1c92-420a-8106-7df412821c7b None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:10.519540 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4432b-1c92-420a-8106-7df412821c7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:10.520265 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a4432b-1c92-420a-8106-7df412821c7b None admin] RBAC: Adding query filter params (group.id=2ef9c744e8974e5486ceaf0f4268bec1, role.id=8767fe0bd994478fac741fc8c76f649e, scope.project.id=e0b257f7f1874d8483a2453331254e1a) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:10.520587 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a4432b-1c92-420a-8106-7df412821c7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:10.522171 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a4432b-1c92-420a-8106-7df412821c7b None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:10.528487 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 237/455] 10.222.0.36 () {56 vars in 1376 bytes} [Mon Aug 29 22:14:10 2022] GET /identity/v3/role_assignments?group.id=2ef9c744e8974e5486ceaf0f4268bec1&scope.project.id=e0b257f7f1874d8483a2453331254e1a&role.id=8767fe0bd994478fac741fc8c76f649e => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:13.157009 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba8cf3-d748-45b4-9451-b0b84d32ba51 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:13.157508 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba8cf3-d748-45b4-9451-b0b84d32ba51 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:13.157508 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba8cf3-d748-45b4-9451-b0b84d32ba51 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:13.159106 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 219/456] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:14:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:14:13.164065 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8525d-9598-49f5-9256-6aab1d9e4b32 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:13.165089 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8525d-9598-49f5-9256-6aab1d9e4b32 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:13.165089 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8525d-9598-49f5-9256-6aab1d9e4b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:13.193569 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-b5e8525d-9598-49f5-9256-6aab1d9e4b32 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:14:13.194822 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b5e8525d-9598-49f5-9256-6aab1d9e4b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:14:13.290832 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 238/457] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:14:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:14:13.323729 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39011dc-ef96-4b95-9755-702f0dad68ca None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:13.324006 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39011dc-ef96-4b95-9755-702f0dad68ca None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:13.324442 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39011dc-ef96-4b95-9755-702f0dad68ca None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:13.326249 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 220/458] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:14:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:14:13.331384 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1d725-6cda-4677-b8bf-4cd83f7ff934 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:13.331674 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1d725-6cda-4677-b8bf-4cd83f7ff934 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:13.331951 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1d725-6cda-4677-b8bf-4cd83f7ff934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:13.342379 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b048a-7bd7-46f5-8e96-8bf9867e1517 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:13.343025 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b048a-7bd7-46f5-8e96-8bf9867e1517 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:13.343494 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b048a-7bd7-46f5-8e96-8bf9867e1517 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:13.345519 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 221/459] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:14:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:14:13.351095 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8deb70-1b54-427a-b37b-cfe95bae0eb7 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:13.351679 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8deb70-1b54-427a-b37b-cfe95bae0eb7 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:13.352173 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8deb70-1b54-427a-b37b-cfe95bae0eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:13.360490 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-89d1d725-6cda-4677-b8bf-4cd83f7ff934 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:14:13.360490 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-89d1d725-6cda-4677-b8bf-4cd83f7ff934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:14:13.390148 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-ff8deb70-1b54-427a-b37b-cfe95bae0eb7 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:14:13.391484 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:13.391595 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-ff8deb70-1b54-427a-b37b-cfe95bae0eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:14:13.451260 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 239/460] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:14:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:14:13.530838 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 222/461] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:14:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:14:13.678129 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d1d725-6cda-4677-b8bf-4cd83f7ff934 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:13.829332 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8deb70-1b54-427a-b37b-cfe95bae0eb7 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:13.857441 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d1d725-6cda-4677-b8bf-4cd83f7ff934 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:13.878987 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:13.896659 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b3b728-67ad-4ec5-aac8-597e2202db58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:13.897505 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3b728-67ad-4ec5-aac8-597e2202db58 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:13.897948 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3b728-67ad-4ec5-aac8-597e2202db58 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:13.898378 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3b728-67ad-4ec5-aac8-597e2202db58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:13.910373 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b3b728-67ad-4ec5-aac8-597e2202db58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:13.913240 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b3b728-67ad-4ec5-aac8-597e2202db58 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:13.940248 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-a3b3b728-67ad-4ec5-aac8-597e2202db58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:13.940248 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:13.940248 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:13.940248 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:13.940248 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:13.940248 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:13.940248 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:13.940248 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:13.940248 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:13.940248 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:13.940248 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:13.940248 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:13.940248 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:14:13.940248 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:14:13.940248 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:14:13.940248 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:14:13.941443 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:13.941443 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:13.941443 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:13.941443 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:13.941443 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:13.941443 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:13.941443 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:13.941443 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:13.941443 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:13.941443 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:13.941443 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:13.941443 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:13.941443 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:13.941443 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:13.941443 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:13.941443 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:13.941443 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:14:13.942293 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:14:13.942293 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:13.942293 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:13.944357 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 240/462] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:14:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:13.950452 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b3b728-67ad-4ec5-aac8-597e2202db58 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:13.962578 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8deb70-1b54-427a-b37b-cfe95bae0eb7 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:13.971494 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:14.010994 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722487aa-d7b4-49b9-b794-9af0a7b80e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:14.011640 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722487aa-d7b4-49b9-b794-9af0a7b80e59 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:14.011949 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722487aa-d7b4-49b9-b794-9af0a7b80e59 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:14.012494 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722487aa-d7b4-49b9-b794-9af0a7b80e59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:14.027493 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722487aa-d7b4-49b9-b794-9af0a7b80e59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:14.030136 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722487aa-d7b4-49b9-b794-9af0a7b80e59 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:14.050182 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-722487aa-d7b4-49b9-b794-9af0a7b80e59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:14.050182 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:14.050182 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:14.050182 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:14.050182 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:14.050182 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:14.050182 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:14.050182 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:14.050182 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:14.050182 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:14.050182 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:14.050182 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:14.050182 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:14:14.050182 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:14:14.050182 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:14:14.050182 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:14:14.051146 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:14.051146 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:14.051146 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:14.051146 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:14.051146 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:14.051146 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:14.051146 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:14.051146 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:14.051146 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:14.051146 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:14.051146 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:14.051146 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:14.051146 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:14.051146 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:14.051146 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:14.051146 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:14.051146 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:14:14.052046 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:14:14.052046 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:14.052046 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:14.052046 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 223/463] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:14:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:14.052736 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722487aa-d7b4-49b9-b794-9af0a7b80e59 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:14.072104 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b3b728-67ad-4ec5-aac8-597e2202db58 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:14.123182 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25475c7d-5830-402a-8b94-bd7778fa563b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:14.123805 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25475c7d-5830-402a-8b94-bd7778fa563b None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:14.124089 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25475c7d-5830-402a-8b94-bd7778fa563b None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:14.124382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25475c7d-5830-402a-8b94-bd7778fa563b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:14.138584 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25475c7d-5830-402a-8b94-bd7778fa563b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:14.140739 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25475c7d-5830-402a-8b94-bd7778fa563b None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:14.146970 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:14.155351 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-25475c7d-5830-402a-8b94-bd7778fa563b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:14.155351 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:14.155351 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:14.155351 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:14.155351 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:14.155351 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:14.155351 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:14.155351 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:14.155351 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:14.155351 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:14.155351 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:14.155351 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:14.155351 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:14:14.155351 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:14:14.155351 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:14:14.155351 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:14:14.156531 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:14.156531 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:14.156531 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:14.156531 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:14.156531 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:14.156531 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:14.156531 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:14.156531 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:14.156531 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:14.156531 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:14.156531 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:14.156531 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:14.156531 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:14.156531 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:14.156531 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:14.156531 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:14.156531 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:14:14.157406 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:14:14.157406 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:14.157406 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:14.157406 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 241/464] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:14:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:14.157406 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25475c7d-5830-402a-8b94-bd7778fa563b None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:14.169231 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722487aa-d7b4-49b9-b794-9af0a7b80e59 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:14.205787 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b886b885-e80a-4035-ae1d-5b62c306ea49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:14.206683 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886b885-e80a-4035-ae1d-5b62c306ea49 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:14.206953 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886b885-e80a-4035-ae1d-5b62c306ea49 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:14.207361 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886b885-e80a-4035-ae1d-5b62c306ea49 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:14.208148 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b886b885-e80a-4035-ae1d-5b62c306ea49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:14.208615 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b886b885-e80a-4035-ae1d-5b62c306ea49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:14.210191 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b886b885-e80a-4035-ae1d-5b62c306ea49 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:14.228731 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 224/465] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:14:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:14.230196 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b359ef-7fcf-45b0-a211-93a0d7a4c661 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:14.230478 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b359ef-7fcf-45b0-a211-93a0d7a4c661 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:14.230744 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b359ef-7fcf-45b0-a211-93a0d7a4c661 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:14.232106 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 225/466] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:14:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:14:14.235316 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:14.236615 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b359ef-7fcf-45b0-a211-93a0d7a4c661 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:14.270932 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25475c7d-5830-402a-8b94-bd7778fa563b None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:14.310260 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a33dbd-ebac-4588-9996-f0802ad96dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:14.310870 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a33dbd-ebac-4588-9996-f0802ad96dee None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:14.311155 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a33dbd-ebac-4588-9996-f0802ad96dee None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:14.311433 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a33dbd-ebac-4588-9996-f0802ad96dee None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:14.312082 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a33dbd-ebac-4588-9996-f0802ad96dee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:14.312397 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a33dbd-ebac-4588-9996-f0802ad96dee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:14.313804 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a33dbd-ebac-4588-9996-f0802ad96dee None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:14.326964 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 242/467] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:14:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:14.328033 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a33dbd-ebac-4588-9996-f0802ad96dee None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:14.350507 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b359ef-7fcf-45b0-a211-93a0d7a4c661 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:14.388483 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3037f1b1-c6c9-4a76-b103-fea03a615184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:14.389052 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037f1b1-c6c9-4a76-b103-fea03a615184 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:14.389363 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037f1b1-c6c9-4a76-b103-fea03a615184 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:14.389949 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037f1b1-c6c9-4a76-b103-fea03a615184 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:14.390601 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3037f1b1-c6c9-4a76-b103-fea03a615184 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:14.390908 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3037f1b1-c6c9-4a76-b103-fea03a615184 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:14.392291 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3037f1b1-c6c9-4a76-b103-fea03a615184 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:14.403996 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 226/468] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:14:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:14.405450 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5071380-db20-43da-9b57-7785ae2d3b0c None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:14.405736 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5071380-db20-43da-9b57-7785ae2d3b0c None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:14.406009 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5071380-db20-43da-9b57-7785ae2d3b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:14.419183 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:14.424987 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-f5071380-db20-43da-9b57-7785ae2d3b0c None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:14:14.426228 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f5071380-db20-43da-9b57-7785ae2d3b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:14:14.449367 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a33dbd-ebac-4588-9996-f0802ad96dee None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:14.479881 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:14.486988 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f0a3d5-bc44-48cd-b3f5-a4e1982a5f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:14.487798 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0a3d5-bc44-48cd-b3f5-a4e1982a5f43 None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:14.488118 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0a3d5-bc44-48cd-b3f5-a4e1982a5f43 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:14.488395 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0a3d5-bc44-48cd-b3f5-a4e1982a5f43 None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:14.489064 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f0a3d5-bc44-48cd-b3f5-a4e1982a5f43 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:14.490544 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f0a3d5-bc44-48cd-b3f5-a4e1982a5f43 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:14.504475 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 227/469] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:14:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:14:14.504475 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5071380-db20-43da-9b57-7785ae2d3b0c None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:14.525490 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 243/470] 10.222.0.36 () {60 vars in 1132 bytes} [Mon Aug 29 22:14:14 2022] POST /identity/v3/users => generated 246 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:14:14.526555 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f0a3d5-bc44-48cd-b3f5-a4e1982a5f43 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:14.663091 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f0a3d5-bc44-48cd-b3f5-a4e1982a5f43 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:14.704424 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953be2f-484c-4ced-8a41-2a2f48b5efdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:14.705316 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953be2f-484c-4ced-8a41-2a2f48b5efdc None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:14.706148 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953be2f-484c-4ced-8a41-2a2f48b5efdc None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:14.706420 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953be2f-484c-4ced-8a41-2a2f48b5efdc None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:14.707237 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7953be2f-484c-4ced-8a41-2a2f48b5efdc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:14.708897 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7953be2f-484c-4ced-8a41-2a2f48b5efdc None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:14.741831 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 244/471] 10.222.0.36 () {60 vars in 1132 bytes} [Mon Aug 29 22:14:14 2022] POST /identity/v3/users => generated 248 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:14:14.745659 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5071380-db20-43da-9b57-7785ae2d3b0c None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:14.781064 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8848e-223c-4f30-b5d6-e25ab6427896 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:14.781411 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8848e-223c-4f30-b5d6-e25ab6427896 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:14.781618 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8848e-223c-4f30-b5d6-e25ab6427896 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:14.783253 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 245/472] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:14:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:14:14.788548 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef1e54-b037-4e46-bea5-c056a4ce3ad8 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:14.788836 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef1e54-b037-4e46-bea5-c056a4ce3ad8 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:14.789200 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef1e54-b037-4e46-bea5-c056a4ce3ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:14.792771 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cfe8a3-c7d1-4844-b883-8472a3a7cc33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:14.793490 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cfe8a3-c7d1-4844-b883-8472a3a7cc33 None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:14.793776 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cfe8a3-c7d1-4844-b883-8472a3a7cc33 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:14.794054 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cfe8a3-c7d1-4844-b883-8472a3a7cc33 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:14.794770 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cfe8a3-c7d1-4844-b883-8472a3a7cc33 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:14.796316 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cfe8a3-c7d1-4844-b883-8472a3a7cc33 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:14.806752 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:14.811546 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-34ef1e54-b037-4e46-bea5-c056a4ce3ad8 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:14:14.812920 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-34ef1e54-b037-4e46-bea5-c056a4ce3ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:14:14.824996 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 228/473] 10.222.0.36 () {60 vars in 1132 bytes} [Mon Aug 29 22:14:14 2022] POST /identity/v3/users => generated 248 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:14:14.826103 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cfe8a3-c7d1-4844-b883-8472a3a7cc33 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:14.870799 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:14.924822 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 246/474] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:14:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:14:14.966781 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cfe8a3-c7d1-4844-b883-8472a3a7cc33 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:15.004755 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad30b67-d34b-4615-8d7d-6eba7f8fd512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:15.005726 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad30b67-d34b-4615-8d7d-6eba7f8fd512 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:15.006184 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad30b67-d34b-4615-8d7d-6eba7f8fd512 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:15.006655 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad30b67-d34b-4615-8d7d-6eba7f8fd512 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:15.019588 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad30b67-d34b-4615-8d7d-6eba7f8fd512 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:15.021432 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad30b67-d34b-4615-8d7d-6eba7f8fd512 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:15.037375 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-aad30b67-d34b-4615-8d7d-6eba7f8fd512 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:15.037375 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:15.037375 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:15.037375 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:15.037375 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:15.037375 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:15.037375 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:15.037375 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:15.037375 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:15.037375 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:15.037375 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:15.037375 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:15.037375 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:14:15.037375 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:14:15.037375 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:14:15.037375 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:14:15.038340 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:15.038340 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:15.038340 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:15.038340 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:15.038340 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:15.038340 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:15.038340 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:15.038340 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:15.038340 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:15.038340 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:15.038340 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:15.038340 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:15.038340 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:15.038340 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:15.038340 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:15.038340 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:15.038340 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:14:15.039213 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:14:15.039213 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:15.039213 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:15.042562 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 229/475] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:14:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:15.048431 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef1e54-b037-4e46-bea5-c056a4ce3ad8 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:15.161775 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef1e54-b037-4e46-bea5-c056a4ce3ad8 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:15.206206 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad30b67-d34b-4615-8d7d-6eba7f8fd512 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:15.206694 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d65853-5208-4def-83fc-2355f46ea9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:15.206811 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d65853-5208-4def-83fc-2355f46ea9f4 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:15.207045 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d65853-5208-4def-83fc-2355f46ea9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:15.207314 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d65853-5208-4def-83fc-2355f46ea9f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:15.207971 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d65853-5208-4def-83fc-2355f46ea9f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:15.208272 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d65853-5208-4def-83fc-2355f46ea9f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:15.209675 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d65853-5208-4def-83fc-2355f46ea9f4 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:15.230192 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 247/476] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:14:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:15.235530 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d65853-5208-4def-83fc-2355f46ea9f4 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:15.256137 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:15.282660 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:15.318160 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad30b67-d34b-4615-8d7d-6eba7f8fd512 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:15.355146 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815fd3d5-56ad-45c6-899c-ea3d623bcef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:15.355768 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815fd3d5-56ad-45c6-899c-ea3d623bcef6 None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:15.356052 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815fd3d5-56ad-45c6-899c-ea3d623bcef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:15.356328 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815fd3d5-56ad-45c6-899c-ea3d623bcef6 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:15.357061 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815fd3d5-56ad-45c6-899c-ea3d623bcef6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:15.358540 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815fd3d5-56ad-45c6-899c-ea3d623bcef6 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:15.370846 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.sql.core [None req-815fd3d5-56ad-45c6-899c-ea3d623bcef6 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 29 22:14:15.370846 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 29 22:14:15.370846 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [parameters: {'id': '2bf888fb991f4591bf58dd75a87c48f6', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 29 22:14:15.370846 dv-cinder-854268-3-smb devstack@keystone.service[81514]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81514) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 22:14:15.405659 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-815fd3d5-56ad-45c6-899c-ea3d623bcef6 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 29 22:14:15.405659 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:15.405659 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 22:14:15.405659 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 22:14:15.405659 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 22:14:15.405659 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 22:14:15.405659 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 22:14:15.405659 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 22:14:15.405659 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 22:14:15.405659 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application conn.query(q) Aug 29 22:14:15.405659 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 22:14:15.405659 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 22:14:15.405659 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 22:14:15.405659 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application result.read() Aug 29 22:14:15.405659 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 22:14:15.407162 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 22:14:15.407162 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 22:14:15.407162 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 22:14:15.407162 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 22:14:15.407162 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 22:14:15.407162 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 22:14:15.407162 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 22:14:15.407162 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 29 22:14:15.407162 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:15.407162 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 29 22:14:15.407162 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:15.407162 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:15.407162 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 29 22:14:15.407162 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 29 22:14:15.407162 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 29 22:14:15.407162 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return ref.to_dict() Aug 29 22:14:15.407162 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 22:14:15.407162 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application next(self.gen) Aug 29 22:14:15.409547 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 29 22:14:15.409547 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application yield resource Aug 29 22:14:15.409547 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 22:14:15.409547 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application next(self.gen) Aug 29 22:14:15.409547 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 29 22:14:15.409547 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self.session.rollback() Aug 29 22:14:15.409547 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 22:14:15.409547 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self.force_reraise() Aug 29 22:14:15.409547 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 22:14:15.409547 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise self.value Aug 29 22:14:15.409547 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 29 22:14:15.409547 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 29 22:14:15.409547 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 29 22:14:15.409547 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application session.commit() Aug 29 22:14:15.409547 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 29 22:14:15.409547 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 29 22:14:15.409547 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 29 22:14:15.411649 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._prepare_impl() Aug 29 22:14:15.411649 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 29 22:14:15.411649 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self.session.flush() Aug 29 22:14:15.411649 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 22:14:15.411649 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._flush(objects) Aug 29 22:14:15.411649 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 22:14:15.411649 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 29 22:14:15.411649 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 22:14:15.411649 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application compat.raise_( Aug 29 22:14:15.411649 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 22:14:15.411649 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception Aug 29 22:14:15.411649 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 22:14:15.411649 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application flush_context.execute() Aug 29 22:14:15.411649 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 22:14:15.411649 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rec.execute(self) Aug 29 22:14:15.411649 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 22:14:15.411649 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 29 22:14:15.414123 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 22:14:15.414123 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 29 22:14:15.414123 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 29 22:14:15.414123 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 29 22:14:15.414123 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 22:14:15.414123 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 22:14:15.414123 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 22:14:15.414123 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 29 22:14:15.414123 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 22:14:15.414123 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 29 22:14:15.414123 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 22:14:15.414123 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 29 22:14:15.414123 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 22:14:15.414123 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 22:14:15.414123 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 22:14:15.414123 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception Aug 29 22:14:15.421774 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 22:14:15.421774 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 22:14:15.421774 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 22:14:15.421774 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 22:14:15.421774 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 22:14:15.421774 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 22:14:15.421774 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 22:14:15.421774 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application conn.query(q) Aug 29 22:14:15.421774 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 22:14:15.421774 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 22:14:15.421774 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 22:14:15.421774 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application result.read() Aug 29 22:14:15.421774 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 22:14:15.421774 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 22:14:15.421774 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 22:14:15.421774 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 22:14:15.423349 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 22:14:15.423349 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 22:14:15.423349 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 22:14:15.423349 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 22:14:15.423349 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 29 22:14:15.423349 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 29 22:14:15.423349 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [parameters: {'id': '2bf888fb991f4591bf58dd75a87c48f6', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 29 22:14:15.423349 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 22:14:15.423349 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:15.423349 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:14:15.423349 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:15.423349 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:15.423349 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:15.423349 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:15.423349 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:15.423349 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:15.424375 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:15.424375 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:15.424375 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:15.424375 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:15.424375 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:15.424375 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:15.424375 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 29 22:14:15.424375 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 29 22:14:15.424375 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:15.424375 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:15.424375 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 29 22:14:15.424375 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 29 22:14:15.424375 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 29 22:14:15.424375 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 29 22:14:15.424375 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 29 22:14:15.424375 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:15.426098 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 230/477] 10.222.0.36 () {60 vars in 1131 bytes} [Mon Aug 29 22:14:15 2022] POST /identity/v3/roles => generated 144 bytes in 203 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:15.426216 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d65853-5208-4def-83fc-2355f46ea9f4 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:15.426342 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815fd3d5-56ad-45c6-899c-ea3d623bcef6 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:15.482207 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be37c197-0c0a-4122-8ed2-a4a63f903ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:15.482769 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37c197-0c0a-4122-8ed2-a4a63f903ab0 None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:15.483044 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37c197-0c0a-4122-8ed2-a4a63f903ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:15.483314 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37c197-0c0a-4122-8ed2-a4a63f903ab0 None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:15.483971 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be37c197-0c0a-4122-8ed2-a4a63f903ab0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:15.485440 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be37c197-0c0a-4122-8ed2-a4a63f903ab0 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:15.535565 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 248/478] 10.222.0.36 () {60 vars in 1132 bytes} [Mon Aug 29 22:14:15 2022] POST /identity/v3/users => generated 249 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:14:15.556675 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815fd3d5-56ad-45c6-899c-ea3d623bcef6 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:15.567158 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:15.605446 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314aa6bf-1bec-4787-8f4c-781ec00aef8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:15.606112 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314aa6bf-1bec-4787-8f4c-781ec00aef8a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:15.606469 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314aa6bf-1bec-4787-8f4c-781ec00aef8a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:15.606747 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314aa6bf-1bec-4787-8f4c-781ec00aef8a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:15.620225 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314aa6bf-1bec-4787-8f4c-781ec00aef8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:14:15.626240 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-314aa6bf-1bec-4787-8f4c-781ec00aef8a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:14:15.626240 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:15.626240 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:15.626240 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:15.626240 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:15.626240 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:15.626240 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:15.626240 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:15.626240 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:15.626240 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:15.626240 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:15.626240 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:15.626240 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:14:15.626240 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:14:15.626240 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:14:15.626240 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:14:15.627343 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:14:15.627343 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:14:15.627343 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:14:15.627343 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:14:15.627343 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:15.627343 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:15.627343 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:15.627343 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:15.627343 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:15.627343 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:15.627343 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:15.627343 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:15.627343 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:15.627343 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:15.627343 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:15.627343 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:15.628152 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:15.628152 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:15.628152 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:15.628152 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:15.628152 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:14:15.628152 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:14:15.628152 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:14:15.628152 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:14:15.628152 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:14:15.628152 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:14:15.628152 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:14:15.628152 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:15.628152 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 231/479] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Aug 29 22:14:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:15.633563 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be37c197-0c0a-4122-8ed2-a4a63f903ab0 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:15.756326 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:15.774660 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be37c197-0c0a-4122-8ed2-a4a63f903ab0 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:15.824607 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013c308-f12b-4a9f-8449-646001e38e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:15.825803 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013c308-f12b-4a9f-8449-646001e38e41 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:15.826087 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013c308-f12b-4a9f-8449-646001e38e41 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:15.826362 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013c308-f12b-4a9f-8449-646001e38e41 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:15.827048 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4013c308-f12b-4a9f-8449-646001e38e41 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:15.827352 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4013c308-f12b-4a9f-8449-646001e38e41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:15.828757 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4013c308-f12b-4a9f-8449-646001e38e41 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:15.838215 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 249/480] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Aug 29 22:14:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:14:17.076811 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd01b39-20b8-4968-ace8-e682cc220a26 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:17.077830 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd01b39-20b8-4968-ace8-e682cc220a26 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:17.078326 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd01b39-20b8-4968-ace8-e682cc220a26 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:17.080113 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 232/481] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:14:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:14:17.085719 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190e445-a005-4cd2-9996-56f11083f4e4 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:17.087240 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190e445-a005-4cd2-9996-56f11083f4e4 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:17.087750 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190e445-a005-4cd2-9996-56f11083f4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:17.107370 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-b190e445-a005-4cd2-9996-56f11083f4e4 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:14:17.108944 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b190e445-a005-4cd2-9996-56f11083f4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:14:17.187758 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 250/482] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:14:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:14:17.358895 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08557d26-7331-4a81-880b-ff38c923deb1 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:17.359532 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08557d26-7331-4a81-880b-ff38c923deb1 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:17.360042 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08557d26-7331-4a81-880b-ff38c923deb1 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:17.361622 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 233/483] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:14:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:14:17.367009 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd90f36-70b0-4c58-98d2-f8065e3246d0 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:17.367560 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd90f36-70b0-4c58-98d2-f8065e3246d0 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:17.368640 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd90f36-70b0-4c58-98d2-f8065e3246d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:17.389222 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-0dd90f36-70b0-4c58-98d2-f8065e3246d0 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:14:17.391015 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-0dd90f36-70b0-4c58-98d2-f8065e3246d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:14:17.458916 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 251/484] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:14:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:14:17.497638 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08557d26-7331-4a81-880b-ff38c923deb1 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:17.505624 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7a088-831b-4d80-8194-ae84f4c374a5 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:17.506185 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7a088-831b-4d80-8194-ae84f4c374a5 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:17.506680 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7a088-831b-4d80-8194-ae84f4c374a5 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:17.509111 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 252/485] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:14:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:14:17.514336 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20f735-5464-419c-9e6a-b5c4c91aa50b None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:17.515175 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20f735-5464-419c-9e6a-b5c4c91aa50b None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:17.515646 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20f735-5464-419c-9e6a-b5c4c91aa50b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:17.545634 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-7c20f735-5464-419c-9e6a-b5c4c91aa50b None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:14:17.546845 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7c20f735-5464-419c-9e6a-b5c4c91aa50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:14:17.557313 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:17.639867 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 253/486] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:14:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:14:17.687775 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08557d26-7331-4a81-880b-ff38c923deb1 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:17.734330 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c6ca2c-b215-41a9-88ee-d6aaf96bf76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:17.735249 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c6ca2c-b215-41a9-88ee-d6aaf96bf76e None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:17.735663 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c6ca2c-b215-41a9-88ee-d6aaf96bf76e None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:17.736135 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c6ca2c-b215-41a9-88ee-d6aaf96bf76e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:17.751186 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c6ca2c-b215-41a9-88ee-d6aaf96bf76e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:14:17.756482 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-f3c6ca2c-b215-41a9-88ee-d6aaf96bf76e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:14:17.756482 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:17.756482 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:17.756482 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:17.756482 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:17.756482 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:17.756482 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:17.756482 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:17.756482 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:17.756482 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:17.756482 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:17.756482 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:17.756482 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:14:17.756482 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:14:17.756482 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:14:17.756482 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:14:17.757554 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:14:17.757554 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:14:17.757554 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:14:17.757554 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:14:17.757554 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:17.757554 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:17.757554 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:17.757554 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:17.757554 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:17.757554 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:17.757554 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:17.757554 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:17.757554 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:17.757554 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:17.757554 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:17.757554 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:17.758835 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:17.758835 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:17.758835 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:17.758835 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:17.758835 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:14:17.758835 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:14:17.758835 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:14:17.758835 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:14:17.758835 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:14:17.758835 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:14:17.758835 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:14:17.758835 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:17.760895 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 234/487] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Aug 29 22:14:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:17.767220 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c20f735-5464-419c-9e6a-b5c4c91aa50b None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:17.786299 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c6ca2c-b215-41a9-88ee-d6aaf96bf76e None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:17.824835 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:17.960672 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c20f735-5464-419c-9e6a-b5c4c91aa50b None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:17.964046 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c6ca2c-b215-41a9-88ee-d6aaf96bf76e None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:18.007766 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e28df4-3300-4a04-b495-eecfebc4416b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:18.008417 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e28df4-3300-4a04-b495-eecfebc4416b None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:18.008735 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e28df4-3300-4a04-b495-eecfebc4416b None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:18.009032 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e28df4-3300-4a04-b495-eecfebc4416b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:18.025430 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e28df4-3300-4a04-b495-eecfebc4416b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:14:18.030511 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-88e28df4-3300-4a04-b495-eecfebc4416b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:14:18.030511 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:18.030511 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:18.030511 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:18.030511 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:18.030511 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:18.030511 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:18.030511 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:18.030511 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:18.030511 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:18.030511 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:18.030511 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:18.030511 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:14:18.030511 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:14:18.030511 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:14:18.030511 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:14:18.031463 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:14:18.031463 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:14:18.031463 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:14:18.031463 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:14:18.031463 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:18.031463 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:18.031463 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:18.031463 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:18.031463 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:18.031463 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:18.031463 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:18.031463 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:18.031463 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:18.031463 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:18.031463 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:18.031463 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:18.032270 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:18.032270 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:18.032270 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:18.032270 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:18.032270 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:14:18.032270 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:14:18.032270 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:14:18.032270 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:14:18.032270 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:14:18.032270 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:14:18.032270 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:14:18.032270 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:18.034196 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3d858-0280-4619-8f3a-0c465e370369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:18.035055 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3d858-0280-4619-8f3a-0c465e370369 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:18.035510 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3d858-0280-4619-8f3a-0c465e370369 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:18.035963 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3d858-0280-4619-8f3a-0c465e370369 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:18.036556 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 235/488] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Aug 29 22:14:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:14:18.037118 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b3d858-0280-4619-8f3a-0c465e370369 None admin] RBAC: Adding query filter params (name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:18.037562 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e28df4-3300-4a04-b495-eecfebc4416b None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:18.037808 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b3d858-0280-4619-8f3a-0c465e370369 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:18.039802 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b3d858-0280-4619-8f3a-0c465e370369 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:18.049430 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 254/489] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Aug 29 22:14:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:18.050567 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3d858-0280-4619-8f3a-0c465e370369 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:18.054476 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:18.149004 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:18.152627 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e28df4-3300-4a04-b495-eecfebc4416b None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:18.153062 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3d858-0280-4619-8f3a-0c465e370369 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:18.188264 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da5604-c3a8-4b9e-bc85-080af90ebcef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:18.188910 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da5604-c3a8-4b9e-bc85-080af90ebcef None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:18.189187 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da5604-c3a8-4b9e-bc85-080af90ebcef None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:18.189454 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da5604-c3a8-4b9e-bc85-080af90ebcef None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:18.190120 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49da5604-c3a8-4b9e-bc85-080af90ebcef None admin] RBAC: Adding query filter params (name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:18.190419 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49da5604-c3a8-4b9e-bc85-080af90ebcef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:18.191482 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd25df4-9942-42a9-95a9-7212075d00ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:18.191780 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49da5604-c3a8-4b9e-bc85-080af90ebcef None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:18.192427 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd25df4-9942-42a9-95a9-7212075d00ee None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:18.192938 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd25df4-9942-42a9-95a9-7212075d00ee None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:18.193414 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd25df4-9942-42a9-95a9-7212075d00ee None admin] PATH_INFO: `/v3/roles/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:18.200139 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 255/490] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Aug 29 22:14:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:18.200974 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da5604-c3a8-4b9e-bc85-080af90ebcef None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:18.209522 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd25df4-9942-42a9-95a9-7212075d00ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:14:18.215136 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-fdd25df4-9942-42a9-95a9-7212075d00ee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:14:18.215136 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:18.215136 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:18.215136 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:18.215136 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:18.215136 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:18.215136 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:18.215136 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:18.215136 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:18.215136 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:18.215136 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:18.215136 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:18.215136 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:14:18.215136 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:14:18.215136 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:14:18.215136 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:14:18.216211 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:14:18.216211 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:14:18.216211 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:14:18.216211 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:14:18.216211 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:18.216211 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:18.216211 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:18.216211 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:18.216211 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:18.216211 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:18.216211 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:18.216211 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:18.216211 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:18.216211 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:18.216211 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:18.216211 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:18.221649 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:18.221649 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:18.221649 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:18.221649 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:18.221649 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:14:18.221649 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:14:18.221649 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:14:18.221649 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:14:18.221649 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:14:18.221649 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:14:18.221649 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:14:18.221649 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:18.221649 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 236/491] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Aug 29 22:14:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:18.221649 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1a0b8-0933-489a-a289-401b052667e7 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:18.222357 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1a0b8-0933-489a-a289-401b052667e7 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:18.222357 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1a0b8-0933-489a-a289-401b052667e7 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:18.222357 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 237/492] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:14:18.222357 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1a0b8-0933-489a-a289-401b052667e7 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:18.275415 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:18.314987 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da5604-c3a8-4b9e-bc85-080af90ebcef None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:18.329210 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1a0b8-0933-489a-a289-401b052667e7 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:18.348505 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386efdcb-5844-4648-a9ec-6f1a48ce78fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:18.349148 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386efdcb-5844-4648-a9ec-6f1a48ce78fb None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:18.349429 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386efdcb-5844-4648-a9ec-6f1a48ce78fb None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:18.349702 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386efdcb-5844-4648-a9ec-6f1a48ce78fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:18.360027 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386efdcb-5844-4648-a9ec-6f1a48ce78fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:18.361511 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386efdcb-5844-4648-a9ec-6f1a48ce78fb None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:18.362307 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281331a3-fe97-4e7e-9e78-67b295038367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:18.362931 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281331a3-fe97-4e7e-9e78-67b295038367 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:18.363211 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281331a3-fe97-4e7e-9e78-67b295038367 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:18.363478 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281331a3-fe97-4e7e-9e78-67b295038367 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:18.373426 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281331a3-fe97-4e7e-9e78-67b295038367 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:18.374918 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281331a3-fe97-4e7e-9e78-67b295038367 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:18.375592 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-386efdcb-5844-4648-a9ec-6f1a48ce78fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:18.375592 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:18.375592 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:18.375592 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:18.375592 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:18.375592 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:18.375592 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:18.375592 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:18.375592 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:18.375592 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:18.375592 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:18.375592 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:18.375592 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:14:18.375592 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:14:18.375592 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:14:18.375592 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:14:18.376530 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:18.376530 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:18.376530 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:18.376530 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:18.376530 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:18.376530 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:18.376530 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:18.376530 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:18.376530 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:18.376530 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:18.376530 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:18.376530 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:18.376530 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:18.376530 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:18.376530 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:18.376530 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:18.376530 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:14:18.377564 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:14:18.377564 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:18.377564 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:18.377564 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 256/493] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:14:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:18.377564 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386efdcb-5844-4648-a9ec-6f1a48ce78fb None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:18.385669 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:18.394085 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-281331a3-fe97-4e7e-9e78-67b295038367 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:18.394085 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:18.394085 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:18.394085 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:18.394085 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:18.394085 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:18.394085 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:18.394085 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:18.394085 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:18.394085 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:18.394085 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:18.394085 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:18.394085 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:14:18.394085 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:14:18.394085 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:14:18.394085 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:14:18.395170 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:18.395170 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:18.395170 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:18.395170 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:18.395170 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:18.395170 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:18.395170 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:18.395170 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:18.395170 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:18.395170 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:18.395170 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:18.395170 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:18.395170 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:18.395170 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:18.395170 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:18.395170 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:18.395170 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:14:18.396176 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:14:18.396176 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:18.396176 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:18.396176 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 238/494] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:14:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:18.396387 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7d240-ff6e-4b7e-b745-ed0155180fe6 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:18.396680 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7d240-ff6e-4b7e-b745-ed0155180fe6 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:18.396950 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7d240-ff6e-4b7e-b745-ed0155180fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:18.414834 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-74b7d240-ff6e-4b7e-b745-ed0155180fe6 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:14:18.416036 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-74b7d240-ff6e-4b7e-b745-ed0155180fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:14:18.482572 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386efdcb-5844-4648-a9ec-6f1a48ce78fb None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:18.483851 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 239/495] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:14:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:14:18.485119 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3019435-62d1-4fa5-bf58-e4d7c118465e None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:18.485407 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3019435-62d1-4fa5-bf58-e4d7c118465e None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:18.485712 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3019435-62d1-4fa5-bf58-e4d7c118465e None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:18.486900 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 240/496] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:14:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:14:18.487591 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3019435-62d1-4fa5-bf58-e4d7c118465e None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:18.502922 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:18.525254 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e4ca1-3290-4e92-8728-f5aa6fb2c41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:18.525925 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e4ca1-3290-4e92-8728-f5aa6fb2c41a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:18.526151 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e4ca1-3290-4e92-8728-f5aa6fb2c41a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:18.526424 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e4ca1-3290-4e92-8728-f5aa6fb2c41a None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:18.527098 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2e4ca1-3290-4e92-8728-f5aa6fb2c41a None admin] RBAC: Adding query filter params (name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:18.527406 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2e4ca1-3290-4e92-8728-f5aa6fb2c41a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:18.528824 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2e4ca1-3290-4e92-8728-f5aa6fb2c41a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:18.536838 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 257/497] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Aug 29 22:14:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:18.537482 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e4ca1-3290-4e92-8728-f5aa6fb2c41a None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:18.606972 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3019435-62d1-4fa5-bf58-e4d7c118465e None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:18.636288 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:18.644590 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046ce6d8-27bf-4447-85f8-70c355d8eb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:18.645213 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ce6d8-27bf-4447-85f8-70c355d8eb54 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:18.645498 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ce6d8-27bf-4447-85f8-70c355d8eb54 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:18.645775 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ce6d8-27bf-4447-85f8-70c355d8eb54 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:18.646431 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046ce6d8-27bf-4447-85f8-70c355d8eb54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:18.646618 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e4ca1-3290-4e92-8728-f5aa6fb2c41a None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:18.646726 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046ce6d8-27bf-4447-85f8-70c355d8eb54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:18.648119 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046ce6d8-27bf-4447-85f8-70c355d8eb54 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:18.665968 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 241/498] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:14:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:18.665968 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbec232-62eb-4564-9906-212fa95ff028 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:18.665968 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbec232-62eb-4564-9906-212fa95ff028 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:18.665968 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbec232-62eb-4564-9906-212fa95ff028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:18.683369 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-6dbec232-62eb-4564-9906-212fa95ff028 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:14:18.684635 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-6dbec232-62eb-4564-9906-212fa95ff028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:14:18.690251 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01418b5-93e9-4d0d-b6a5-e03620037a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:18.690873 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01418b5-93e9-4d0d-b6a5-e03620037a0d None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:18.691155 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01418b5-93e9-4d0d-b6a5-e03620037a0d None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:18.691428 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01418b5-93e9-4d0d-b6a5-e03620037a0d None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:18.692076 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01418b5-93e9-4d0d-b6a5-e03620037a0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:18.692378 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01418b5-93e9-4d0d-b6a5-e03620037a0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:18.694179 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01418b5-93e9-4d0d-b6a5-e03620037a0d None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:18.713397 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 258/499] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:14:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:18.713397 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01418b5-93e9-4d0d-b6a5-e03620037a0d None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:18.755554 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:18.761764 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 242/500] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:14:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:14:18.762708 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbec232-62eb-4564-9906-212fa95ff028 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:18.818865 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01418b5-93e9-4d0d-b6a5-e03620037a0d None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:18.859928 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff80cb-189e-4b04-b11d-9717015f3fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:18.860772 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff80cb-189e-4b04-b11d-9717015f3fff None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:18.861055 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff80cb-189e-4b04-b11d-9717015f3fff None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:18.861329 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff80cb-189e-4b04-b11d-9717015f3fff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:18.872803 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ff80cb-189e-4b04-b11d-9717015f3fff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:18.874302 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ff80cb-189e-4b04-b11d-9717015f3fff None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:18.882806 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbec232-62eb-4564-9906-212fa95ff028 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:18.890886 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-b9ff80cb-189e-4b04-b11d-9717015f3fff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:18.890886 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:18.890886 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:18.890886 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:18.890886 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:18.890886 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:18.890886 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:18.890886 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:18.890886 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:18.890886 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:18.890886 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:18.890886 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:18.890886 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:14:18.890886 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:14:18.890886 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:14:18.890886 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:14:18.891841 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:18.891841 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:18.891841 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:18.891841 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:18.891841 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:18.891841 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:18.891841 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:18.891841 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:18.891841 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:18.891841 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:18.891841 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:18.891841 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:18.891841 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:18.891841 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:18.891841 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:18.891841 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:18.891841 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:14:18.892853 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:14:18.892853 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:18.892853 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:18.892853 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 259/501] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:14:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:18.892853 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff80cb-189e-4b04-b11d-9717015f3fff None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:18.913198 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:18.930740 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4738bb30-1df4-412c-b28d-8b9b18123d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:18.931386 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738bb30-1df4-412c-b28d-8b9b18123d77 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:18.931665 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738bb30-1df4-412c-b28d-8b9b18123d77 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:18.931935 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738bb30-1df4-412c-b28d-8b9b18123d77 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:18.939250 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4738bb30-1df4-412c-b28d-8b9b18123d77 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:18.940741 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4738bb30-1df4-412c-b28d-8b9b18123d77 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:18.954324 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-4738bb30-1df4-412c-b28d-8b9b18123d77 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:14:18.954324 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:18.954324 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:18.954324 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:18.954324 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:18.954324 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:18.954324 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:18.954324 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:18.954324 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:18.954324 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:18.954324 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:18.954324 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:18.954324 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:14:18.954324 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:14:18.954324 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:14:18.954324 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:14:18.955274 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:18.955274 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:18.955274 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:14:18.955274 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:14:18.955274 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:14:18.955274 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:14:18.955274 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:18.955274 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:18.955274 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:18.955274 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:18.955274 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:18.955274 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:18.955274 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:18.955274 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:18.955274 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:18.955274 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:18.955274 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:18.955274 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:18.956220 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:18.956220 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:18.956220 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:14:18.956220 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:14:18.956220 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:14:18.956220 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:14:18.956220 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:14:18.956220 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:14:18.956220 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:14:18.956220 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:18.956220 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 243/502] 10.222.0.36 () {56 vars in 1093 bytes} [Mon Aug 29 22:14:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:18.956220 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4738bb30-1df4-412c-b28d-8b9b18123d77 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:18.989872 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:19.001084 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff80cb-189e-4b04-b11d-9717015f3fff None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:19.035390 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ec750-b48c-4697-b193-74dff0351710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:19.036022 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ec750-b48c-4697-b193-74dff0351710 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:19.036306 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ec750-b48c-4697-b193-74dff0351710 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:19.036602 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ec750-b48c-4697-b193-74dff0351710 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:19.044644 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045ec750-b48c-4697-b193-74dff0351710 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:19.046091 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045ec750-b48c-4697-b193-74dff0351710 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:19.058548 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-045ec750-b48c-4697-b193-74dff0351710 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 29 22:14:19.058548 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:19.058548 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:19.058548 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:19.058548 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:19.058548 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:19.058548 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:19.058548 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:19.058548 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:19.058548 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:19.058548 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:19.058548 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:19.058548 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:14:19.058548 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:14:19.058548 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:14:19.058548 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:14:19.059515 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:19.059515 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:19.059515 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:14:19.059515 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:14:19.059515 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:14:19.059515 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:14:19.059515 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:19.059515 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:19.059515 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:19.059515 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:19.059515 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:19.059515 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:19.059515 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:19.059515 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:19.059515 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:19.059515 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:19.059515 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:19.059515 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:19.060409 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:19.060409 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:19.060409 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:14:19.060409 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:14:19.060409 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:14:19.060409 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:14:19.060409 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:14:19.060409 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:14:19.060409 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 29 22:14:19.060409 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:19.060409 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 260/503] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:14:18 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:19.061014 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ec750-b48c-4697-b193-74dff0351710 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:19.063297 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4738bb30-1df4-412c-b28d-8b9b18123d77 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:19.096382 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ceddf8-b8c0-4155-90c7-63632d96dd37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:19.096960 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ceddf8-b8c0-4155-90c7-63632d96dd37 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:19.097241 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ceddf8-b8c0-4155-90c7-63632d96dd37 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:19.097516 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ceddf8-b8c0-4155-90c7-63632d96dd37 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:19.107981 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ceddf8-b8c0-4155-90c7-63632d96dd37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:14:19.113266 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-41ceddf8-b8c0-4155-90c7-63632d96dd37 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:14:19.113266 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:19.113266 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:19.113266 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:19.113266 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:19.113266 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:19.113266 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:19.113266 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:19.113266 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:19.113266 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:19.113266 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:19.113266 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:19.113266 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:14:19.113266 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:14:19.113266 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:14:19.113266 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:14:19.114314 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:14:19.114314 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:14:19.114314 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:14:19.114314 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:14:19.114314 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:19.114314 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:19.114314 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:19.114314 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:19.114314 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:19.114314 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:19.114314 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:19.114314 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:19.114314 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:19.114314 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:19.114314 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:19.114314 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:19.115120 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:19.115120 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:19.115120 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:19.115120 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:19.115120 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:14:19.115120 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:14:19.115120 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:14:19.115120 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:14:19.115120 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:14:19.115120 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:14:19.115120 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:14:19.115120 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:19.115120 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 244/504] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Aug 29 22:14:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:19.115779 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ceddf8-b8c0-4155-90c7-63632d96dd37 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:19.158326 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:19.164551 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ec750-b48c-4697-b193-74dff0351710 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:19.198746 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5443a1e3-d00b-4709-9103-94e637db053a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:19.199345 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443a1e3-d00b-4709-9103-94e637db053a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:19.199624 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443a1e3-d00b-4709-9103-94e637db053a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:19.199897 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443a1e3-d00b-4709-9103-94e637db053a None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:19.200577 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5443a1e3-d00b-4709-9103-94e637db053a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:19.200881 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5443a1e3-d00b-4709-9103-94e637db053a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:19.202273 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5443a1e3-d00b-4709-9103-94e637db053a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:19.213938 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 261/505] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:14:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:19.214730 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5443a1e3-d00b-4709-9103-94e637db053a None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:19.221505 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ceddf8-b8c0-4155-90c7-63632d96dd37 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:19.226086 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:19.256570 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a29e3b9-680f-4418-a46e-4f03bff5b91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:19.257176 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a29e3b9-680f-4418-a46e-4f03bff5b91e None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:19.257456 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a29e3b9-680f-4418-a46e-4f03bff5b91e None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:19.257725 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a29e3b9-680f-4418-a46e-4f03bff5b91e None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:19.258647 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a29e3b9-680f-4418-a46e-4f03bff5b91e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:19.259064 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a29e3b9-680f-4418-a46e-4f03bff5b91e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:19.260587 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a29e3b9-680f-4418-a46e-4f03bff5b91e None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:19.297455 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 245/506] 10.222.0.36 () {56 vars in 1133 bytes} [Mon Aug 29 22:14:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:19.298289 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a29e3b9-680f-4418-a46e-4f03bff5b91e None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:19.313207 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5443a1e3-d00b-4709-9103-94e637db053a None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:19.348575 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb94358-109b-46cd-bdcb-ef8285137974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:19.349137 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb94358-109b-46cd-bdcb-ef8285137974 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:19.349418 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb94358-109b-46cd-bdcb-ef8285137974 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:19.349692 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb94358-109b-46cd-bdcb-ef8285137974 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:19.360560 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb94358-109b-46cd-bdcb-ef8285137974 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:19.362052 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb94358-109b-46cd-bdcb-ef8285137974 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:19.377212 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-feb94358-109b-46cd-bdcb-ef8285137974 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:19.377212 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:19.377212 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:19.377212 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:19.377212 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:19.377212 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:19.377212 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:19.377212 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:19.377212 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:19.377212 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:19.377212 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:19.377212 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:19.377212 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:14:19.377212 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:14:19.377212 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:14:19.377212 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:14:19.378187 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:19.378187 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:19.378187 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:19.378187 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:19.378187 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:19.378187 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:19.378187 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:19.378187 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:19.378187 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:19.378187 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:19.378187 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:19.378187 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:19.378187 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:19.378187 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:19.378187 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:19.378187 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:19.378187 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:14:19.379056 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:14:19.379056 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:19.379056 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:19.379056 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 262/507] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:14:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:19.379269 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb94358-109b-46cd-bdcb-ef8285137974 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:19.399406 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:19.403281 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a29e3b9-680f-4418-a46e-4f03bff5b91e None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:19.436706 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a4d57-f3b2-4df9-b7d0-2dc20c2308a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:19.437313 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a4d57-f3b2-4df9-b7d0-2dc20c2308a7 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:19.437592 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a4d57-f3b2-4df9-b7d0-2dc20c2308a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:19.437863 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a4d57-f3b2-4df9-b7d0-2dc20c2308a7 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:19.438594 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971a4d57-f3b2-4df9-b7d0-2dc20c2308a7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:19.438896 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971a4d57-f3b2-4df9-b7d0-2dc20c2308a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:19.440336 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971a4d57-f3b2-4df9-b7d0-2dc20c2308a7 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:19.442221 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:19.457628 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 246/508] 10.222.0.36 () {56 vars in 1137 bytes} [Mon Aug 29 22:14:19 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:19.458444 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a4d57-f3b2-4df9-b7d0-2dc20c2308a7 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:19.486008 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb94358-109b-46cd-bdcb-ef8285137974 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:19.520092 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8cfec-cc42-48f6-8276-815da5ab66c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:19.520747 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8cfec-cc42-48f6-8276-815da5ab66c5 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:19.521023 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8cfec-cc42-48f6-8276-815da5ab66c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:19.521296 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8cfec-cc42-48f6-8276-815da5ab66c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:19.521956 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8cfec-cc42-48f6-8276-815da5ab66c5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:19.522257 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8cfec-cc42-48f6-8276-815da5ab66c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:19.523628 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8cfec-cc42-48f6-8276-815da5ab66c5 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:19.531411 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 263/509] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Aug 29 22:14:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:19.532208 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8cfec-cc42-48f6-8276-815da5ab66c5 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:19.560118 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a4d57-f3b2-4df9-b7d0-2dc20c2308a7 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:19.595300 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a0a50a-6462-48e3-869a-5b617adee1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:19.596181 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a0a50a-6462-48e3-869a-5b617adee1ff None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:19.596181 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a0a50a-6462-48e3-869a-5b617adee1ff None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:19.596475 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a0a50a-6462-48e3-869a-5b617adee1ff None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:19.604243 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a0a50a-6462-48e3-869a-5b617adee1ff None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:19.605669 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a0a50a-6462-48e3-869a-5b617adee1ff None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:19.616954 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-d5a0a50a-6462-48e3-869a-5b617adee1ff None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 22:14:19.616954 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:19.616954 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:19.616954 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:19.616954 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:19.616954 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:19.616954 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:19.616954 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:19.616954 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:19.616954 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:19.616954 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:19.616954 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:19.616954 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:14:19.616954 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:14:19.616954 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:14:19.616954 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:14:19.618007 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:19.618007 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:19.618007 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:14:19.618007 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:14:19.618007 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:14:19.618007 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:14:19.618007 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:19.618007 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:19.618007 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:19.618007 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:19.618007 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:19.618007 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:19.618007 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:19.618007 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:19.618007 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:19.618007 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:19.618007 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:19.618007 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:19.619003 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:19.619003 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:19.619003 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:14:19.619003 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:14:19.619003 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:14:19.619003 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:14:19.619003 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:14:19.619003 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:14:19.619003 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 22:14:19.619003 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:19.619003 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 247/510] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:14:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:19.619619 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a0a50a-6462-48e3-869a-5b617adee1ff None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:19.637415 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:19.641288 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8cfec-cc42-48f6-8276-815da5ab66c5 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:19.665640 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:19.676761 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7300f88a-ce32-4bc4-bf14-1a6b775b674e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:19.677376 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300f88a-ce32-4bc4-bf14-1a6b775b674e None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:19.677656 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300f88a-ce32-4bc4-bf14-1a6b775b674e None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:19.677929 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300f88a-ce32-4bc4-bf14-1a6b775b674e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:19.725246 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a0a50a-6462-48e3-869a-5b617adee1ff None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:19.750020 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7300f88a-ce32-4bc4-bf14-1a6b775b674e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:19.751494 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7300f88a-ce32-4bc4-bf14-1a6b775b674e None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:19.757497 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2b2c5c-2738-4503-af06-514bc82410a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:19.758153 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b2c5c-2738-4503-af06-514bc82410a0 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:19.758475 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b2c5c-2738-4503-af06-514bc82410a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:19.758710 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b2c5c-2738-4503-af06-514bc82410a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:19.759520 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2b2c5c-2738-4503-af06-514bc82410a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:19.759826 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2b2c5c-2738-4503-af06-514bc82410a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:19.761210 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2b2c5c-2738-4503-af06-514bc82410a0 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:19.772955 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 248/511] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:14:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:19.773878 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2b2c5c-2738-4503-af06-514bc82410a0 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:19.848705 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:19.854034 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 264/512] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:14:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:14:19.854941 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7300f88a-ce32-4bc4-bf14-1a6b775b674e None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:19.878162 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2b2c5c-2738-4503-af06-514bc82410a0 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:19.879375 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:19.915554 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fda794-4904-40a9-a82b-fdc55b578d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:19.916162 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fda794-4904-40a9-a82b-fdc55b578d00 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:19.916466 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fda794-4904-40a9-a82b-fdc55b578d00 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:19.916748 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fda794-4904-40a9-a82b-fdc55b578d00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:19.952717 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7300f88a-ce32-4bc4-bf14-1a6b775b674e None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:19.982899 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fda794-4904-40a9-a82b-fdc55b578d00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:19.984368 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fda794-4904-40a9-a82b-fdc55b578d00 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:19.986777 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78628e6b-78c0-4d31-8fcf-1b1c0021c916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:19.987411 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78628e6b-78c0-4d31-8fcf-1b1c0021c916 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:19.987690 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78628e6b-78c0-4d31-8fcf-1b1c0021c916 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:19.987959 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78628e6b-78c0-4d31-8fcf-1b1c0021c916 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:19.997959 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78628e6b-78c0-4d31-8fcf-1b1c0021c916 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:19.999403 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78628e6b-78c0-4d31-8fcf-1b1c0021c916 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:20.014231 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-78628e6b-78c0-4d31-8fcf-1b1c0021c916 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:20.014231 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:20.014231 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:20.014231 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:20.014231 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:20.014231 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:20.014231 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:20.014231 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:20.014231 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:20.014231 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:20.014231 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:20.014231 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:20.014231 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:14:20.014231 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:14:20.014231 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:14:20.014231 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:14:20.015512 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:20.015512 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:20.015512 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:20.015512 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:20.015512 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:20.015512 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:20.015512 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:20.015512 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:20.015512 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:20.015512 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:20.015512 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:20.015512 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:20.015512 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:20.015512 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:20.015512 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:20.015512 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:20.015512 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:14:20.016382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:14:20.016382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:20.016382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:20.016382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 265/513] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:14:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:20.016382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78628e6b-78c0-4d31-8fcf-1b1c0021c916 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:20.060838 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:20.091191 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 249/514] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:14:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:14:20.091191 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fda794-4904-40a9-a82b-fdc55b578d00 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:20.105659 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:20.129657 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78628e6b-78c0-4d31-8fcf-1b1c0021c916 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:20.162486 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617f34a-ac56-4e7f-8c6c-b6146cbbc6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:20.163090 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617f34a-ac56-4e7f-8c6c-b6146cbbc6ab None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:20.163367 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617f34a-ac56-4e7f-8c6c-b6146cbbc6ab None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:20.163639 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617f34a-ac56-4e7f-8c6c-b6146cbbc6ab None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:20.164392 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a617f34a-ac56-4e7f-8c6c-b6146cbbc6ab None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:20.165102 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a617f34a-ac56-4e7f-8c6c-b6146cbbc6ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:20.166245 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a617f34a-ac56-4e7f-8c6c-b6146cbbc6ab None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:20.190235 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fda794-4904-40a9-a82b-fdc55b578d00 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:20.202479 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 266/515] 10.222.0.36 () {56 vars in 1137 bytes} [Mon Aug 29 22:14:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:20.203302 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617f34a-ac56-4e7f-8c6c-b6146cbbc6ab None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:20.225641 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b402a-0963-4831-ba63-4a7bd0310d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:20.226254 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b402a-0963-4831-ba63-4a7bd0310d1c None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:20.226538 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b402a-0963-4831-ba63-4a7bd0310d1c None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:20.227021 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b402a-0963-4831-ba63-4a7bd0310d1c None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:20.227879 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b402a-0963-4831-ba63-4a7bd0310d1c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:20.229325 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b402a-0963-4831-ba63-4a7bd0310d1c None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:20.250759 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 250/516] 10.222.0.36 () {60 vars in 1132 bytes} [Mon Aug 29 22:14:20 2022] POST /identity/v3/users => generated 247 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:14:20.250759 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b402a-0963-4831-ba63-4a7bd0310d1c None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:20.294669 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:20.325070 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617f34a-ac56-4e7f-8c6c-b6146cbbc6ab None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:20.361367 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e53a6-311f-47bf-8144-a3c81b0df8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:20.361922 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e53a6-311f-47bf-8144-a3c81b0df8c5 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:20.362208 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e53a6-311f-47bf-8144-a3c81b0df8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:20.362461 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e53a6-311f-47bf-8144-a3c81b0df8c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:20.364720 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:20.376442 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5e53a6-311f-47bf-8144-a3c81b0df8c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:20.377092 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b402a-0963-4831-ba63-4a7bd0310d1c None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:20.377988 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5e53a6-311f-47bf-8144-a3c81b0df8c5 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:20.394924 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-4f5e53a6-311f-47bf-8144-a3c81b0df8c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:20.394924 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:20.394924 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:20.394924 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:20.394924 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:20.394924 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:20.394924 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:20.394924 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:20.394924 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:20.394924 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:20.394924 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:20.394924 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:20.394924 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:14:20.394924 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:14:20.394924 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:14:20.394924 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:14:20.396085 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:20.396085 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:20.396085 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:20.396085 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:20.396085 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:20.396085 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:20.396085 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:20.396085 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:20.396085 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:20.396085 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:20.396085 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:20.396085 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:20.396085 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:20.396085 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:20.396085 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:20.396085 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:20.396085 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:14:20.397001 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:14:20.397001 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:20.397001 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:20.397001 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 267/517] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:14:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:20.397639 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e53a6-311f-47bf-8144-a3c81b0df8c5 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:20.423255 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f4a0b6-a3c1-4619-b619-ff3b1df7e508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:20.423907 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4a0b6-a3c1-4619-b619-ff3b1df7e508 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:20.424190 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4a0b6-a3c1-4619-b619-ff3b1df7e508 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:20.424484 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4a0b6-a3c1-4619-b619-ff3b1df7e508 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:20.425168 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f4a0b6-a3c1-4619-b619-ff3b1df7e508 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:20.426190 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f4a0b6-a3c1-4619-b619-ff3b1df7e508 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:20.427556 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f4a0b6-a3c1-4619-b619-ff3b1df7e508 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:20.442201 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 251/518] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:20.443063 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f4a0b6-a3c1-4619-b619-ff3b1df7e508 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:20.512289 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e53a6-311f-47bf-8144-a3c81b0df8c5 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:20.539209 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:20.548486 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91416c7-6382-451f-9dc3-2340d3db0839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:20.549126 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91416c7-6382-451f-9dc3-2340d3db0839 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:20.549403 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91416c7-6382-451f-9dc3-2340d3db0839 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:20.549672 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91416c7-6382-451f-9dc3-2340d3db0839 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:20.549885 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f4a0b6-a3c1-4619-b619-ff3b1df7e508 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:20.561291 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91416c7-6382-451f-9dc3-2340d3db0839 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:20.562767 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91416c7-6382-451f-9dc3-2340d3db0839 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:20.577135 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-c91416c7-6382-451f-9dc3-2340d3db0839 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:20.577135 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:20.577135 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:20.577135 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:20.577135 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:20.577135 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:20.577135 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:20.577135 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:20.577135 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:20.577135 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:20.577135 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:20.577135 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:20.577135 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:14:20.577135 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:14:20.577135 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:14:20.577135 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:14:20.578099 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:20.578099 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:20.578099 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:20.578099 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:20.578099 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:20.578099 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:20.578099 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:20.578099 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:20.578099 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:20.578099 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:20.578099 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:20.578099 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:20.578099 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:20.578099 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:20.578099 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:20.578099 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:20.578099 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:14:20.578934 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:14:20.578934 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:20.578934 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:20.578934 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 268/519] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:14:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:20.579157 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91416c7-6382-451f-9dc3-2340d3db0839 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:20.591131 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d80f46d-743c-4c17-8515-4a92ca65e4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:20.592037 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80f46d-743c-4c17-8515-4a92ca65e4aa None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:20.592529 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80f46d-743c-4c17-8515-4a92ca65e4aa None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:20.592997 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80f46d-743c-4c17-8515-4a92ca65e4aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:20.623351 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:20.669238 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d80f46d-743c-4c17-8515-4a92ca65e4aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:20.670706 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d80f46d-743c-4c17-8515-4a92ca65e4aa None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:20.690624 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91416c7-6382-451f-9dc3-2340d3db0839 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:20.730210 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa5d2b-2108-4025-a354-57cd78ccceb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:20.731078 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa5d2b-2108-4025-a354-57cd78ccceb5 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:20.731507 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa5d2b-2108-4025-a354-57cd78ccceb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:20.731942 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa5d2b-2108-4025-a354-57cd78ccceb5 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:20.732629 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aa5d2b-2108-4025-a354-57cd78ccceb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:20.732940 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aa5d2b-2108-4025-a354-57cd78ccceb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:20.734337 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aa5d2b-2108-4025-a354-57cd78ccceb5 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:20.750278 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 269/520] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:20.750278 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa5d2b-2108-4025-a354-57cd78ccceb5 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:20.775266 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:20.790528 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 252/521] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:14:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:14:20.790528 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d80f46d-743c-4c17-8515-4a92ca65e4aa None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:20.856839 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:20.860182 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa5d2b-2108-4025-a354-57cd78ccceb5 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:20.902375 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de4409-ccaa-4cf5-b7c4-fffc1da8b0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:20.903013 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de4409-ccaa-4cf5-b7c4-fffc1da8b0ac None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:20.903290 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de4409-ccaa-4cf5-b7c4-fffc1da8b0ac None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:20.903557 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de4409-ccaa-4cf5-b7c4-fffc1da8b0ac None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:20.904923 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d80f46d-743c-4c17-8515-4a92ca65e4aa None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:20.911127 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93de4409-ccaa-4cf5-b7c4-fffc1da8b0ac None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:20.912615 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93de4409-ccaa-4cf5-b7c4-fffc1da8b0ac None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:20.924653 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-93de4409-ccaa-4cf5-b7c4-fffc1da8b0ac None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 22:14:20.924653 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:20.924653 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:20.924653 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:20.924653 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:20.924653 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:20.924653 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:20.924653 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:20.924653 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:20.924653 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:20.924653 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:20.924653 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:20.924653 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:14:20.924653 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:14:20.924653 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:14:20.924653 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:14:20.925571 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:20.925571 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:20.925571 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:14:20.925571 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:14:20.925571 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:14:20.925571 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:14:20.925571 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:20.925571 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:20.925571 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:20.925571 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:20.925571 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:20.925571 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:20.925571 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:20.925571 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:20.925571 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:20.925571 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:20.925571 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:20.925571 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:20.926501 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:20.926501 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:20.926501 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:14:20.926501 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:14:20.926501 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:14:20.926501 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:14:20.926501 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:14:20.926501 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:14:20.926501 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 22:14:20.926501 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:20.926501 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 270/522] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Aug 29 22:14:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:20.931171 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de4409-ccaa-4cf5-b7c4-fffc1da8b0ac None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:20.942945 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe1b03-7bfb-4c32-9c88-4cc44fac5405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:20.943571 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe1b03-7bfb-4c32-9c88-4cc44fac5405 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:20.943846 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe1b03-7bfb-4c32-9c88-4cc44fac5405 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:20.944126 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe1b03-7bfb-4c32-9c88-4cc44fac5405 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:20.944805 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fe1b03-7bfb-4c32-9c88-4cc44fac5405 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:20.945113 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fe1b03-7bfb-4c32-9c88-4cc44fac5405 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:20.946774 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fe1b03-7bfb-4c32-9c88-4cc44fac5405 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:20.958225 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 253/523] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:20.964012 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe1b03-7bfb-4c32-9c88-4cc44fac5405 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:21.018729 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:21.039090 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de4409-ccaa-4cf5-b7c4-fffc1da8b0ac None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:21.070632 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe1b03-7bfb-4c32-9c88-4cc44fac5405 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:21.080213 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa74c1c3-d658-4eed-b48a-7915605f8338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:21.080882 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74c1c3-d658-4eed-b48a-7915605f8338 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:21.081162 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74c1c3-d658-4eed-b48a-7915605f8338 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:21.081441 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74c1c3-d658-4eed-b48a-7915605f8338 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:21.088583 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa74c1c3-d658-4eed-b48a-7915605f8338 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:21.090025 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa74c1c3-d658-4eed-b48a-7915605f8338 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:21.101756 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-fa74c1c3-d658-4eed-b48a-7915605f8338 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:14:21.101756 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:21.101756 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:21.101756 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:21.101756 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:21.101756 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:21.101756 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:21.101756 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:21.101756 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:21.101756 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:21.101756 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:21.101756 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:21.101756 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:14:21.101756 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:14:21.101756 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:14:21.102870 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:14:21.102870 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:21.102870 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:21.102870 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:21.102870 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:21.102870 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:21.102870 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:21.102870 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:21.102870 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:21.102870 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:21.102870 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:21.102870 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:21.102870 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:21.102870 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:21.102870 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:21.102870 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:21.102870 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:21.103713 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:14:21.103713 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:14:21.103713 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:14:21.103713 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:14:21.103713 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:14:21.103713 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:14:21.103713 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:14:21.103713 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:21.103713 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 271/524] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Aug 29 22:14:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:21.104232 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa74c1c3-d658-4eed-b48a-7915605f8338 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:21.111923 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1fff54-c404-46f5-b8d2-822bd01d376f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:21.112604 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1fff54-c404-46f5-b8d2-822bd01d376f None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:21.112885 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1fff54-c404-46f5-b8d2-822bd01d376f None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:21.113163 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1fff54-c404-46f5-b8d2-822bd01d376f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:21.124388 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:21.125918 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1fff54-c404-46f5-b8d2-822bd01d376f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:21.127917 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1fff54-c404-46f5-b8d2-822bd01d376f None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:21.143799 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-3f1fff54-c404-46f5-b8d2-822bd01d376f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:21.143799 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:21.143799 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:21.143799 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:21.143799 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:21.143799 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:21.143799 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:21.143799 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:21.143799 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:21.143799 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:21.143799 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:21.143799 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:21.143799 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:14:21.143799 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:14:21.143799 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:14:21.143799 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:14:21.144775 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:21.144775 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:21.144775 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:21.144775 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:21.144775 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:21.144775 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:21.144775 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:21.144775 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:21.144775 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:21.144775 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:21.144775 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:21.144775 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:21.144775 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:21.144775 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:21.144775 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:21.144775 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:21.144775 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:14:21.151166 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:14:21.151166 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:21.151166 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:21.151166 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 254/525] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:14:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:21.151166 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1fff54-c404-46f5-b8d2-822bd01d376f None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:21.213694 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa74c1c3-d658-4eed-b48a-7915605f8338 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:21.249895 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c06f0-77a0-48c6-93ce-1678c36e3a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:21.250518 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c06f0-77a0-48c6-93ce-1678c36e3a05 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:21.250798 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c06f0-77a0-48c6-93ce-1678c36e3a05 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:21.250913 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1fff54-c404-46f5-b8d2-822bd01d376f None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:21.251356 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c06f0-77a0-48c6-93ce-1678c36e3a05 None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:21.251796 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9c06f0-77a0-48c6-93ce-1678c36e3a05 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:21.252103 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9c06f0-77a0-48c6-93ce-1678c36e3a05 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:21.253598 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9c06f0-77a0-48c6-93ce-1678c36e3a05 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:21.254107 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:21.279733 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 272/526] 10.222.0.36 () {56 vars in 1139 bytes} [Mon Aug 29 22:14:21 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:21.279733 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c06f0-77a0-48c6-93ce-1678c36e3a05 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:21.297590 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75981c7-5dd3-4ce6-ad9f-803fb1f25e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:21.298229 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75981c7-5dd3-4ce6-ad9f-803fb1f25e0d None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:21.298507 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75981c7-5dd3-4ce6-ad9f-803fb1f25e0d None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:21.298776 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75981c7-5dd3-4ce6-ad9f-803fb1f25e0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:21.306519 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75981c7-5dd3-4ce6-ad9f-803fb1f25e0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:21.307987 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75981c7-5dd3-4ce6-ad9f-803fb1f25e0d None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:21.319908 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-b75981c7-5dd3-4ce6-ad9f-803fb1f25e0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:14:21.319908 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:21.319908 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:21.319908 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:21.319908 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:21.319908 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:21.319908 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:21.319908 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:21.319908 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:21.319908 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:21.319908 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:21.319908 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:21.319908 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:14:21.319908 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:14:21.319908 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:14:21.320933 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:14:21.320933 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:21.320933 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:21.320933 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:21.320933 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:21.320933 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:21.320933 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:21.320933 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:21.320933 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:21.320933 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:21.320933 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:21.320933 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:21.320933 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:21.320933 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:21.320933 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:21.320933 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:21.320933 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:21.321967 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:14:21.321967 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:14:21.321967 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:14:21.321967 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:14:21.321967 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:14:21.321967 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:14:21.321967 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:14:21.321967 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:21.321967 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 255/527] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Aug 29 22:14:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:21.322436 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75981c7-5dd3-4ce6-ad9f-803fb1f25e0d None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:21.367751 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:21.406478 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c06f0-77a0-48c6-93ce-1678c36e3a05 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:21.449172 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61fedf-0ca3-4f41-a2a4-4f52fd6f9895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:21.450088 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61fedf-0ca3-4f41-a2a4-4f52fd6f9895 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:21.450434 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61fedf-0ca3-4f41-a2a4-4f52fd6f9895 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:21.450715 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61fedf-0ca3-4f41-a2a4-4f52fd6f9895 None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:21.451432 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a61fedf-0ca3-4f41-a2a4-4f52fd6f9895 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:21.451744 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a61fedf-0ca3-4f41-a2a4-4f52fd6f9895 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:21.452162 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75981c7-5dd3-4ce6-ad9f-803fb1f25e0d None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:21.453211 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a61fedf-0ca3-4f41-a2a4-4f52fd6f9895 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:21.477114 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 273/528] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Aug 29 22:14:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:21.477114 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61fedf-0ca3-4f41-a2a4-4f52fd6f9895 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:21.494686 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0373d0e-85b5-44c5-b926-c3a2994505b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:21.495353 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0373d0e-85b5-44c5-b926-c3a2994505b4 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:21.495633 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0373d0e-85b5-44c5-b926-c3a2994505b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:21.495950 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0373d0e-85b5-44c5-b926-c3a2994505b4 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:21.496670 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0373d0e-85b5-44c5-b926-c3a2994505b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:21.497091 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0373d0e-85b5-44c5-b926-c3a2994505b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:21.498513 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0373d0e-85b5-44c5-b926-c3a2994505b4 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:21.517015 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 256/529] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:14:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:21.517015 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0373d0e-85b5-44c5-b926-c3a2994505b4 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:21.545125 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:21.582690 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61fedf-0ca3-4f41-a2a4-4f52fd6f9895 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:21.618972 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b04af11-3d3b-4898-a578-1f5b85a8bb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:21.619594 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b04af11-3d3b-4898-a578-1f5b85a8bb03 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:21.619876 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b04af11-3d3b-4898-a578-1f5b85a8bb03 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:21.620261 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b04af11-3d3b-4898-a578-1f5b85a8bb03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:21.624356 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:21.626457 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0373d0e-85b5-44c5-b926-c3a2994505b4 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:21.662385 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04146c6c-89af-45c7-9b7f-fdbba19640f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:21.662919 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04146c6c-89af-45c7-9b7f-fdbba19640f0 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:21.663200 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04146c6c-89af-45c7-9b7f-fdbba19640f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:21.663472 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04146c6c-89af-45c7-9b7f-fdbba19640f0 None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:21.664159 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04146c6c-89af-45c7-9b7f-fdbba19640f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:21.664585 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04146c6c-89af-45c7-9b7f-fdbba19640f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:21.666083 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04146c6c-89af-45c7-9b7f-fdbba19640f0 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:21.690120 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 257/530] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Aug 29 22:14:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:21.690120 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04146c6c-89af-45c7-9b7f-fdbba19640f0 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:21.707595 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b04af11-3d3b-4898-a578-1f5b85a8bb03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:21.709596 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b04af11-3d3b-4898-a578-1f5b85a8bb03 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:21.813660 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:21.836196 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04146c6c-89af-45c7-9b7f-fdbba19640f0 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:21.843997 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 274/531] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:14:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:14:21.844895 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b04af11-3d3b-4898-a578-1f5b85a8bb03 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:21.881687 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:21.892073 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4801e6-d6cd-4f7f-a46b-92355a4b3eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:21.892812 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4801e6-d6cd-4f7f-a46b-92355a4b3eab None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:21.893092 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4801e6-d6cd-4f7f-a46b-92355a4b3eab None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:21.893477 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4801e6-d6cd-4f7f-a46b-92355a4b3eab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:21.894197 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4801e6-d6cd-4f7f-a46b-92355a4b3eab None admin] RBAC: Adding query filter params (role.id=bc7b902c0870483ba03c139d941f78ac, scope.project.id=696ed25cc0cb43fab4bfaf762a90da54, user.id=90b7213b7111456a93e294ce40b95b21) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:21.894704 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4801e6-d6cd-4f7f-a46b-92355a4b3eab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:21.896046 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4801e6-d6cd-4f7f-a46b-92355a4b3eab None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:21.912778 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 258/532] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Aug 29 22:14:21 2022] GET /identity/v3/role_assignments?user.id=90b7213b7111456a93e294ce40b95b21&scope.project.id=696ed25cc0cb43fab4bfaf762a90da54&role.id=bc7b902c0870483ba03c139d941f78ac => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:21.912778 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4801e6-d6cd-4f7f-a46b-92355a4b3eab None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:21.967679 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b04af11-3d3b-4898-a578-1f5b85a8bb03 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:22.007069 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17e6e9-507b-4628-a336-a6017341ab68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:22.007886 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17e6e9-507b-4628-a336-a6017341ab68 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:22.008517 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17e6e9-507b-4628-a336-a6017341ab68 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:22.008903 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17e6e9-507b-4628-a336-a6017341ab68 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:22.017364 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b17e6e9-507b-4628-a336-a6017341ab68 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:22.019056 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b17e6e9-507b-4628-a336-a6017341ab68 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:22.034438 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-7b17e6e9-507b-4628-a336-a6017341ab68 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:14:22.034438 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:22.034438 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:22.034438 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:22.034438 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:22.034438 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:22.034438 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:22.034438 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:22.034438 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:22.034438 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:22.034438 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:22.034438 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:22.034438 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:14:22.034438 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:14:22.034438 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:14:22.035375 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:14:22.035375 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:22.035375 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:22.035375 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:22.035375 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:22.035375 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:22.035375 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:22.035375 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:22.035375 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:22.035375 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:22.035375 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:22.035375 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:22.035375 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:22.035375 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:22.035375 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:22.035375 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:22.035375 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:22.036212 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:14:22.036212 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:14:22.036212 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:14:22.036212 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:14:22.036212 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:14:22.036212 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:14:22.036212 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:14:22.036212 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:22.036212 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 275/533] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Aug 29 22:14:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:22.037170 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17e6e9-507b-4628-a336-a6017341ab68 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:22.061022 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4801e6-d6cd-4f7f-a46b-92355a4b3eab None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:22.106409 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c864ad-7328-4dfd-add3-e63e6ecbc375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:22.107001 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c864ad-7328-4dfd-add3-e63e6ecbc375 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:22.107285 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c864ad-7328-4dfd-add3-e63e6ecbc375 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:22.107686 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c864ad-7328-4dfd-add3-e63e6ecbc375 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:22.108646 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c864ad-7328-4dfd-add3-e63e6ecbc375 None admin] RBAC: Adding query filter params (role.id=bc7b902c0870483ba03c139d941f78ac, scope.project.id=696ed25cc0cb43fab4bfaf762a90da54, user.id=e7a399ee5db44100a88a4ffb451512aa) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:22.109032 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c864ad-7328-4dfd-add3-e63e6ecbc375 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:22.110578 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c864ad-7328-4dfd-add3-e63e6ecbc375 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:22.116809 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 259/534] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Aug 29 22:14:21 2022] GET /identity/v3/role_assignments?user.id=e7a399ee5db44100a88a4ffb451512aa&scope.project.id=696ed25cc0cb43fab4bfaf762a90da54&role.id=bc7b902c0870483ba03c139d941f78ac => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:22.117968 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c864ad-7328-4dfd-add3-e63e6ecbc375 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:22.136325 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:22.170616 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:22.178967 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17e6e9-507b-4628-a336-a6017341ab68 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:22.219054 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cea995-cec0-4ca7-8d4b-d18cf11a8ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:22.220562 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cea995-cec0-4ca7-8d4b-d18cf11a8ca4 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:22.221070 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cea995-cec0-4ca7-8d4b-d18cf11a8ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:22.221725 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cea995-cec0-4ca7-8d4b-d18cf11a8ca4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:22.234861 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cea995-cec0-4ca7-8d4b-d18cf11a8ca4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:22.237203 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cea995-cec0-4ca7-8d4b-d18cf11a8ca4 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:22.239086 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c864ad-7328-4dfd-add3-e63e6ecbc375 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:22.254775 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-e1cea995-cec0-4ca7-8d4b-d18cf11a8ca4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:22.254775 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:22.254775 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:22.254775 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:22.254775 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:22.254775 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:22.254775 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:22.254775 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:22.254775 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:22.254775 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:22.254775 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:22.254775 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:22.254775 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:14:22.254775 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:14:22.254775 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:14:22.254775 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:14:22.255783 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:22.255783 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:22.255783 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:22.255783 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:22.255783 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:22.255783 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:22.255783 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:22.255783 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:22.255783 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:22.255783 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:22.255783 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:22.255783 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:22.255783 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:22.255783 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:22.255783 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:22.255783 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:22.255783 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:14:22.256714 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:14:22.256714 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:22.256714 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:22.257975 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 276/535] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:14:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:22.262910 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b390d4d-73e7-42db-8f3d-5b9885971675 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:22.262910 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b390d4d-73e7-42db-8f3d-5b9885971675 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:22.262910 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b390d4d-73e7-42db-8f3d-5b9885971675 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:22.264952 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 277/536] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:14:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:14:22.266438 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b390d4d-73e7-42db-8f3d-5b9885971675 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:22.288095 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ce876-e1bc-4773-a0e7-6096c856f042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:22.288836 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ce876-e1bc-4773-a0e7-6096c856f042 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:22.289041 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ce876-e1bc-4773-a0e7-6096c856f042 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:22.289373 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ce876-e1bc-4773-a0e7-6096c856f042 None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:22.290067 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4ce876-e1bc-4773-a0e7-6096c856f042 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:22.290371 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4ce876-e1bc-4773-a0e7-6096c856f042 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:22.292175 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4ce876-e1bc-4773-a0e7-6096c856f042 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:22.305781 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 260/537] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Aug 29 22:14:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:22.307101 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17597042-afc4-48bc-8d21-a768d8864e5d None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:22.307426 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17597042-afc4-48bc-8d21-a768d8864e5d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:22.307695 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17597042-afc4-48bc-8d21-a768d8864e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:22.326722 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-17597042-afc4-48bc-8d21-a768d8864e5d None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:14:22.328722 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-17597042-afc4-48bc-8d21-a768d8864e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:14:22.390305 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b390d4d-73e7-42db-8f3d-5b9885971675 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:22.417023 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 261/538] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:14:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:14:22.418294 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17597042-afc4-48bc-8d21-a768d8864e5d None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:22.447569 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdced8f8-7b32-47e9-bf84-78398a7708ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:22.448124 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdced8f8-7b32-47e9-bf84-78398a7708ea None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:22.448475 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdced8f8-7b32-47e9-bf84-78398a7708ea None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:22.448765 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdced8f8-7b32-47e9-bf84-78398a7708ea None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:22.449437 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdced8f8-7b32-47e9-bf84-78398a7708ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:22.449742 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdced8f8-7b32-47e9-bf84-78398a7708ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:22.451699 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdced8f8-7b32-47e9-bf84-78398a7708ea None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:22.460493 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:22.466388 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 278/539] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:14:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:22.473449 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdced8f8-7b32-47e9-bf84-78398a7708ea None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:22.497959 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:22.579772 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17597042-afc4-48bc-8d21-a768d8864e5d None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:22.614494 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84cce2-ce0c-46b6-8596-6a37f740d0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:22.615114 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84cce2-ce0c-46b6-8596-6a37f740d0cf None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:22.615395 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84cce2-ce0c-46b6-8596-6a37f740d0cf None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:22.615670 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84cce2-ce0c-46b6-8596-6a37f740d0cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:22.616681 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a84cce2-ce0c-46b6-8596-6a37f740d0cf None admin] RBAC: Adding query filter params (role.id=bc7b902c0870483ba03c139d941f78ac, scope.project.id=696ed25cc0cb43fab4bfaf762a90da54, user.id=d14db90aa108495e9c48584cdc2f7206) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:22.619757 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a84cce2-ce0c-46b6-8596-6a37f740d0cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:22.622296 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a84cce2-ce0c-46b6-8596-6a37f740d0cf None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:22.636370 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 262/540] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Aug 29 22:14:22 2022] GET /identity/v3/role_assignments?user.id=d14db90aa108495e9c48584cdc2f7206&scope.project.id=696ed25cc0cb43fab4bfaf762a90da54&role.id=bc7b902c0870483ba03c139d941f78ac => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:22.664248 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdced8f8-7b32-47e9-bf84-78398a7708ea None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:22.702909 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b5c0a-3699-46be-81a7-7e96c17b2224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:22.703520 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b5c0a-3699-46be-81a7-7e96c17b2224 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:22.703802 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b5c0a-3699-46be-81a7-7e96c17b2224 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:22.704075 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b5c0a-3699-46be-81a7-7e96c17b2224 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:22.712336 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8b5c0a-3699-46be-81a7-7e96c17b2224 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:22.713843 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8b5c0a-3699-46be-81a7-7e96c17b2224 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:22.726131 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-ea8b5c0a-3699-46be-81a7-7e96c17b2224 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:14:22.726131 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:22.726131 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:22.726131 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:22.726131 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:22.726131 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:22.726131 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:22.726131 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:22.726131 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:22.726131 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:22.726131 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:22.726131 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:22.726131 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:14:22.726131 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:14:22.726131 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:14:22.727117 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:14:22.727117 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:22.727117 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:22.727117 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:22.727117 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:22.727117 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:22.727117 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:22.727117 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:22.727117 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:22.727117 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:22.727117 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:22.727117 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:22.727117 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:22.727117 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:22.727117 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:22.727117 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:22.727117 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:22.727970 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:14:22.727970 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:14:22.727970 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:14:22.727970 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:14:22.727970 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:14:22.727970 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:14:22.727970 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:14:22.727970 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:22.728374 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 279/541] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Aug 29 22:14:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:22.733798 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84cce2-ce0c-46b6-8596-6a37f740d0cf None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:22.757699 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b5c0a-3699-46be-81a7-7e96c17b2224 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:22.821057 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:22.860485 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84cce2-ce0c-46b6-8596-6a37f740d0cf None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:22.860686 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:22.886872 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b5c0a-3699-46be-81a7-7e96c17b2224 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:22.927908 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb8287-b3f8-4a1c-967d-d9988bce0646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:22.928745 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb8287-b3f8-4a1c-967d-d9988bce0646 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:22.929028 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb8287-b3f8-4a1c-967d-d9988bce0646 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:22.929304 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb8287-b3f8-4a1c-967d-d9988bce0646 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:22.937762 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f840430-8ae5-433d-9243-54a227d55683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:22.938490 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f840430-8ae5-433d-9243-54a227d55683 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:22.938980 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f840430-8ae5-433d-9243-54a227d55683 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:22.939341 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f840430-8ae5-433d-9243-54a227d55683 None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:22.941083 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f840430-8ae5-433d-9243-54a227d55683 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:22.941390 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f840430-8ae5-433d-9243-54a227d55683 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:22.943805 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f840430-8ae5-433d-9243-54a227d55683 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:22.948631 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cb8287-b3f8-4a1c-967d-d9988bce0646 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:14:22.955516 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-52cb8287-b3f8-4a1c-967d-d9988bce0646 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:14:22.955516 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:22.955516 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:22.955516 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:22.955516 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:22.955516 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:22.955516 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:22.955516 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:22.955516 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:22.955516 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:22.955516 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:22.955516 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:22.955516 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:14:22.955516 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:14:22.955516 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:14:22.955516 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:14:22.956412 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:14:22.956412 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:14:22.956412 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:14:22.956412 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:14:22.956412 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:22.956412 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:22.956412 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:22.956412 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:22.956412 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:22.956412 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:22.956412 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:22.956412 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:22.956412 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:22.956412 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:22.956412 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:22.956412 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:22.957275 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:22.957275 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:22.957275 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:22.957275 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:22.957275 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:14:22.957275 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:14:22.957275 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:14:22.957275 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:14:22.957275 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:14:22.957275 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:14:22.957275 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:14:22.957275 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:22.957894 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 263/542] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Aug 29 22:14:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:22.957976 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 280/543] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Aug 29 22:14:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:14:22.963353 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb8287-b3f8-4a1c-967d-d9988bce0646 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:22.963567 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f840430-8ae5-433d-9243-54a227d55683 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:23.103483 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f840430-8ae5-433d-9243-54a227d55683 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:23.115086 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb8287-b3f8-4a1c-967d-d9988bce0646 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:23.142803 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:23.150602 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde7a57e-90f7-45e6-9776-d923dafb438d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:23.151322 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7a57e-90f7-45e6-9776-d923dafb438d None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:23.151959 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7a57e-90f7-45e6-9776-d923dafb438d None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:23.151959 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7a57e-90f7-45e6-9776-d923dafb438d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:23.152700 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde7a57e-90f7-45e6-9776-d923dafb438d None admin] RBAC: Adding query filter params (role.id=bc7b902c0870483ba03c139d941f78ac, scope.project.id=696ed25cc0cb43fab4bfaf762a90da54, user.id=204c597d751c420796bd972f10a3d149) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:23.153046 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde7a57e-90f7-45e6-9776-d923dafb438d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:23.154665 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde7a57e-90f7-45e6-9776-d923dafb438d None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:23.158099 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:23.161755 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 281/544] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Aug 29 22:14:22 2022] GET /identity/v3/role_assignments?user.id=204c597d751c420796bd972f10a3d149&scope.project.id=696ed25cc0cb43fab4bfaf762a90da54&role.id=bc7b902c0870483ba03c139d941f78ac => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:23.194709 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc0a25e-c00a-4041-ab09-a577c9c39979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:23.195344 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0a25e-c00a-4041-ab09-a577c9c39979 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:23.195662 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0a25e-c00a-4041-ab09-a577c9c39979 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:23.195934 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0a25e-c00a-4041-ab09-a577c9c39979 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:23.196648 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc0a25e-c00a-4041-ab09-a577c9c39979 None admin] RBAC: Adding query filter params (name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:23.196954 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc0a25e-c00a-4041-ab09-a577c9c39979 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:23.198357 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc0a25e-c00a-4041-ab09-a577c9c39979 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:23.216272 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 264/545] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Aug 29 22:14:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:23.221786 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde7a57e-90f7-45e6-9776-d923dafb438d None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:23.366653 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde7a57e-90f7-45e6-9776-d923dafb438d None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:23.407737 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7278cd-3e6c-4773-a88b-d716e1081280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:23.408398 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7278cd-3e6c-4773-a88b-d716e1081280 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:23.409134 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7278cd-3e6c-4773-a88b-d716e1081280 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:23.409134 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7278cd-3e6c-4773-a88b-d716e1081280 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:23.425575 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7278cd-3e6c-4773-a88b-d716e1081280 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:23.427072 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7278cd-3e6c-4773-a88b-d716e1081280 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:23.444395 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-ae7278cd-3e6c-4773-a88b-d716e1081280 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:23.444395 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:23.444395 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:23.444395 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:23.444395 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:23.444395 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:23.444395 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:23.444395 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:23.444395 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:23.444395 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:23.444395 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:23.444395 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:23.444395 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:14:23.444395 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:14:23.444395 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:14:23.444395 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:14:23.445383 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:23.445383 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:23.445383 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:23.445383 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:23.445383 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:23.445383 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:23.445383 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:23.445383 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:23.445383 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:23.445383 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:23.445383 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:23.445383 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:23.445383 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:23.445383 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:23.445383 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:23.445383 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:23.445383 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:14:23.446430 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:14:23.446430 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:23.446430 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:23.446430 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 282/546] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:14:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:23.451662 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc0a25e-c00a-4041-ab09-a577c9c39979 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:23.591312 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc0a25e-c00a-4041-ab09-a577c9c39979 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:23.635134 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd0cb1-8b49-4ce3-88bb-92c2d07f99ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:23.635747 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd0cb1-8b49-4ce3-88bb-92c2d07f99ef None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:23.636027 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd0cb1-8b49-4ce3-88bb-92c2d07f99ef None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:23.636299 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd0cb1-8b49-4ce3-88bb-92c2d07f99ef None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:23.636971 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd0cb1-8b49-4ce3-88bb-92c2d07f99ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:23.637275 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd0cb1-8b49-4ce3-88bb-92c2d07f99ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:23.638648 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd0cb1-8b49-4ce3-88bb-92c2d07f99ef None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:23.656024 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 265/547] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:14:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:23.661479 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7278cd-3e6c-4773-a88b-d716e1081280 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:23.742839 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:23.815412 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7278cd-3e6c-4773-a88b-d716e1081280 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:23.848997 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab70655-3daa-4404-903a-b93318e120cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:23.849551 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab70655-3daa-4404-903a-b93318e120cd None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:23.849828 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab70655-3daa-4404-903a-b93318e120cd None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:23.850094 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab70655-3daa-4404-903a-b93318e120cd None admin] PATH_INFO: `/v3/users/swift` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:23.860615 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab70655-3daa-4404-903a-b93318e120cd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:23.862088 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab70655-3daa-4404-903a-b93318e120cd None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:23.873542 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-6ab70655-3daa-4404-903a-b93318e120cd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 22:14:23.873542 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:23.873542 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:23.873542 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:23.873542 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:23.873542 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:23.873542 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:23.873542 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:23.873542 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:23.873542 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:23.873542 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:23.873542 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:23.873542 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:14:23.873542 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:14:23.873542 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:14:23.873542 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:14:23.875253 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:23.875253 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:23.875253 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:14:23.875253 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:14:23.875253 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:14:23.875253 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:14:23.875253 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:23.875253 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:23.875253 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:23.875253 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:23.875253 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:23.875253 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:23.875253 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:23.875253 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:23.875253 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:23.875253 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:23.875253 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:23.875253 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:23.876671 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:23.876671 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:23.876671 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:14:23.876671 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:14:23.876671 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:14:23.876671 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:14:23.876671 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:14:23.876671 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:14:23.876671 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 22:14:23.876671 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:23.876671 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 283/548] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Aug 29 22:14:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:23.880937 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd0cb1-8b49-4ce3-88bb-92c2d07f99ef None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:23.938842 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:24.003422 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd0cb1-8b49-4ce3-88bb-92c2d07f99ef None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:24.050617 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9059801-ae16-4669-81d9-cbef401cdd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:24.051245 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9059801-ae16-4669-81d9-cbef401cdd72 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:24.051525 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9059801-ae16-4669-81d9-cbef401cdd72 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:24.051796 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9059801-ae16-4669-81d9-cbef401cdd72 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:24.052555 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9059801-ae16-4669-81d9-cbef401cdd72 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:24.052860 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9059801-ae16-4669-81d9-cbef401cdd72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:24.054295 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9059801-ae16-4669-81d9-cbef401cdd72 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:24.088009 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 266/549] 10.222.0.36 () {56 vars in 1135 bytes} [Mon Aug 29 22:14:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:24.093755 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab70655-3daa-4404-903a-b93318e120cd None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:24.179689 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db71f0-b701-4409-8958-18e4b26685a3 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:24.179894 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db71f0-b701-4409-8958-18e4b26685a3 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:24.180177 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db71f0-b701-4409-8958-18e4b26685a3 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:24.181747 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 267/550] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:14:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:14:24.187150 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41348ca2-f941-4388-9829-c90dd5b837d6 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:24.187430 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41348ca2-f941-4388-9829-c90dd5b837d6 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:24.187698 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41348ca2-f941-4388-9829-c90dd5b837d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:24.209451 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-41348ca2-f941-4388-9829-c90dd5b837d6 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:14:24.210750 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-41348ca2-f941-4388-9829-c90dd5b837d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:14:24.225544 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab70655-3daa-4404-903a-b93318e120cd None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:24.229741 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:24.293991 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03acbc3-34e3-4b3a-ae45-8f8781d1e94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:24.294929 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03acbc3-34e3-4b3a-ae45-8f8781d1e94f None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:24.295376 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03acbc3-34e3-4b3a-ae45-8f8781d1e94f None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:24.295941 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03acbc3-34e3-4b3a-ae45-8f8781d1e94f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:24.312813 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 268/551] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:14:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:14:24.376572 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03acbc3-34e3-4b3a-ae45-8f8781d1e94f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:24.378098 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03acbc3-34e3-4b3a-ae45-8f8781d1e94f None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:24.482356 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 284/552] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:14:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:14:24.493580 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41348ca2-f941-4388-9829-c90dd5b837d6 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:24.549375 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:24.618152 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb237e-422d-4831-85ab-918ec733b48d None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:24.618798 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb237e-422d-4831-85ab-918ec733b48d None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:24.619269 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb237e-422d-4831-85ab-918ec733b48d None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:24.621146 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 285/553] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:14:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:14:24.626708 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993ff96-49de-4474-ac5c-07d9fb7c6d49 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:24.627200 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993ff96-49de-4474-ac5c-07d9fb7c6d49 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:24.627677 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993ff96-49de-4474-ac5c-07d9fb7c6d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:24.631863 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41348ca2-f941-4388-9829-c90dd5b837d6 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:24.636413 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:24.649358 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-b993ff96-49de-4474-ac5c-07d9fb7c6d49 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:14:24.651040 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b993ff96-49de-4474-ac5c-07d9fb7c6d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:14:24.669090 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6fa6bc-8cf4-4a0b-a4f1-66389343c643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:24.669766 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6fa6bc-8cf4-4a0b-a4f1-66389343c643 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:24.670043 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6fa6bc-8cf4-4a0b-a4f1-66389343c643 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:24.670303 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6fa6bc-8cf4-4a0b-a4f1-66389343c643 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:24.681050 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6fa6bc-8cf4-4a0b-a4f1-66389343c643 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:24.682558 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6fa6bc-8cf4-4a0b-a4f1-66389343c643 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:24.698589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-7b6fa6bc-8cf4-4a0b-a4f1-66389343c643 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:24.698589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:24.698589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:24.698589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:24.698589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:24.698589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:24.698589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:24.698589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:24.698589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:24.698589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:24.698589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:24.698589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:24.698589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:14:24.698589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:14:24.698589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:14:24.698589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:14:24.699596 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:24.699596 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:24.699596 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:24.699596 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:24.699596 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:24.699596 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:24.699596 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:24.699596 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:24.699596 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:24.699596 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:24.699596 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:24.699596 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:24.699596 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:24.699596 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:24.699596 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:24.699596 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:24.699596 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:14:24.701178 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:14:24.701178 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:24.701178 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:24.701178 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 269/554] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:14:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:24.705357 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6fa6bc-8cf4-4a0b-a4f1-66389343c643 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:24.736643 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 286/555] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:14:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:14:24.740442 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993ff96-49de-4474-ac5c-07d9fb7c6d49 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:24.796205 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:24.808621 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6fa6bc-8cf4-4a0b-a4f1-66389343c643 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:24.853243 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993ff96-49de-4474-ac5c-07d9fb7c6d49 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:24.877219 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e1be0-3408-4f6e-9ad8-08b1369ae967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:24.877899 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e1be0-3408-4f6e-9ad8-08b1369ae967 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:24.878103 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e1be0-3408-4f6e-9ad8-08b1369ae967 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:24.878423 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e1be0-3408-4f6e-9ad8-08b1369ae967 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:24.879073 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190e1be0-3408-4f6e-9ad8-08b1369ae967 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:24.879420 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190e1be0-3408-4f6e-9ad8-08b1369ae967 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:24.880825 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190e1be0-3408-4f6e-9ad8-08b1369ae967 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:24.899002 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2287e3-c7db-43fc-98db-b7024565ed1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:24.904123 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2287e3-c7db-43fc-98db-b7024565ed1b None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:24.904123 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2287e3-c7db-43fc-98db-b7024565ed1b None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:24.904123 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2287e3-c7db-43fc-98db-b7024565ed1b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:24.904123 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:24.918994 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 270/556] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:14:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:14:24.919181 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2287e3-c7db-43fc-98db-b7024565ed1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:14:24.923985 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e1be0-3408-4f6e-9ad8-08b1369ae967 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:24.933913 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-1f2287e3-c7db-43fc-98db-b7024565ed1b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:14:24.933913 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:24.933913 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:24.933913 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:24.933913 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:24.933913 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:24.933913 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:24.933913 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:24.933913 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:24.933913 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:24.933913 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:24.933913 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:24.933913 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:14:24.933913 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:14:24.933913 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:14:24.933913 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:14:24.934937 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:14:24.934937 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:14:24.934937 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:14:24.934937 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:14:24.934937 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:24.934937 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:24.934937 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:24.934937 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:24.934937 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:24.934937 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:24.934937 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:24.934937 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:24.934937 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:24.934937 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:24.934937 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:24.934937 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:24.935787 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:24.935787 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:24.935787 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:24.935787 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:24.935787 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:14:24.935787 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:14:24.935787 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:14:24.935787 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:14:24.935787 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:14:24.935787 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:14:24.935787 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:14:24.935787 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:24.939017 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 287/557] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Aug 29 22:14:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:24.943549 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2287e3-c7db-43fc-98db-b7024565ed1b None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:25.093867 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2287e3-c7db-43fc-98db-b7024565ed1b None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:25.101712 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e1be0-3408-4f6e-9ad8-08b1369ae967 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:25.137123 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d76e59e-128c-4738-a17b-8776a9a92b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:25.137739 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76e59e-128c-4738-a17b-8776a9a92b44 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:25.138050 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76e59e-128c-4738-a17b-8776a9a92b44 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:25.138304 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76e59e-128c-4738-a17b-8776a9a92b44 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:25.138983 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d76e59e-128c-4738-a17b-8776a9a92b44 None admin] RBAC: Adding query filter params (name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:25.139342 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d76e59e-128c-4738-a17b-8776a9a92b44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:25.140257 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732cc99-12d4-4013-b5d1-50a509b4ea28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:25.140911 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732cc99-12d4-4013-b5d1-50a509b4ea28 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:25.141019 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d76e59e-128c-4738-a17b-8776a9a92b44 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:25.141465 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732cc99-12d4-4013-b5d1-50a509b4ea28 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:25.141465 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732cc99-12d4-4013-b5d1-50a509b4ea28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:25.148162 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1732cc99-12d4-4013-b5d1-50a509b4ea28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:25.149940 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1732cc99-12d4-4013-b5d1-50a509b4ea28 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:25.150122 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 288/558] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Aug 29 22:14:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:25.151343 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6ba23-889e-4c1d-90da-44b20a70001d None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:25.151626 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6ba23-889e-4c1d-90da-44b20a70001d None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:25.151896 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6ba23-889e-4c1d-90da-44b20a70001d None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:25.156487 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 289/559] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:14:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:14:25.156487 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b6ba23-889e-4c1d-90da-44b20a70001d None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:25.166747 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-1732cc99-12d4-4013-b5d1-50a509b4ea28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:14:25.166747 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:25.166747 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:25.166747 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:25.166747 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:25.166747 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:25.166747 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:25.166747 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:25.166747 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:25.166747 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:25.166747 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:25.166747 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:25.166747 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:14:25.166747 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:14:25.166747 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:14:25.167666 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:14:25.167666 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:25.167666 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:25.167666 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:25.167666 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:25.167666 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:25.167666 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:25.167666 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:25.167666 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:25.167666 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:25.167666 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:25.167666 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:25.167666 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:25.167666 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:25.167666 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:25.167666 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:25.167666 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:25.168597 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:14:25.168597 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:14:25.168597 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:14:25.168597 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:14:25.168597 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:14:25.168597 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:14:25.168597 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:14:25.168597 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:25.169728 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 271/560] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Aug 29 22:14:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:14:25.170558 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732cc99-12d4-4013-b5d1-50a509b4ea28 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:25.181549 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:25.222564 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:25.275277 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b6ba23-889e-4c1d-90da-44b20a70001d None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:25.276750 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732cc99-12d4-4013-b5d1-50a509b4ea28 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:25.312157 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837dbdba-9788-4d06-bb0a-9d72de3fdb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:25.312826 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837dbdba-9788-4d06-bb0a-9d72de3fdb45 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:25.313105 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837dbdba-9788-4d06-bb0a-9d72de3fdb45 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:25.313346 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fee311-8a25-474c-81a0-0b4bf62b0289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:25.313462 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837dbdba-9788-4d06-bb0a-9d72de3fdb45 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:25.314025 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fee311-8a25-474c-81a0-0b4bf62b0289 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:25.314265 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fee311-8a25-474c-81a0-0b4bf62b0289 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:25.314532 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fee311-8a25-474c-81a0-0b4bf62b0289 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:25.325460 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fee311-8a25-474c-81a0-0b4bf62b0289 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:25.325924 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837dbdba-9788-4d06-bb0a-9d72de3fdb45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:14:25.326932 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fee311-8a25-474c-81a0-0b4bf62b0289 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:25.331900 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-837dbdba-9788-4d06-bb0a-9d72de3fdb45 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:14:25.331900 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:25.331900 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:25.331900 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:25.331900 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:25.331900 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:25.331900 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:25.331900 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:25.331900 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:25.331900 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:25.331900 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:25.331900 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:25.331900 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:14:25.331900 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:14:25.331900 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:14:25.331900 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:14:25.333081 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:14:25.333081 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:14:25.333081 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:14:25.333081 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:14:25.333081 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:25.333081 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:25.333081 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:25.333081 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:25.333081 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:25.333081 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:25.333081 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:25.333081 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:25.333081 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:25.333081 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:25.333081 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:25.333081 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:25.334399 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:25.334399 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:25.334399 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:25.334399 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:25.334399 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:14:25.334399 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:14:25.334399 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:14:25.334399 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:14:25.334399 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:14:25.334399 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:14:25.334399 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:14:25.334399 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:25.334399 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 290/561] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Aug 29 22:14:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:25.335091 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662e956-d4f1-44a1-b82f-051be6196d17 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:25.335091 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662e956-d4f1-44a1-b82f-051be6196d17 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:25.335091 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662e956-d4f1-44a1-b82f-051be6196d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:25.346657 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-06fee311-8a25-474c-81a0-0b4bf62b0289 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:25.346657 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:25.346657 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:25.346657 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:25.346657 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:25.346657 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:25.346657 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:25.346657 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:25.346657 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:25.346657 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:25.346657 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:25.346657 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:25.346657 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:14:25.346657 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:14:25.346657 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:14:25.346657 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:14:25.347713 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:25.347713 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:25.347713 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:25.347713 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:25.347713 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:25.347713 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:25.347713 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:25.347713 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:25.347713 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:25.347713 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:25.347713 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:25.347713 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:25.347713 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:25.347713 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:25.347713 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:25.347713 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:25.347713 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:14:25.348623 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:14:25.348623 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:25.348623 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:25.348623 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 272/562] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:14:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:25.349286 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fee311-8a25-474c-81a0-0b4bf62b0289 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:25.360134 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-9662e956-d4f1-44a1-b82f-051be6196d17 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:14:25.361721 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-9662e956-d4f1-44a1-b82f-051be6196d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:14:25.417777 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:25.434407 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 291/563] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:14:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:14:25.435470 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9662e956-d4f1-44a1-b82f-051be6196d17 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:25.479100 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fee311-8a25-474c-81a0-0b4bf62b0289 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:25.482622 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:25.528951 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bdab2e-df90-4e82-8b3b-94ff517322c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:25.530405 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bdab2e-df90-4e82-8b3b-94ff517322c2 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:25.530874 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bdab2e-df90-4e82-8b3b-94ff517322c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:25.531580 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bdab2e-df90-4e82-8b3b-94ff517322c2 None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:25.532883 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bdab2e-df90-4e82-8b3b-94ff517322c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:25.533572 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bdab2e-df90-4e82-8b3b-94ff517322c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:25.535817 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bdab2e-df90-4e82-8b3b-94ff517322c2 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:25.541459 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9662e956-d4f1-44a1-b82f-051be6196d17 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:25.551505 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 273/564] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Aug 29 22:14:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:25.557201 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bdab2e-df90-4e82-8b3b-94ff517322c2 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:25.590073 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea634ed2-f771-418d-8e36-eee39bf2d7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:25.591453 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea634ed2-f771-418d-8e36-eee39bf2d7ee None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:25.592010 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea634ed2-f771-418d-8e36-eee39bf2d7ee None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:25.592443 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea634ed2-f771-418d-8e36-eee39bf2d7ee None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:25.593282 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea634ed2-f771-418d-8e36-eee39bf2d7ee None admin] RBAC: Adding query filter params (name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:25.593739 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea634ed2-f771-418d-8e36-eee39bf2d7ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:25.596394 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea634ed2-f771-418d-8e36-eee39bf2d7ee None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:25.610811 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 292/565] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Aug 29 22:14:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:25.611910 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea634ed2-f771-418d-8e36-eee39bf2d7ee None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:25.680245 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bdab2e-df90-4e82-8b3b-94ff517322c2 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:25.701419 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:25.716744 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1328a781-53cf-4426-8147-e82002c4fa84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:25.717712 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328a781-53cf-4426-8147-e82002c4fa84 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:25.718257 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328a781-53cf-4426-8147-e82002c4fa84 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:25.718729 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328a781-53cf-4426-8147-e82002c4fa84 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:25.719551 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1328a781-53cf-4426-8147-e82002c4fa84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:25.720031 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1328a781-53cf-4426-8147-e82002c4fa84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:25.721618 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1328a781-53cf-4426-8147-e82002c4fa84 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:25.723823 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea634ed2-f771-418d-8e36-eee39bf2d7ee None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:25.734573 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 274/566] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:14:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:25.734924 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:25.735621 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1328a781-53cf-4426-8147-e82002c4fa84 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:25.767187 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df70ce-6939-4df1-a5ed-3c51086db90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:25.767792 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df70ce-6939-4df1-a5ed-3c51086db90d None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:25.768067 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df70ce-6939-4df1-a5ed-3c51086db90d None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:25.768333 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df70ce-6939-4df1-a5ed-3c51086db90d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:25.769089 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32df70ce-6939-4df1-a5ed-3c51086db90d None admin] RBAC: Adding query filter params (role.id=bc7b902c0870483ba03c139d941f78ac, scope.project.id=696ed25cc0cb43fab4bfaf762a90da54, user.id=5f3472d8ffa748d8828c6a2d89ee7ac7) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:25.769394 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32df70ce-6939-4df1-a5ed-3c51086db90d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:25.770827 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32df70ce-6939-4df1-a5ed-3c51086db90d None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:25.776320 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 293/567] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Aug 29 22:14:25 2022] GET /identity/v3/role_assignments?user.id=5f3472d8ffa748d8828c6a2d89ee7ac7&scope.project.id=696ed25cc0cb43fab4bfaf762a90da54&role.id=bc7b902c0870483ba03c139d941f78ac => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:25.777135 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df70ce-6939-4df1-a5ed-3c51086db90d None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:25.862649 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1328a781-53cf-4426-8147-e82002c4fa84 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:25.903524 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df70ce-6939-4df1-a5ed-3c51086db90d None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:25.906822 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d37c1-b810-4b8c-87cb-9ad868798677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:25.907226 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d37c1-b810-4b8c-87cb-9ad868798677 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:25.907488 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d37c1-b810-4b8c-87cb-9ad868798677 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:25.907760 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d37c1-b810-4b8c-87cb-9ad868798677 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:25.919654 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d37c1-b810-4b8c-87cb-9ad868798677 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:25.921243 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d37c1-b810-4b8c-87cb-9ad868798677 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:25.938723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-e77d37c1-b810-4b8c-87cb-9ad868798677 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:25.938723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:25.938723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:25.938723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:25.938723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:25.938723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:25.938723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:25.938723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:25.938723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:25.938723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:25.938723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:25.938723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:25.938723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:14:25.938723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:14:25.938723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:14:25.938723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:14:25.939720 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:25.939720 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:25.939720 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:25.939720 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:25.939720 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:25.939720 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:25.939720 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:25.939720 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:25.939720 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:25.939720 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:25.939720 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:25.939720 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:25.939720 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:25.939720 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:25.939720 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:25.939720 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:25.939720 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:14:25.940625 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:14:25.940625 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:25.940625 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:25.944750 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 275/568] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:14:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:25.945319 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489e39b-b6e8-482f-90d1-cac462138936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:25.945632 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d37c1-b810-4b8c-87cb-9ad868798677 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:25.946143 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489e39b-b6e8-482f-90d1-cac462138936 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:25.946423 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489e39b-b6e8-482f-90d1-cac462138936 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:25.946756 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489e39b-b6e8-482f-90d1-cac462138936 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:25.958607 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2489e39b-b6e8-482f-90d1-cac462138936 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:14:25.963906 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-2489e39b-b6e8-482f-90d1-cac462138936 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:14:25.963906 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:25.963906 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:25.963906 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:25.963906 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:25.963906 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:25.963906 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:25.963906 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:25.963906 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:25.963906 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:25.963906 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:25.963906 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:25.963906 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:14:25.963906 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:14:25.963906 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:14:25.963906 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:14:25.964915 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:14:25.964915 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:14:25.964915 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:14:25.964915 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:14:25.964915 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:25.964915 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:25.964915 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:25.964915 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:25.964915 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:25.964915 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:25.964915 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:25.964915 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:25.964915 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:25.964915 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:25.964915 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:25.964915 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:25.965749 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:25.965749 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:25.965749 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:25.965749 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:25.965749 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:14:25.965749 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:14:25.965749 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:14:25.965749 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:14:25.965749 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:14:25.965749 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:14:25.965749 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:14:25.965749 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:25.965749 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 294/569] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Aug 29 22:14:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:25.967030 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559092a-659a-4914-a687-d62dab11bb18 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:25.967312 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559092a-659a-4914-a687-d62dab11bb18 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:25.967699 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559092a-659a-4914-a687-d62dab11bb18 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:25.969088 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 295/570] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:14:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:14:25.969605 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d559092a-659a-4914-a687-d62dab11bb18 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:25.995579 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:26.003617 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:26.073509 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d37c1-b810-4b8c-87cb-9ad868798677 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:26.077626 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d559092a-659a-4914-a687-d62dab11bb18 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:26.113976 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be97d28-9633-40cf-9e2a-8536207351a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:26.114506 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be97d28-9633-40cf-9e2a-8536207351a3 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:26.114786 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be97d28-9633-40cf-9e2a-8536207351a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:26.115053 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be97d28-9633-40cf-9e2a-8536207351a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:26.115699 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be97d28-9633-40cf-9e2a-8536207351a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:26.115999 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be97d28-9633-40cf-9e2a-8536207351a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:26.116115 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa5b411-fbda-4434-8a64-da0236a5bca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:26.116869 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5b411-fbda-4434-8a64-da0236a5bca4 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:26.117215 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5b411-fbda-4434-8a64-da0236a5bca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:26.117492 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be97d28-9633-40cf-9e2a-8536207351a3 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:26.117686 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5b411-fbda-4434-8a64-da0236a5bca4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:26.127557 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa5b411-fbda-4434-8a64-da0236a5bca4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:26.129380 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa5b411-fbda-4434-8a64-da0236a5bca4 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:26.130030 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 296/571] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:14:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:26.130769 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be97d28-9633-40cf-9e2a-8536207351a3 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:26.147116 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-daa5b411-fbda-4434-8a64-da0236a5bca4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:14:26.147116 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:26.147116 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:26.147116 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:26.147116 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:26.147116 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:26.147116 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:26.147116 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:26.147116 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:26.147116 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:26.147116 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:26.147116 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:26.147116 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:14:26.147116 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:14:26.147116 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:14:26.147116 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:14:26.148142 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:26.148142 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:26.148142 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:14:26.148142 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:14:26.148142 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:14:26.148142 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:14:26.148142 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:26.148142 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:26.148142 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:26.148142 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:26.148142 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:26.148142 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:26.148142 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:26.148142 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:26.148142 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:26.148142 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:26.148142 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:26.148142 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:26.149288 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:26.149288 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:26.149288 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:14:26.149288 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:14:26.149288 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:14:26.149288 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:14:26.149288 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:14:26.149288 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:14:26.149288 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:14:26.149288 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:26.149288 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 276/572] 10.222.0.36 () {56 vars in 1093 bytes} [Mon Aug 29 22:14:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:26.150062 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49399c6-6e8d-4cfa-96dd-d6468c7f77dc None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:26.150062 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49399c6-6e8d-4cfa-96dd-d6468c7f77dc None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:26.150533 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49399c6-6e8d-4cfa-96dd-d6468c7f77dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:26.168950 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-c49399c6-6e8d-4cfa-96dd-d6468c7f77dc None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:14:26.170148 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c49399c6-6e8d-4cfa-96dd-d6468c7f77dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:14:26.232287 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:26.244061 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be97d28-9633-40cf-9e2a-8536207351a3 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:26.252766 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 277/573] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:14:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:14:26.254307 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49399c6-6e8d-4cfa-96dd-d6468c7f77dc None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:26.285435 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a15b6c-b448-4576-a72c-3081c4323eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:26.286141 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a15b6c-b448-4576-a72c-3081c4323eab None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:26.286329 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a15b6c-b448-4576-a72c-3081c4323eab None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:26.286596 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a15b6c-b448-4576-a72c-3081c4323eab None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:26.287287 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a15b6c-b448-4576-a72c-3081c4323eab None admin] RBAC: Adding query filter params (name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:26.287591 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a15b6c-b448-4576-a72c-3081c4323eab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:26.287805 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:26.289499 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a15b6c-b448-4576-a72c-3081c4323eab None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:26.300254 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 297/574] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Aug 29 22:14:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:26.301418 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a15b6c-b448-4576-a72c-3081c4323eab None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:26.374065 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49399c6-6e8d-4cfa-96dd-d6468c7f77dc None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:26.410498 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fc0d88-658d-4ae9-9893-9d55cfcfc789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:26.411543 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc0d88-658d-4ae9-9893-9d55cfcfc789 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:26.412010 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc0d88-658d-4ae9-9893-9d55cfcfc789 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:26.412552 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc0d88-658d-4ae9-9893-9d55cfcfc789 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:26.420888 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fc0d88-658d-4ae9-9893-9d55cfcfc789 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:26.422688 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fc0d88-658d-4ae9-9893-9d55cfcfc789 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:26.427205 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a15b6c-b448-4576-a72c-3081c4323eab None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:26.436221 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-d9fc0d88-658d-4ae9-9893-9d55cfcfc789 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 29 22:14:26.436221 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:26.436221 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:26.436221 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:26.436221 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:26.436221 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:26.436221 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:26.436221 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:26.436221 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:26.436221 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:26.436221 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:26.436221 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:26.436221 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:14:26.436221 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:14:26.436221 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:14:26.436221 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:14:26.437216 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:26.437216 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:26.437216 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:14:26.437216 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:14:26.437216 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:14:26.437216 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:14:26.437216 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:26.437216 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:26.437216 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:26.437216 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:26.437216 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:26.437216 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:26.437216 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:26.437216 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:26.437216 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:26.437216 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:26.437216 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:26.437216 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:26.438160 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:26.438160 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:26.438160 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:14:26.438160 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:14:26.438160 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:14:26.438160 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:14:26.438160 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:14:26.438160 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:14:26.438160 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 29 22:14:26.438160 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:26.441016 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 278/575] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:14:26 2022] GET /identity/v3/users/glance => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:26.442017 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fc0d88-658d-4ae9-9893-9d55cfcfc789 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:26.472616 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef02a1a1-51b5-4cd2-bf3e-40f2f8a12b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:26.473600 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02a1a1-51b5-4cd2-bf3e-40f2f8a12b33 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:26.474069 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02a1a1-51b5-4cd2-bf3e-40f2f8a12b33 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:26.474561 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02a1a1-51b5-4cd2-bf3e-40f2f8a12b33 None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:26.475484 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef02a1a1-51b5-4cd2-bf3e-40f2f8a12b33 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:26.475976 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef02a1a1-51b5-4cd2-bf3e-40f2f8a12b33 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:26.477702 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef02a1a1-51b5-4cd2-bf3e-40f2f8a12b33 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:26.500737 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 298/576] 10.222.0.36 () {56 vars in 1133 bytes} [Mon Aug 29 22:14:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:26.501973 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef02a1a1-51b5-4cd2-bf3e-40f2f8a12b33 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:26.517938 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:26.540436 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:26.559575 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fc0d88-658d-4ae9-9893-9d55cfcfc789 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:26.592465 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b2f4a4-a22d-4d27-81c2-97c7215ef708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:26.593113 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2f4a4-a22d-4d27-81c2-97c7215ef708 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:26.593387 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2f4a4-a22d-4d27-81c2-97c7215ef708 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:26.593655 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2f4a4-a22d-4d27-81c2-97c7215ef708 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:26.604391 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b2f4a4-a22d-4d27-81c2-97c7215ef708 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:26.605892 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b2f4a4-a22d-4d27-81c2-97c7215ef708 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:26.611972 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef02a1a1-51b5-4cd2-bf3e-40f2f8a12b33 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:26.620397 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-d5b2f4a4-a22d-4d27-81c2-97c7215ef708 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:26.620397 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:26.620397 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:26.620397 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:26.620397 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:26.620397 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:26.620397 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:26.620397 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:26.620397 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:26.620397 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:26.620397 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:26.620397 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:26.620397 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:14:26.620397 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:14:26.620397 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:14:26.620397 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:14:26.621413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:26.621413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:26.621413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:26.621413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:26.621413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:26.621413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:26.621413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:26.621413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:26.621413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:26.621413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:26.621413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:26.621413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:26.621413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:26.621413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:26.621413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:26.621413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:26.621413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:14:26.622355 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:14:26.622355 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:26.622355 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:26.622355 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 279/577] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:14:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:26.622599 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b2f4a4-a22d-4d27-81c2-97c7215ef708 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:26.655447 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64b74b-f302-404d-b48e-7b9232b1988c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:26.655975 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64b74b-f302-404d-b48e-7b9232b1988c None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:26.656266 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64b74b-f302-404d-b48e-7b9232b1988c None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:26.656548 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64b74b-f302-404d-b48e-7b9232b1988c None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:26.657275 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f64b74b-f302-404d-b48e-7b9232b1988c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:26.657575 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f64b74b-f302-404d-b48e-7b9232b1988c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:26.658998 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f64b74b-f302-404d-b48e-7b9232b1988c None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:26.676714 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 299/578] 10.222.0.36 () {56 vars in 1137 bytes} [Mon Aug 29 22:14:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:26.681862 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64b74b-f302-404d-b48e-7b9232b1988c None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:26.736256 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b2f4a4-a22d-4d27-81c2-97c7215ef708 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:26.760650 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:26.778946 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f491a4-7876-4f16-9ed2-88417812a3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:26.779589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f491a4-7876-4f16-9ed2-88417812a3fb None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:26.779864 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f491a4-7876-4f16-9ed2-88417812a3fb None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:26.780137 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f491a4-7876-4f16-9ed2-88417812a3fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:26.782157 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:26.792428 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f491a4-7876-4f16-9ed2-88417812a3fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:26.793933 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f491a4-7876-4f16-9ed2-88417812a3fb None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:26.803171 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64b74b-f302-404d-b48e-7b9232b1988c None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:26.811323 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-e9f491a4-7876-4f16-9ed2-88417812a3fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:26.811323 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:26.811323 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:26.811323 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:26.811323 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:26.811323 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:26.811323 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:26.811323 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:26.811323 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:26.811323 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:26.811323 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:26.811323 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:26.811323 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:14:26.811323 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:14:26.811323 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:14:26.811323 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:14:26.812295 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:26.812295 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:26.812295 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:26.812295 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:26.812295 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:26.812295 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:26.812295 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:26.812295 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:26.812295 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:26.812295 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:26.812295 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:26.812295 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:26.812295 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:26.812295 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:26.812295 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:26.812295 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:26.812295 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:14:26.813252 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:14:26.813252 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:26.813252 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:26.813252 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 280/579] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:14:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:26.813476 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f491a4-7876-4f16-9ed2-88417812a3fb None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:26.845337 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86037848-ce55-46c1-95df-dd4b044048c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:26.845993 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86037848-ce55-46c1-95df-dd4b044048c6 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:26.846274 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86037848-ce55-46c1-95df-dd4b044048c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:26.846549 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86037848-ce55-46c1-95df-dd4b044048c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:26.866230 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86037848-ce55-46c1-95df-dd4b044048c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:14:26.871633 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-86037848-ce55-46c1-95df-dd4b044048c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:14:26.871633 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:26.871633 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:26.871633 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:26.871633 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:26.871633 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:26.871633 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:26.871633 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:26.871633 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:26.871633 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:26.871633 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:26.871633 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:26.871633 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:14:26.871633 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:14:26.871633 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:14:26.871633 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:14:26.872694 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:14:26.872694 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:14:26.872694 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:14:26.872694 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:14:26.872694 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:26.872694 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:26.872694 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:26.872694 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:26.872694 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:26.872694 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:26.872694 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:26.872694 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:26.872694 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:26.872694 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:26.872694 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:26.872694 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:26.873532 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:26.873532 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:26.873532 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:26.873532 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:26.873532 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:14:26.873532 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:14:26.873532 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:14:26.873532 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:14:26.873532 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:14:26.873532 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:14:26.873532 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:14:26.873532 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:26.873532 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 300/580] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Aug 29 22:14:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:26.874360 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86037848-ce55-46c1-95df-dd4b044048c6 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:26.946629 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f491a4-7876-4f16-9ed2-88417812a3fb None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:26.983004 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7997cc-805d-4b87-b547-2aa79fb10027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:26.983614 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7997cc-805d-4b87-b547-2aa79fb10027 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:26.983893 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7997cc-805d-4b87-b547-2aa79fb10027 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:26.984163 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7997cc-805d-4b87-b547-2aa79fb10027 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:26.984336 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86037848-ce55-46c1-95df-dd4b044048c6 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:26.984867 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7997cc-805d-4b87-b547-2aa79fb10027 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:26.985169 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7997cc-805d-4b87-b547-2aa79fb10027 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:26.986555 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7997cc-805d-4b87-b547-2aa79fb10027 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:26.999487 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 281/581] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:14:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:27.000302 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7997cc-805d-4b87-b547-2aa79fb10027 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:27.023338 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:27.029797 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9278e5c1-015e-41d5-a67d-bdc841936006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:27.030452 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278e5c1-015e-41d5-a67d-bdc841936006 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:27.030695 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278e5c1-015e-41d5-a67d-bdc841936006 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:27.030959 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278e5c1-015e-41d5-a67d-bdc841936006 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:27.041302 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9278e5c1-015e-41d5-a67d-bdc841936006 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:27.042752 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9278e5c1-015e-41d5-a67d-bdc841936006 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:27.052849 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:27.057760 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-9278e5c1-015e-41d5-a67d-bdc841936006 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:27.057760 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:27.057760 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:27.057760 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:27.057760 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:27.057760 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:27.057760 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:27.057760 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:27.057760 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:27.057760 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:27.057760 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:27.057760 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:27.057760 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:14:27.057760 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:14:27.057760 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:14:27.057760 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:14:27.058756 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:27.058756 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:27.058756 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:27.058756 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:27.058756 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:27.058756 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:27.058756 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:27.058756 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:27.058756 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:27.058756 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:27.058756 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:27.058756 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:27.058756 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:27.058756 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:27.058756 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:27.058756 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:27.058756 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:14:27.059705 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:14:27.059705 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:27.059705 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:27.064149 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 301/582] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:14:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:27.064846 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9278e5c1-015e-41d5-a67d-bdc841936006 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:27.110998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7997cc-805d-4b87-b547-2aa79fb10027 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:27.151403 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf60a6-0eeb-46d9-b3fb-55af60ec0c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:27.152068 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf60a6-0eeb-46d9-b3fb-55af60ec0c01 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:27.152363 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf60a6-0eeb-46d9-b3fb-55af60ec0c01 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:27.152667 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf60a6-0eeb-46d9-b3fb-55af60ec0c01 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:27.153330 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf60a6-0eeb-46d9-b3fb-55af60ec0c01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:27.153644 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf60a6-0eeb-46d9-b3fb-55af60ec0c01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:27.155185 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf60a6-0eeb-46d9-b3fb-55af60ec0c01 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:27.168616 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 282/583] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:14:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:27.172647 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9278e5c1-015e-41d5-a67d-bdc841936006 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:27.173680 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf60a6-0eeb-46d9-b3fb-55af60ec0c01 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:27.213408 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b4450-d32b-43ff-afe5-c1e67183e7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:27.213949 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b4450-d32b-43ff-afe5-c1e67183e7b5 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:27.214414 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b4450-d32b-43ff-afe5-c1e67183e7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:27.214688 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b4450-d32b-43ff-afe5-c1e67183e7b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:27.215360 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b4450-d32b-43ff-afe5-c1e67183e7b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:27.215660 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b4450-d32b-43ff-afe5-c1e67183e7b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:27.217058 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b4450-d32b-43ff-afe5-c1e67183e7b5 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:27.232809 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 302/584] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Aug 29 22:14:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:27.232809 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b4450-d32b-43ff-afe5-c1e67183e7b5 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:27.276296 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:27.289534 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf60a6-0eeb-46d9-b3fb-55af60ec0c01 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:27.296856 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:27.326612 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773a001-1c8b-4d5f-be8c-5727340bfa04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:27.327270 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773a001-1c8b-4d5f-be8c-5727340bfa04 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:27.327545 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773a001-1c8b-4d5f-be8c-5727340bfa04 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:27.327811 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773a001-1c8b-4d5f-be8c-5727340bfa04 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:27.334968 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a773a001-1c8b-4d5f-be8c-5727340bfa04 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:27.336471 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a773a001-1c8b-4d5f-be8c-5727340bfa04 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:27.338793 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b4450-d32b-43ff-afe5-c1e67183e7b5 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:27.348293 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-a773a001-1c8b-4d5f-be8c-5727340bfa04 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 22:14:27.348293 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:27.348293 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:27.348293 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:27.348293 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:27.348293 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:27.348293 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:27.348293 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:27.348293 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:27.348293 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:27.348293 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:27.348293 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:27.348293 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:14:27.348293 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:14:27.348293 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:14:27.348293 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:14:27.349462 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:27.349462 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:27.349462 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:14:27.349462 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:14:27.349462 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:14:27.349462 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:14:27.349462 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:27.349462 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:27.349462 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:27.349462 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:27.349462 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:27.349462 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:27.349462 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:27.349462 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:27.349462 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:27.349462 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:27.349462 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:27.349462 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:27.350601 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:27.350601 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:27.350601 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:14:27.350601 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:14:27.350601 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:14:27.350601 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:14:27.350601 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:14:27.350601 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:14:27.350601 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 22:14:27.350601 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:27.350601 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 283/585] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:14:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:27.350601 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773a001-1c8b-4d5f-be8c-5727340bfa04 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:27.381679 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24fae46-7bb0-495c-880f-8f32ac5132b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:27.382626 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24fae46-7bb0-495c-880f-8f32ac5132b2 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:27.383211 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24fae46-7bb0-495c-880f-8f32ac5132b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:27.383661 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24fae46-7bb0-495c-880f-8f32ac5132b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:27.384623 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24fae46-7bb0-495c-880f-8f32ac5132b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:27.385193 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24fae46-7bb0-495c-880f-8f32ac5132b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:27.386590 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24fae46-7bb0-495c-880f-8f32ac5132b2 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:27.401559 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 303/586] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:14:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:27.402471 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24fae46-7bb0-495c-880f-8f32ac5132b2 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:27.458985 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773a001-1c8b-4d5f-be8c-5727340bfa04 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:27.505008 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d2293-2c8b-4b89-9c9d-5874e3ff2513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:27.506028 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d2293-2c8b-4b89-9c9d-5874e3ff2513 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:27.506527 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d2293-2c8b-4b89-9c9d-5874e3ff2513 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:27.506898 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d2293-2c8b-4b89-9c9d-5874e3ff2513 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:27.509482 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24fae46-7bb0-495c-880f-8f32ac5132b2 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:27.512621 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:27.515958 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69d2293-2c8b-4b89-9c9d-5874e3ff2513 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:27.517593 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69d2293-2c8b-4b89-9c9d-5874e3ff2513 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:27.531069 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-d69d2293-2c8b-4b89-9c9d-5874e3ff2513 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:14:27.531069 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:27.531069 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:27.531069 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:27.531069 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:27.531069 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:27.531069 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:27.531069 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:27.531069 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:27.531069 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:27.531069 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:27.531069 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:27.531069 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:14:27.531069 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:14:27.531069 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:14:27.532194 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:14:27.532194 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:27.532194 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:27.532194 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:27.532194 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:27.532194 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:27.532194 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:27.532194 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:27.532194 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:27.532194 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:27.532194 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:27.532194 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:27.532194 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:27.532194 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:27.532194 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:27.532194 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:27.532194 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:27.533288 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:14:27.533288 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:14:27.533288 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:14:27.533288 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:14:27.533288 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:14:27.533288 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:14:27.533288 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:14:27.533288 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:27.534436 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 284/587] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Aug 29 22:14:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:27.535131 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d2293-2c8b-4b89-9c9d-5874e3ff2513 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:27.554185 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7def18-6a81-4c63-96aa-6f4383321177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:27.555006 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7def18-6a81-4c63-96aa-6f4383321177 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:27.555287 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7def18-6a81-4c63-96aa-6f4383321177 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:27.555561 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7def18-6a81-4c63-96aa-6f4383321177 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:27.565645 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:27.567327 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7def18-6a81-4c63-96aa-6f4383321177 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:27.569121 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7def18-6a81-4c63-96aa-6f4383321177 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:27.588766 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-ce7def18-6a81-4c63-96aa-6f4383321177 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:27.588766 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:27.588766 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:27.588766 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:27.588766 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:27.588766 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:27.588766 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:27.588766 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:27.588766 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:27.588766 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:27.588766 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:27.588766 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:27.588766 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:14:27.588766 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:14:27.588766 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:14:27.588766 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:14:27.589803 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:27.589803 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:27.589803 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:27.589803 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:27.589803 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:27.589803 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:27.589803 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:27.589803 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:27.589803 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:27.589803 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:27.589803 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:27.589803 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:27.589803 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:27.589803 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:27.589803 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:27.589803 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:27.589803 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:14:27.590697 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:14:27.590697 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:27.590697 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:27.590697 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 304/588] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:14:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:27.591707 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7def18-6a81-4c63-96aa-6f4383321177 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:27.655156 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d2293-2c8b-4b89-9c9d-5874e3ff2513 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:27.691736 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7def18-6a81-4c63-96aa-6f4383321177 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:27.691942 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43469126-020e-4fe1-ad3f-35c9af82d26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:27.692526 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43469126-020e-4fe1-ad3f-35c9af82d26d None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:27.692922 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43469126-020e-4fe1-ad3f-35c9af82d26d None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:27.693397 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43469126-020e-4fe1-ad3f-35c9af82d26d None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:27.694313 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43469126-020e-4fe1-ad3f-35c9af82d26d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:27.694623 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43469126-020e-4fe1-ad3f-35c9af82d26d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:27.696200 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43469126-020e-4fe1-ad3f-35c9af82d26d None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:27.714175 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 285/589] 10.222.0.36 () {56 vars in 1137 bytes} [Mon Aug 29 22:14:27 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:27.715002 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43469126-020e-4fe1-ad3f-35c9af82d26d None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:27.731110 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6c85e5-4477-4ef4-9929-5bf09f23046a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:27.731741 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c85e5-4477-4ef4-9929-5bf09f23046a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:27.732016 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c85e5-4477-4ef4-9929-5bf09f23046a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:27.732286 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c85e5-4477-4ef4-9929-5bf09f23046a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:27.738932 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6c85e5-4477-4ef4-9929-5bf09f23046a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:27.740376 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6c85e5-4477-4ef4-9929-5bf09f23046a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:27.751526 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-eb6c85e5-4477-4ef4-9929-5bf09f23046a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:14:27.751526 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:27.751526 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:27.751526 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:27.751526 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:27.751526 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:27.751526 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:27.751526 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:27.751526 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:27.751526 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:27.751526 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:27.751526 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:27.751526 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:14:27.751526 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:14:27.751526 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:14:27.752495 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:14:27.752495 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:27.752495 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:27.752495 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:27.752495 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:27.752495 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:27.752495 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:27.752495 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:27.752495 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:27.752495 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:27.752495 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:27.752495 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:27.752495 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:27.752495 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:27.752495 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:27.752495 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:27.752495 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:27.753415 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:14:27.753415 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:14:27.753415 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:14:27.753415 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:14:27.753415 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:14:27.753415 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:14:27.753415 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:14:27.753415 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:27.757457 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 305/590] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Aug 29 22:14:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:27.758248 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6c85e5-4477-4ef4-9929-5bf09f23046a None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:27.778682 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:27.801228 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:27.818124 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43469126-020e-4fe1-ad3f-35c9af82d26d None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:27.852475 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a7313e-12fe-4d9b-a839-e7f0daf0b234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:27.853581 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7313e-12fe-4d9b-a839-e7f0daf0b234 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:27.853966 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7313e-12fe-4d9b-a839-e7f0daf0b234 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:27.854340 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7313e-12fe-4d9b-a839-e7f0daf0b234 None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:27.855105 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a7313e-12fe-4d9b-a839-e7f0daf0b234 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:27.855477 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a7313e-12fe-4d9b-a839-e7f0daf0b234 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:27.857032 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a7313e-12fe-4d9b-a839-e7f0daf0b234 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:27.862183 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6c85e5-4477-4ef4-9929-5bf09f23046a None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:27.869249 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 286/591] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Aug 29 22:14:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:27.871673 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec12655-2f29-4125-b611-1a9b70089eca None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:27.871956 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec12655-2f29-4125-b611-1a9b70089eca None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:27.872229 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec12655-2f29-4125-b611-1a9b70089eca None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:27.873626 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 287/592] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:14:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:14:27.874149 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec12655-2f29-4125-b611-1a9b70089eca None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:27.903867 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ece477-64b7-4c99-bc43-8c699174054a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:27.904571 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ece477-64b7-4c99-bc43-8c699174054a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:27.904845 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ece477-64b7-4c99-bc43-8c699174054a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:27.905112 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ece477-64b7-4c99-bc43-8c699174054a None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:27.905806 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ece477-64b7-4c99-bc43-8c699174054a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:27.906104 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ece477-64b7-4c99-bc43-8c699174054a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:27.907494 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ece477-64b7-4c99-bc43-8c699174054a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:27.919688 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 306/593] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:14:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:27.920289 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ece477-64b7-4c99-bc43-8c699174054a None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:27.977986 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec12655-2f29-4125-b611-1a9b70089eca None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:27.997813 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:28.012479 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4832c42f-1b70-4ec6-8153-77cb7ecdef7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:28.013049 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832c42f-1b70-4ec6-8153-77cb7ecdef7e None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:28.013342 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832c42f-1b70-4ec6-8153-77cb7ecdef7e None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:28.013613 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832c42f-1b70-4ec6-8153-77cb7ecdef7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:28.021456 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ece477-64b7-4c99-bc43-8c699174054a None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:28.023969 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4832c42f-1b70-4ec6-8153-77cb7ecdef7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:28.025458 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4832c42f-1b70-4ec6-8153-77cb7ecdef7e None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:28.027958 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:28.040811 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-4832c42f-1b70-4ec6-8153-77cb7ecdef7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:28.040811 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:28.040811 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:28.040811 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:28.040811 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:28.040811 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:28.040811 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:28.040811 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:28.040811 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:28.040811 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:28.040811 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:28.040811 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:28.040811 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:14:28.040811 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:14:28.040811 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:14:28.040811 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:14:28.041935 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:28.041935 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:28.041935 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:28.041935 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:28.041935 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:28.041935 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:28.041935 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:28.041935 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:28.041935 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:28.041935 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:28.041935 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:28.041935 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:28.041935 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:28.041935 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:28.041935 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:28.041935 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:28.041935 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:14:28.047876 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:14:28.047876 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:28.047876 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:28.047876 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 288/594] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:14:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:28.047876 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4832c42f-1b70-4ec6-8153-77cb7ecdef7e None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:28.056798 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe06c6e9-ced7-4e9f-ad33-a6e61585c26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:28.057417 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06c6e9-ced7-4e9f-ad33-a6e61585c26a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:28.057691 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06c6e9-ced7-4e9f-ad33-a6e61585c26a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:28.057956 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06c6e9-ced7-4e9f-ad33-a6e61585c26a None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:28.058647 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe06c6e9-ced7-4e9f-ad33-a6e61585c26a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:28.058950 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe06c6e9-ced7-4e9f-ad33-a6e61585c26a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:28.060395 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe06c6e9-ced7-4e9f-ad33-a6e61585c26a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:28.072911 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 307/595] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Aug 29 22:14:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:28.074177 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093eb2b9-8286-4824-9601-78f9c6e5fd7a None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:28.074465 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093eb2b9-8286-4824-9601-78f9c6e5fd7a None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:28.074736 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093eb2b9-8286-4824-9601-78f9c6e5fd7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:28.093799 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-093eb2b9-8286-4824-9601-78f9c6e5fd7a None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:14:28.094992 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-093eb2b9-8286-4824-9601-78f9c6e5fd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:14:28.148341 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4832c42f-1b70-4ec6-8153-77cb7ecdef7e None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:28.161016 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 308/596] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:14:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:14:28.161852 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093eb2b9-8286-4824-9601-78f9c6e5fd7a None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:28.184337 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549f332-d8b6-4e70-b8de-f95bbcada012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:28.185108 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549f332-d8b6-4e70-b8de-f95bbcada012 None admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:28.185386 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549f332-d8b6-4e70-b8de-f95bbcada012 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:28.185666 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549f332-d8b6-4e70-b8de-f95bbcada012 None admin] PATH_INFO: `/v3/projects/696ed25cc0cb43fab4bfaf762a90da54/users/90b7213b7111456a93e294ce40b95b21/roles/bc7b902c0870483ba03c139d941f78ac` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:28.203175 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7549f332-d8b6-4e70-b8de-f95bbcada012 None admin] RBAC: Authorizing `identity:create_grant(project_id=696ed25cc0cb43fab4bfaf762a90da54, user_id=90b7213b7111456a93e294ce40b95b21, role_id=bc7b902c0870483ba03c139d941f78ac)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:28.204924 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7549f332-d8b6-4e70-b8de-f95bbcada012 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:28.228491 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 289/597] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Aug 29 22:14:28 2022] PUT /identity/v3/projects/696ed25cc0cb43fab4bfaf762a90da54/users/90b7213b7111456a93e294ce40b95b21/roles/bc7b902c0870483ba03c139d941f78ac => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:14:28.228491 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549f332-d8b6-4e70-b8de-f95bbcada012 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:28.238779 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:28.291933 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093eb2b9-8286-4824-9601-78f9c6e5fd7a None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:28.294250 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:28.346505 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10835b11-5328-4008-82d1-f845f10e370d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:28.347302 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10835b11-5328-4008-82d1-f845f10e370d None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:28.347584 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10835b11-5328-4008-82d1-f845f10e370d None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:28.348123 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10835b11-5328-4008-82d1-f845f10e370d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:28.359453 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10835b11-5328-4008-82d1-f845f10e370d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:28.360101 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549f332-d8b6-4e70-b8de-f95bbcada012 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:28.360983 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10835b11-5328-4008-82d1-f845f10e370d None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:28.380180 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-10835b11-5328-4008-82d1-f845f10e370d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 22:14:28.380180 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:28.380180 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:28.380180 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:28.380180 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:28.380180 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:28.380180 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:28.380180 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:28.380180 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:28.380180 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:28.380180 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:28.380180 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:28.380180 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:14:28.380180 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:14:28.380180 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:14:28.380180 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:14:28.381227 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:28.381227 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:28.381227 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:14:28.381227 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:14:28.381227 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:14:28.381227 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:14:28.381227 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:28.381227 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:28.381227 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:28.381227 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:28.381227 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:28.381227 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:28.381227 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:28.381227 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:28.381227 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:28.381227 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:28.381227 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:28.381227 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:28.382180 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:28.382180 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:28.382180 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:14:28.382180 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:14:28.382180 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:14:28.382180 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:14:28.382180 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:14:28.382180 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:14:28.382180 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 22:14:28.382180 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:28.382180 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 309/598] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Aug 29 22:14:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:28.382180 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10835b11-5328-4008-82d1-f845f10e370d None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:28.410360 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4001d056-fb15-4772-8408-65181676741d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:28.411421 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001d056-fb15-4772-8408-65181676741d None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:28.411421 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001d056-fb15-4772-8408-65181676741d None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:28.411623 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001d056-fb15-4772-8408-65181676741d None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:28.412229 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4001d056-fb15-4772-8408-65181676741d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:28.412571 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4001d056-fb15-4772-8408-65181676741d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:28.413964 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4001d056-fb15-4772-8408-65181676741d None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:28.428076 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 290/599] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:14:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:28.428958 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4001d056-fb15-4772-8408-65181676741d None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:28.497407 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10835b11-5328-4008-82d1-f845f10e370d None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:28.523065 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:28.534187 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7225b-1c8c-423c-878e-9ae57230c2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:28.534859 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7225b-1c8c-423c-878e-9ae57230c2a0 None admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:28.535132 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7225b-1c8c-423c-878e-9ae57230c2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:28.535400 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7225b-1c8c-423c-878e-9ae57230c2a0 None admin] PATH_INFO: `/v3/projects/696ed25cc0cb43fab4bfaf762a90da54/users/e7a399ee5db44100a88a4ffb451512aa/roles/bc7b902c0870483ba03c139d941f78ac` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:28.546427 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4001d056-fb15-4772-8408-65181676741d None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:28.552594 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f7225b-1c8c-423c-878e-9ae57230c2a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=696ed25cc0cb43fab4bfaf762a90da54, user_id=e7a399ee5db44100a88a4ffb451512aa, role_id=bc7b902c0870483ba03c139d941f78ac)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:28.553835 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:28.555118 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f7225b-1c8c-423c-878e-9ae57230c2a0 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:28.569596 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 310/600] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Aug 29 22:14:28 2022] PUT /identity/v3/projects/696ed25cc0cb43fab4bfaf762a90da54/users/e7a399ee5db44100a88a4ffb451512aa/roles/bc7b902c0870483ba03c139d941f78ac => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:14:28.570875 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7225b-1c8c-423c-878e-9ae57230c2a0 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:28.600785 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee32f1dc-746a-429c-9c7a-a1e05affbe9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:28.603184 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32f1dc-746a-429c-9c7a-a1e05affbe9c None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:28.603813 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32f1dc-746a-429c-9c7a-a1e05affbe9c None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:28.604433 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32f1dc-746a-429c-9c7a-a1e05affbe9c None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:28.606022 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee32f1dc-746a-429c-9c7a-a1e05affbe9c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:28.606734 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee32f1dc-746a-429c-9c7a-a1e05affbe9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:28.609157 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee32f1dc-746a-429c-9c7a-a1e05affbe9c None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:28.641338 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 291/601] 10.222.0.36 () {56 vars in 1139 bytes} [Mon Aug 29 22:14:28 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:28.642589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee32f1dc-746a-429c-9c7a-a1e05affbe9c None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:28.717741 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7225b-1c8c-423c-878e-9ae57230c2a0 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:28.769136 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d859e-2eee-427e-ab71-7b3af1c54430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:28.770468 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d859e-2eee-427e-ab71-7b3af1c54430 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:28.770468 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d859e-2eee-427e-ab71-7b3af1c54430 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:28.770468 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d859e-2eee-427e-ab71-7b3af1c54430 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:28.774618 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee32f1dc-746a-429c-9c7a-a1e05affbe9c None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:28.782445 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3d859e-2eee-427e-ab71-7b3af1c54430 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:14:28.787408 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-de3d859e-2eee-427e-ab71-7b3af1c54430 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:14:28.787408 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:28.787408 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:28.787408 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:28.787408 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:28.787408 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:28.787408 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:28.787408 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:28.787408 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:28.787408 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:28.787408 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:28.787408 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:28.787408 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:14:28.787408 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:14:28.787408 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:14:28.787408 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:14:28.788593 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:14:28.788593 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:14:28.788593 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:14:28.788593 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:14:28.788593 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:28.788593 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:28.788593 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:28.788593 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:28.788593 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:28.788593 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:28.788593 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:28.788593 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:28.788593 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:28.788593 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:28.788593 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:28.788593 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:28.789860 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:28.789860 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:28.789860 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:28.789860 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:28.789860 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:14:28.789860 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:14:28.789860 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:14:28.789860 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:14:28.789860 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:14:28.789860 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:14:28.789860 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:14:28.789860 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:28.789860 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 311/602] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Aug 29 22:14:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:28.789860 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d859e-2eee-427e-ab71-7b3af1c54430 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:28.827478 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac9673-cf50-400e-96a6-63351324cfd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:28.828795 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac9673-cf50-400e-96a6-63351324cfd7 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:28.829447 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac9673-cf50-400e-96a6-63351324cfd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:28.829864 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac9673-cf50-400e-96a6-63351324cfd7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:28.833107 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:28.841094 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bac9673-cf50-400e-96a6-63351324cfd7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:28.843646 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bac9673-cf50-400e-96a6-63351324cfd7 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:28.869565 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-4bac9673-cf50-400e-96a6-63351324cfd7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:14:28.869565 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:28.869565 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:28.869565 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:28.869565 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:28.869565 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:28.869565 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:28.869565 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:28.869565 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:28.869565 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:28.869565 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:28.869565 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:28.869565 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:14:28.869565 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:14:28.869565 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:14:28.870914 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:14:28.870914 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:28.870914 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:28.870914 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:28.870914 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:28.870914 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:28.870914 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:28.870914 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:28.870914 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:28.870914 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:28.870914 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:28.870914 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:28.870914 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:28.870914 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:28.870914 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:28.870914 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:28.870914 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:28.872003 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:14:28.872003 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:14:28.872003 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:14:28.872003 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:14:28.872003 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:14:28.872003 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:14:28.872003 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:14:28.872003 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:28.875010 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 292/603] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Aug 29 22:14:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:28.880473 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac9673-cf50-400e-96a6-63351324cfd7 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:28.918746 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:28.925703 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d859e-2eee-427e-ab71-7b3af1c54430 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:28.963050 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cda150f-b351-4861-ad88-73400deb053e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:28.963845 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda150f-b351-4861-ad88-73400deb053e None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:28.964225 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda150f-b351-4861-ad88-73400deb053e None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:28.964656 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda150f-b351-4861-ad88-73400deb053e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:28.975905 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cda150f-b351-4861-ad88-73400deb053e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:28.977576 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cda150f-b351-4861-ad88-73400deb053e None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:28.995039 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-6cda150f-b351-4861-ad88-73400deb053e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:28.995039 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:28.995039 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:28.995039 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:28.995039 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:28.995039 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:28.995039 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:28.995039 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:28.995039 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:28.995039 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:28.995039 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:28.995039 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:28.995039 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:14:28.995039 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:14:28.995039 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:14:28.995039 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:14:28.996235 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:28.996235 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:28.996235 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:28.996235 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:28.996235 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:28.996235 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:28.996235 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:28.996235 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:28.996235 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:28.996235 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:28.996235 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:28.996235 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:28.996235 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:28.996235 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:28.996235 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:28.996235 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:28.996235 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:14:28.997364 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:14:28.997364 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:28.997364 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:29.003069 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 312/604] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:14:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:29.003069 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cda150f-b351-4861-ad88-73400deb053e None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:29.011871 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac9673-cf50-400e-96a6-63351324cfd7 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:29.048076 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4edf96-4c89-4001-ab87-84d4f63a9dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:29.048965 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4edf96-4c89-4001-ab87-84d4f63a9dbb None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:29.049435 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4edf96-4c89-4001-ab87-84d4f63a9dbb None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:29.049878 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4edf96-4c89-4001-ab87-84d4f63a9dbb None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:29.050704 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4edf96-4c89-4001-ab87-84d4f63a9dbb None admin] RBAC: Adding query filter params (name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:29.051154 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4edf96-4c89-4001-ab87-84d4f63a9dbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:29.052721 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4edf96-4c89-4001-ab87-84d4f63a9dbb None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:29.061861 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 293/605] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Aug 29 22:14:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:29.062895 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4edf96-4c89-4001-ab87-84d4f63a9dbb None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:29.093336 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:29.107887 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cda150f-b351-4861-ad88-73400deb053e None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:29.143248 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988dffd3-31ce-4346-8cd2-d75983ee47c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:29.144232 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988dffd3-31ce-4346-8cd2-d75983ee47c5 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:29.144753 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988dffd3-31ce-4346-8cd2-d75983ee47c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:29.145213 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988dffd3-31ce-4346-8cd2-d75983ee47c5 None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:29.146098 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988dffd3-31ce-4346-8cd2-d75983ee47c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:29.146593 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988dffd3-31ce-4346-8cd2-d75983ee47c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:29.148212 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988dffd3-31ce-4346-8cd2-d75983ee47c5 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:29.155942 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:29.166824 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 313/606] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Aug 29 22:14:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:29.167900 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988dffd3-31ce-4346-8cd2-d75983ee47c5 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:29.168785 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4edf96-4c89-4001-ab87-84d4f63a9dbb None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:29.203421 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5137e9-e05e-4e0a-9585-c1831e8f203c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:29.204054 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5137e9-e05e-4e0a-9585-c1831e8f203c None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:29.204576 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5137e9-e05e-4e0a-9585-c1831e8f203c None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:29.204858 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5137e9-e05e-4e0a-9585-c1831e8f203c None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:29.205552 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5137e9-e05e-4e0a-9585-c1831e8f203c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:29.205855 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5137e9-e05e-4e0a-9585-c1831e8f203c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:29.207255 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5137e9-e05e-4e0a-9585-c1831e8f203c None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:29.224264 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 294/607] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:14:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:29.225256 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5137e9-e05e-4e0a-9585-c1831e8f203c None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:29.271036 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988dffd3-31ce-4346-8cd2-d75983ee47c5 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:29.311420 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec3fd8-2189-4438-8a11-b7949a7b1022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:29.312505 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec3fd8-2189-4438-8a11-b7949a7b1022 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:29.312881 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec3fd8-2189-4438-8a11-b7949a7b1022 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:29.313262 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec3fd8-2189-4438-8a11-b7949a7b1022 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:29.327930 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec3fd8-2189-4438-8a11-b7949a7b1022 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:29.329893 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec3fd8-2189-4438-8a11-b7949a7b1022 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:29.330606 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5137e9-e05e-4e0a-9585-c1831e8f203c None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:29.350346 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-c5ec3fd8-2189-4438-8a11-b7949a7b1022 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:29.350346 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:29.350346 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:29.350346 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:29.350346 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:29.350346 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:29.350346 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:29.350346 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:29.350346 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:29.350346 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:29.350346 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:29.350346 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:29.350346 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:14:29.350346 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:14:29.350346 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:14:29.350346 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:14:29.351929 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:29.351929 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:29.351929 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:29.351929 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:29.351929 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:29.351929 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:29.351929 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:29.351929 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:29.351929 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:29.351929 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:29.351929 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:29.351929 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:29.351929 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:29.351929 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:29.351929 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:29.351929 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:29.351929 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:14:29.353545 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:14:29.353545 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:29.353545 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:29.355116 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 314/608] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:14:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:29.355627 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:29.360606 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec3fd8-2189-4438-8a11-b7949a7b1022 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:29.374673 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda0b07-09fe-4b86-8037-c5d1a8849603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:29.375396 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda0b07-09fe-4b86-8037-c5d1a8849603 None admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:29.375680 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda0b07-09fe-4b86-8037-c5d1a8849603 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:29.375964 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda0b07-09fe-4b86-8037-c5d1a8849603 None admin] PATH_INFO: `/v3/projects/696ed25cc0cb43fab4bfaf762a90da54/users/d14db90aa108495e9c48584cdc2f7206/roles/bc7b902c0870483ba03c139d941f78ac` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:29.394556 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda0b07-09fe-4b86-8037-c5d1a8849603 None admin] RBAC: Authorizing `identity:create_grant(project_id=696ed25cc0cb43fab4bfaf762a90da54, user_id=d14db90aa108495e9c48584cdc2f7206, role_id=bc7b902c0870483ba03c139d941f78ac)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:29.396649 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda0b07-09fe-4b86-8037-c5d1a8849603 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:29.401445 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:29.423571 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 295/609] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Aug 29 22:14:29 2022] PUT /identity/v3/projects/696ed25cc0cb43fab4bfaf762a90da54/users/d14db90aa108495e9c48584cdc2f7206/roles/bc7b902c0870483ba03c139d941f78ac => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:14:29.425883 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda0b07-09fe-4b86-8037-c5d1a8849603 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:29.492181 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec3fd8-2189-4438-8a11-b7949a7b1022 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:29.559323 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda0b07-09fe-4b86-8037-c5d1a8849603 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:29.571512 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8601bbc4-8139-462a-a64a-ca930cb972af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:29.572137 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601bbc4-8139-462a-a64a-ca930cb972af None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:29.572422 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601bbc4-8139-462a-a64a-ca930cb972af None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:29.572789 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601bbc4-8139-462a-a64a-ca930cb972af None admin] PATH_INFO: `/v3/projects/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:29.588952 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8601bbc4-8139-462a-a64a-ca930cb972af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:29.590452 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8601bbc4-8139-462a-a64a-ca930cb972af None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:29.601940 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d9898-ecd0-47d2-ba6c-bd6780b9b2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:29.603403 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d9898-ecd0-47d2-ba6c-bd6780b9b2ab None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:29.603848 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d9898-ecd0-47d2-ba6c-bd6780b9b2ab None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:29.604400 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d9898-ecd0-47d2-ba6c-bd6780b9b2ab None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:29.605225 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d9898-ecd0-47d2-ba6c-bd6780b9b2ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:29.605706 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d9898-ecd0-47d2-ba6c-bd6780b9b2ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:29.607263 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d9898-ecd0-47d2-ba6c-bd6780b9b2ab None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:29.614362 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-8601bbc4-8139-462a-a64a-ca930cb972af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:14:29.614362 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:29.614362 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:29.614362 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:29.614362 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:29.614362 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:29.614362 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:29.614362 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:29.614362 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:29.614362 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:29.614362 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:29.614362 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:29.614362 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:14:29.614362 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:14:29.614362 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:14:29.615445 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:14:29.615445 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:29.615445 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:29.615445 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:29.615445 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:29.615445 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:29.615445 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:29.615445 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:29.615445 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:29.615445 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:29.615445 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:29.615445 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:29.615445 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:29.615445 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:29.615445 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:29.615445 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:29.615445 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:29.620748 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:14:29.620748 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:14:29.620748 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:14:29.620748 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:14:29.620748 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:14:29.620748 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:14:29.620748 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:14:29.620748 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:29.620748 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 315/610] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Aug 29 22:14:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:29.624246 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8601bbc4-8139-462a-a64a-ca930cb972af None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:29.635753 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 296/611] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:14:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:29.641644 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d9898-ecd0-47d2-ba6c-bd6780b9b2ab None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:29.696514 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:29.730903 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:29.755642 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8601bbc4-8139-462a-a64a-ca930cb972af None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:29.796230 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ffffe-f41d-4d22-b1d0-d6c17d14d1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:29.796481 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d9898-ecd0-47d2-ba6c-bd6780b9b2ab None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:29.796902 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ffffe-f41d-4d22-b1d0-d6c17d14d1ee None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:29.797179 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ffffe-f41d-4d22-b1d0-d6c17d14d1ee None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:29.797450 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ffffe-f41d-4d22-b1d0-d6c17d14d1ee None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:29.798165 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ffffe-f41d-4d22-b1d0-d6c17d14d1ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:29.798480 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ffffe-f41d-4d22-b1d0-d6c17d14d1ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:29.800673 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ffffe-f41d-4d22-b1d0-d6c17d14d1ee None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:29.815567 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 316/612] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Aug 29 22:14:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:14:29.825478 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ffffe-f41d-4d22-b1d0-d6c17d14d1ee None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:29.864967 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20863f41-9680-454e-bc40-4e28d6f4d2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:29.872478 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20863f41-9680-454e-bc40-4e28d6f4d2b3 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:29.873176 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20863f41-9680-454e-bc40-4e28d6f4d2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:29.873596 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20863f41-9680-454e-bc40-4e28d6f4d2b3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:29.887511 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20863f41-9680-454e-bc40-4e28d6f4d2b3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:29.889079 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20863f41-9680-454e-bc40-4e28d6f4d2b3 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:29.913648 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-20863f41-9680-454e-bc40-4e28d6f4d2b3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 22:14:29.913648 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:29.913648 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:29.913648 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:29.913648 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:29.913648 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:29.913648 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:29.913648 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:29.913648 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:29.913648 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:29.913648 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:29.913648 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:29.913648 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:14:29.913648 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:14:29.913648 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:14:29.913648 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:14:29.914723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:29.914723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:29.914723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:14:29.914723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:14:29.914723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:14:29.914723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:14:29.914723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:29.914723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:29.914723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:29.914723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:29.914723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:29.914723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:29.914723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:29.914723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:29.914723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:29.914723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:29.914723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:29.914723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:29.915780 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:29.915780 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:29.915780 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:14:29.915780 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:14:29.915780 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:14:29.915780 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:14:29.915780 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:14:29.915780 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:14:29.915780 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 22:14:29.915780 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:29.915780 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 297/613] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Aug 29 22:14:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:14:29.920689 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20863f41-9680-454e-bc40-4e28d6f4d2b3 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:29.948538 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ffffe-f41d-4d22-b1d0-d6c17d14d1ee None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:29.974738 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:29.995409 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e109df-8eca-4754-a823-1654fa2bf75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:29.996403 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e109df-8eca-4754-a823-1654fa2bf75b None admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:29.996936 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e109df-8eca-4754-a823-1654fa2bf75b None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:29.997403 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e109df-8eca-4754-a823-1654fa2bf75b None admin] PATH_INFO: `/v3/projects/696ed25cc0cb43fab4bfaf762a90da54/users/204c597d751c420796bd972f10a3d149/roles/bc7b902c0870483ba03c139d941f78ac` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:30.021936 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e109df-8eca-4754-a823-1654fa2bf75b None admin] RBAC: Authorizing `identity:create_grant(project_id=696ed25cc0cb43fab4bfaf762a90da54, user_id=204c597d751c420796bd972f10a3d149, role_id=bc7b902c0870483ba03c139d941f78ac)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:30.023402 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e109df-8eca-4754-a823-1654fa2bf75b None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:30.052573 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 317/614] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Aug 29 22:14:29 2022] PUT /identity/v3/projects/696ed25cc0cb43fab4bfaf762a90da54/users/204c597d751c420796bd972f10a3d149/roles/bc7b902c0870483ba03c139d941f78ac => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:14:30.078260 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20863f41-9680-454e-bc40-4e28d6f4d2b3 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:30.104881 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:30.124191 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f2618-5320-467d-a654-c2cbf5e1b88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:30.124760 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f2618-5320-467d-a654-c2cbf5e1b88a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:30.125042 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f2618-5320-467d-a654-c2cbf5e1b88a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:30.125314 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f2618-5320-467d-a654-c2cbf5e1b88a None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:30.126058 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81f2618-5320-467d-a654-c2cbf5e1b88a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:30.126370 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81f2618-5320-467d-a654-c2cbf5e1b88a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:30.127818 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81f2618-5320-467d-a654-c2cbf5e1b88a None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:30.147991 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 298/615] 10.222.0.36 () {56 vars in 1135 bytes} [Mon Aug 29 22:14:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:30.153931 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e109df-8eca-4754-a823-1654fa2bf75b None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:30.295396 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e109df-8eca-4754-a823-1654fa2bf75b None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:30.311689 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2be83e-4bfd-458e-b148-1254129169a8 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:30.312089 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2be83e-4bfd-458e-b148-1254129169a8 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:30.312268 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2be83e-4bfd-458e-b148-1254129169a8 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:30.313897 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 299/616] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:14:30.319739 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42bda39-cb4d-4414-b4b8-cc474dfb6deb None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:30.320032 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42bda39-cb4d-4414-b4b8-cc474dfb6deb None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:30.320311 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42bda39-cb4d-4414-b4b8-cc474dfb6deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:30.334572 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a25a6-1f75-43dd-b072-763e3eedcf6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:30.335216 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a25a6-1f75-43dd-b072-763e3eedcf6b None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:30.335490 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a25a6-1f75-43dd-b072-763e3eedcf6b None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:30.335755 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a25a6-1f75-43dd-b072-763e3eedcf6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:30.349235 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06a25a6-1f75-43dd-b072-763e3eedcf6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:30.349786 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-a42bda39-cb4d-4414-b4b8-cc474dfb6deb None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:14:30.350767 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06a25a6-1f75-43dd-b072-763e3eedcf6b None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:30.351204 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a42bda39-cb4d-4414-b4b8-cc474dfb6deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:14:30.368863 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-e06a25a6-1f75-43dd-b072-763e3eedcf6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:30.368863 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:30.368863 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:30.368863 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:30.368863 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:30.368863 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:30.368863 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:30.368863 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:30.368863 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:30.368863 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:30.368863 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:30.368863 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:30.368863 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:14:30.368863 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:14:30.368863 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:14:30.368863 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:14:30.369911 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:30.369911 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:30.369911 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:30.369911 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:30.369911 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:30.369911 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:30.369911 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:30.369911 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:30.369911 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:30.369911 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:30.369911 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:30.369911 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:30.369911 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:30.369911 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:30.369911 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:30.369911 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:30.369911 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:14:30.370816 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:14:30.370816 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:30.370816 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:30.380750 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 318/617] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:14:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:30.394614 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a25a6-1f75-43dd-b072-763e3eedcf6b None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:30.443450 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 300/618] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:14:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:14:30.455382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:30.566916 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a25a6-1f75-43dd-b072-763e3eedcf6b None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:30.620161 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3ead8-9999-4fdf-b464-1e1256feb916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:30.620813 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3ead8-9999-4fdf-b464-1e1256feb916 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:30.621094 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3ead8-9999-4fdf-b464-1e1256feb916 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:30.621364 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3ead8-9999-4fdf-b464-1e1256feb916 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:30.622020 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd3ead8-9999-4fdf-b464-1e1256feb916 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:30.622323 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd3ead8-9999-4fdf-b464-1e1256feb916 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:30.623698 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd3ead8-9999-4fdf-b464-1e1256feb916 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:30.636150 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 319/619] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:14:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:14:30.641977 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42bda39-cb4d-4414-b4b8-cc474dfb6deb None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:30.791678 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3ead8-9999-4fdf-b464-1e1256feb916 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:30.797129 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42bda39-cb4d-4414-b4b8-cc474dfb6deb None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:30.800345 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:30.849441 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70248db-b0d7-4c36-8856-acb181efac10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:30.850090 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70248db-b0d7-4c36-8856-acb181efac10 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:30.850372 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70248db-b0d7-4c36-8856-acb181efac10 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:30.850638 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70248db-b0d7-4c36-8856-acb181efac10 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:30.863579 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70248db-b0d7-4c36-8856-acb181efac10 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:30.865117 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70248db-b0d7-4c36-8856-acb181efac10 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:30.877020 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-a70248db-b0d7-4c36-8856-acb181efac10 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:14:30.877020 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:30.877020 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:30.877020 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:30.877020 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:30.877020 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:30.877020 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:30.877020 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:30.877020 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:30.877020 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:30.877020 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:30.877020 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:30.877020 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:14:30.877020 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:14:30.877020 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:14:30.878039 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:14:30.878039 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:30.878039 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:30.878039 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:30.878039 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:30.878039 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:30.878039 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:30.878039 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:30.878039 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:30.878039 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:30.878039 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:30.878039 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:30.878039 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:30.878039 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:30.878039 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:30.878039 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:30.878039 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:30.879453 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:14:30.879453 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:14:30.879453 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:14:30.879453 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:14:30.879453 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:14:30.879453 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:14:30.879453 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:14:30.879453 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:30.879453 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 301/620] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Aug 29 22:14:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:14:30.884652 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70248db-b0d7-4c36-8856-acb181efac10 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:30.945964 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:30.969959 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3ead8-9999-4fdf-b464-1e1256feb916 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:31.007250 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715bc1d-f97e-41b0-a759-9d5eb1c9c459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:31.007993 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715bc1d-f97e-41b0-a759-9d5eb1c9c459 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:31.008378 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715bc1d-f97e-41b0-a759-9d5eb1c9c459 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:31.008884 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715bc1d-f97e-41b0-a759-9d5eb1c9c459 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:31.020102 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0715bc1d-f97e-41b0-a759-9d5eb1c9c459 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:14:31.025594 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-0715bc1d-f97e-41b0-a759-9d5eb1c9c459 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:14:31.025594 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:31.025594 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:31.025594 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:31.025594 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:31.025594 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:31.025594 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:31.025594 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:31.025594 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:31.025594 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:31.025594 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:31.025594 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:31.025594 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:14:31.025594 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:14:31.025594 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:14:31.025594 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:14:31.026745 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:14:31.026745 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:14:31.026745 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:14:31.026745 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:14:31.026745 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:31.026745 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:31.026745 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:31.026745 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:31.026745 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:31.026745 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:31.026745 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:31.026745 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:31.026745 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:31.026745 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:31.026745 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:31.026745 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:31.027813 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:31.027813 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:31.027813 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:31.027813 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:31.027813 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:14:31.027813 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:14:31.027813 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:14:31.027813 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:14:31.027813 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:14:31.027813 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:14:31.027813 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:14:31.027813 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:31.029674 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 320/621] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Aug 29 22:14:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:14:31.031355 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70248db-b0d7-4c36-8856-acb181efac10 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:31.035757 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7edc7-8f53-4d33-b543-59ffb3288a76 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:31.036104 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7edc7-8f53-4d33-b543-59ffb3288a76 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:31.036484 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7edc7-8f53-4d33-b543-59ffb3288a76 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:31.038172 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 321/622] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:14:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:14:31.038986 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b7edc7-8f53-4d33-b543-59ffb3288a76 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:31.069931 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb45377-dc6b-4486-8d92-839fa72617fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:31.071459 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb45377-dc6b-4486-8d92-839fa72617fe None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:31.071924 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb45377-dc6b-4486-8d92-839fa72617fe None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:31.072382 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb45377-dc6b-4486-8d92-839fa72617fe None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:31.073438 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb45377-dc6b-4486-8d92-839fa72617fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:31.074037 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb45377-dc6b-4486-8d92-839fa72617fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:31.075757 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb45377-dc6b-4486-8d92-839fa72617fe None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:31.089623 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 302/623] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Aug 29 22:14:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:31.091125 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa93054-bd49-48d8-bcba-d1f74aa98d59 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:31.091589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa93054-bd49-48d8-bcba-d1f74aa98d59 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:31.092074 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa93054-bd49-48d8-bcba-d1f74aa98d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:31.110794 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-4fa93054-bd49-48d8-bcba-d1f74aa98d59 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:14:31.112237 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-4fa93054-bd49-48d8-bcba-d1f74aa98d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:14:31.131177 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:31.145262 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b7edc7-8f53-4d33-b543-59ffb3288a76 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:31.181351 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d342f7-1370-45b0-a2e5-c4ac20e5adeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:31.182059 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d342f7-1370-45b0-a2e5-c4ac20e5adeb None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:31.182436 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d342f7-1370-45b0-a2e5-c4ac20e5adeb None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:31.182769 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d342f7-1370-45b0-a2e5-c4ac20e5adeb None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:31.183542 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d342f7-1370-45b0-a2e5-c4ac20e5adeb None admin] RBAC: Adding query filter params (name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:31.183908 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d342f7-1370-45b0-a2e5-c4ac20e5adeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:31.185431 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d342f7-1370-45b0-a2e5-c4ac20e5adeb None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:31.189218 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 303/624] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:14:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:14:31.190296 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa93054-bd49-48d8-bcba-d1f74aa98d59 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:31.199392 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 322/625] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Aug 29 22:14:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:31.200508 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d342f7-1370-45b0-a2e5-c4ac20e5adeb None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:31.204656 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:31.301649 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa93054-bd49-48d8-bcba-d1f74aa98d59 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:31.307106 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d342f7-1370-45b0-a2e5-c4ac20e5adeb None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:31.340306 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbfaf18-87f1-43e4-a9b8-869edf9f254c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:31.341379 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfaf18-87f1-43e4-a9b8-869edf9f254c None admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:31.341890 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfaf18-87f1-43e4-a9b8-869edf9f254c None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:31.342361 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfaf18-87f1-43e4-a9b8-869edf9f254c None admin] PATH_INFO: `/v3/projects/696ed25cc0cb43fab4bfaf762a90da54/users/5f3472d8ffa748d8828c6a2d89ee7ac7/roles/bc7b902c0870483ba03c139d941f78ac` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:31.342467 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac40ab7-7906-4a25-bd65-352752e8731a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:31.343083 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac40ab7-7906-4a25-bd65-352752e8731a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:31.343367 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac40ab7-7906-4a25-bd65-352752e8731a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:31.343638 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac40ab7-7906-4a25-bd65-352752e8731a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:31.355178 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac40ab7-7906-4a25-bd65-352752e8731a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:31.356789 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac40ab7-7906-4a25-bd65-352752e8731a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:31.360814 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbfaf18-87f1-43e4-a9b8-869edf9f254c None admin] RBAC: Authorizing `identity:create_grant(project_id=696ed25cc0cb43fab4bfaf762a90da54, user_id=5f3472d8ffa748d8828c6a2d89ee7ac7, role_id=bc7b902c0870483ba03c139d941f78ac)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:31.362518 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbfaf18-87f1-43e4-a9b8-869edf9f254c None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:31.372491 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-eac40ab7-7906-4a25-bd65-352752e8731a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:31.372491 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:31.372491 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:31.372491 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:31.372491 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:31.372491 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:31.372491 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:31.372491 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:31.372491 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:31.372491 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:31.372491 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:31.372491 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:31.372491 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:14:31.372491 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:14:31.372491 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:14:31.372491 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:14:31.373818 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:31.373818 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:31.373818 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:31.373818 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:31.373818 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:31.373818 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:31.373818 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:31.373818 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:31.373818 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:31.373818 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:31.373818 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:31.373818 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:31.373818 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:31.373818 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:31.373818 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:31.373818 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:31.373818 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:14:31.375165 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:14:31.375165 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:31.375165 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:31.375165 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 323/626] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:14:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:14:31.379305 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac40ab7-7906-4a25-bd65-352752e8731a None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:31.391972 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 304/627] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Aug 29 22:14:31 2022] PUT /identity/v3/projects/696ed25cc0cb43fab4bfaf762a90da54/users/5f3472d8ffa748d8828c6a2d89ee7ac7/roles/bc7b902c0870483ba03c139d941f78ac => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:14:31.446665 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:31.498312 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac40ab7-7906-4a25-bd65-352752e8731a None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:31.544180 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbfaf18-87f1-43e4-a9b8-869edf9f254c None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:31.544382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a807eb1e-e326-4053-b819-6348e59b658b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:31.545097 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807eb1e-e326-4053-b819-6348e59b658b None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:31.545587 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807eb1e-e326-4053-b819-6348e59b658b None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:31.546972 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807eb1e-e326-4053-b819-6348e59b658b None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:31.547186 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a807eb1e-e326-4053-b819-6348e59b658b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:31.547501 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a807eb1e-e326-4053-b819-6348e59b658b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:31.548918 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:31.549245 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a807eb1e-e326-4053-b819-6348e59b658b None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:31.565126 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 324/628] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:14:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:14:31.570788 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a807eb1e-e326-4053-b819-6348e59b658b None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:31.679879 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a807eb1e-e326-4053-b819-6348e59b658b None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:31.699475 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:31.700543 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbfaf18-87f1-43e4-a9b8-869edf9f254c None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:31.724938 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf971dc-e350-4a0d-a0c4-c84437437d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:31.726013 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf971dc-e350-4a0d-a0c4-c84437437d84 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:31.726517 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf971dc-e350-4a0d-a0c4-c84437437d84 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:31.727289 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf971dc-e350-4a0d-a0c4-c84437437d84 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:31.742409 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf971dc-e350-4a0d-a0c4-c84437437d84 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:31.745133 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf971dc-e350-4a0d-a0c4-c84437437d84 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:31.766856 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-8cf971dc-e350-4a0d-a0c4-c84437437d84 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:14:31.766856 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:31.766856 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:31.766856 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:31.766856 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:31.766856 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:31.766856 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:31.766856 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:31.766856 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:31.766856 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:31.766856 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:31.766856 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:31.766856 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:14:31.766856 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:14:31.766856 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:14:31.766856 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:14:31.767974 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:31.767974 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:31.767974 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:14:31.767974 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:14:31.767974 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:14:31.767974 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:14:31.767974 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:31.767974 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:31.767974 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:31.767974 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:31.767974 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:31.767974 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:31.767974 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:31.767974 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:31.767974 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:31.767974 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:31.767974 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:31.767974 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:31.768975 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:31.768975 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:31.768975 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:14:31.768975 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:14:31.768975 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:14:31.768975 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:14:31.768975 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:14:31.768975 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:14:31.768975 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:14:31.768975 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:31.770104 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 325/629] 10.222.0.36 () {56 vars in 1093 bytes} [Mon Aug 29 22:14:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:14:31.775210 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf971dc-e350-4a0d-a0c4-c84437437d84 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:31.799734 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e425168-0215-4384-b2ee-1ac77289323f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:31.800388 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e425168-0215-4384-b2ee-1ac77289323f None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:31.800690 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e425168-0215-4384-b2ee-1ac77289323f None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:31.800957 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e425168-0215-4384-b2ee-1ac77289323f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:31.820072 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e425168-0215-4384-b2ee-1ac77289323f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:14:31.832196 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-1e425168-0215-4384-b2ee-1ac77289323f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:14:31.832196 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:31.832196 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:31.832196 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:31.832196 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:31.832196 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:31.832196 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:31.832196 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:31.832196 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:31.832196 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:31.832196 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:31.832196 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:31.832196 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:14:31.832196 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:14:31.832196 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:14:31.832196 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:14:31.833259 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:14:31.833259 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:14:31.833259 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:14:31.833259 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:14:31.833259 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:31.833259 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:31.833259 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:31.833259 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:31.833259 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:31.833259 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:31.833259 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:31.833259 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:31.833259 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:31.833259 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:31.833259 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:31.833259 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:31.834725 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:31.834725 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:31.834725 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:31.834725 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:31.834725 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:14:31.834725 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:14:31.834725 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:14:31.834725 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:14:31.834725 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:14:31.834725 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:14:31.834725 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:14:31.834725 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:31.834725 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 305/630] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Aug 29 22:14:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:14:31.839542 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e425168-0215-4384-b2ee-1ac77289323f None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:31.964821 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf971dc-e350-4a0d-a0c4-c84437437d84 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:31.994041 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:32.005700 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26610e99-f3d2-4b31-a533-5925d64367cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:32.006317 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26610e99-f3d2-4b31-a533-5925d64367cc None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:32.006598 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26610e99-f3d2-4b31-a533-5925d64367cc None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:32.006925 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26610e99-f3d2-4b31-a533-5925d64367cc None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:32.007784 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26610e99-f3d2-4b31-a533-5925d64367cc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:32.008203 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26610e99-f3d2-4b31-a533-5925d64367cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:32.009672 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26610e99-f3d2-4b31-a533-5925d64367cc None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:32.029285 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 326/631] 10.222.0.36 () {56 vars in 1133 bytes} [Mon Aug 29 22:14:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:14:32.030553 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70962b-dd74-4405-b753-50ac74d09fb9 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:32.030843 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70962b-dd74-4405-b753-50ac74d09fb9 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:32.031119 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70962b-dd74-4405-b753-50ac74d09fb9 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:32.036663 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e425168-0215-4384-b2ee-1ac77289323f None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:32.036938 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 327/632] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:14:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:14:32.037931 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70962b-dd74-4405-b753-50ac74d09fb9 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:32.073888 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:32.076345 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f42474-9849-4e57-9550-a8fed1d033c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:32.077565 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f42474-9849-4e57-9550-a8fed1d033c6 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:32.078213 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f42474-9849-4e57-9550-a8fed1d033c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:32.078705 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f42474-9849-4e57-9550-a8fed1d033c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:32.079572 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f42474-9849-4e57-9550-a8fed1d033c6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:32.080070 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f42474-9849-4e57-9550-a8fed1d033c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:32.082265 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f42474-9849-4e57-9550-a8fed1d033c6 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:32.092430 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 306/633] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Aug 29 22:14:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:32.098766 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474889f-6a68-47b0-8b6e-e16afd5a77e6 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:32.099297 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474889f-6a68-47b0-8b6e-e16afd5a77e6 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:32.099889 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474889f-6a68-47b0-8b6e-e16afd5a77e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:32.119309 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-8474889f-6a68-47b0-8b6e-e16afd5a77e6 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:14:32.120983 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-8474889f-6a68-47b0-8b6e-e16afd5a77e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:14:32.143108 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70962b-dd74-4405-b753-50ac74d09fb9 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:32.178224 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bbcd24-75cc-495a-83b5-fcaa11641ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:32.178910 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbcd24-75cc-495a-83b5-fcaa11641ff0 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:32.179192 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbcd24-75cc-495a-83b5-fcaa11641ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:32.179461 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbcd24-75cc-495a-83b5-fcaa11641ff0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:32.207983 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 307/634] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:14:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:14:32.209016 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8474889f-6a68-47b0-8b6e-e16afd5a77e6 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:32.251077 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bbcd24-75cc-495a-83b5-fcaa11641ff0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:32.252493 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bbcd24-75cc-495a-83b5-fcaa11641ff0 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:32.292868 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:32.320396 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:32.333207 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8474889f-6a68-47b0-8b6e-e16afd5a77e6 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:32.384077 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ebc1be-28ed-437e-9e73-b9ac07a230d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:32.386887 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ebc1be-28ed-437e-9e73-b9ac07a230d7 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:32.388467 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ebc1be-28ed-437e-9e73-b9ac07a230d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:32.388897 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ebc1be-28ed-437e-9e73-b9ac07a230d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:32.433869 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ebc1be-28ed-437e-9e73-b9ac07a230d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:32.435394 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ebc1be-28ed-437e-9e73-b9ac07a230d7 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:32.443470 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 328/635] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:14:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:14:32.451397 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bbcd24-75cc-495a-83b5-fcaa11641ff0 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:32.487322 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-06ebc1be-28ed-437e-9e73-b9ac07a230d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:32.487322 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:32.487322 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:32.487322 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:32.487322 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:32.487322 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:32.487322 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:32.487322 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:32.487322 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:32.487322 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:32.487322 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:32.487322 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:32.487322 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:14:32.487322 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:14:32.487322 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:14:32.487322 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:14:32.488817 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:32.488817 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:32.488817 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:32.488817 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:32.488817 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:32.488817 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:32.488817 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:32.488817 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:32.488817 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:32.488817 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:32.488817 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:32.488817 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:32.488817 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:32.488817 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:32.488817 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:32.488817 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:32.488817 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:14:32.490885 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:14:32.490885 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:32.490885 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:32.494968 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 308/636] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:14:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:32.500896 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ebc1be-28ed-437e-9e73-b9ac07a230d7 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:32.610722 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bbcd24-75cc-495a-83b5-fcaa11641ff0 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:32.649468 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ebc1be-28ed-437e-9e73-b9ac07a230d7 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:32.659394 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655dffda-2b33-4578-81f8-368d18201783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:32.660407 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655dffda-2b33-4578-81f8-368d18201783 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:32.660754 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655dffda-2b33-4578-81f8-368d18201783 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:32.661012 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655dffda-2b33-4578-81f8-368d18201783 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:32.661768 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:32.665389 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:32.679058 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655dffda-2b33-4578-81f8-368d18201783 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:32.681282 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655dffda-2b33-4578-81f8-368d18201783 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:32.690498 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676deb7a-3110-4d57-b66d-255262ef11bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:32.691119 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676deb7a-3110-4d57-b66d-255262ef11bc None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:32.691401 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676deb7a-3110-4d57-b66d-255262ef11bc None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:32.691670 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676deb7a-3110-4d57-b66d-255262ef11bc None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:32.692335 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676deb7a-3110-4d57-b66d-255262ef11bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:32.692664 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676deb7a-3110-4d57-b66d-255262ef11bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:32.694030 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676deb7a-3110-4d57-b66d-255262ef11bc None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:32.699247 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-655dffda-2b33-4578-81f8-368d18201783 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:32.699247 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:32.699247 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:32.699247 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:32.699247 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:32.699247 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:32.699247 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:32.699247 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:32.699247 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:32.699247 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:32.699247 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:32.699247 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:32.699247 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:14:32.699247 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:14:32.699247 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:14:32.699247 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:14:32.700278 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:32.700278 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:32.700278 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:32.700278 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:32.700278 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:32.700278 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:32.700278 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:32.700278 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:32.700278 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:32.700278 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:32.700278 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:32.700278 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:32.700278 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:32.700278 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:32.700278 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:32.700278 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:32.700278 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:14:32.701194 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:14:32.701194 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:32.701194 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:32.705409 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 329/637] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:14:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:32.706798 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9abda2-4e3b-4a34-81f3-1c201a48d1e5 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:32.707157 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9abda2-4e3b-4a34-81f3-1c201a48d1e5 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:32.707423 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9abda2-4e3b-4a34-81f3-1c201a48d1e5 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:32.716795 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 330/638] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:14:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:14:32.716795 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9abda2-4e3b-4a34-81f3-1c201a48d1e5 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:32.717167 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 309/639] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:14:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:14:32.717167 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676deb7a-3110-4d57-b66d-255262ef11bc None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:32.841485 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9abda2-4e3b-4a34-81f3-1c201a48d1e5 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:32.855814 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676deb7a-3110-4d57-b66d-255262ef11bc None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:32.881290 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7b8a7-a7a1-42e4-8951-fab1e20a5f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:32.881840 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7b8a7-a7a1-42e4-8951-fab1e20a5f39 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:32.882123 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7b8a7-a7a1-42e4-8951-fab1e20a5f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:32.882391 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7b8a7-a7a1-42e4-8951-fab1e20a5f39 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:32.898263 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a7b8a7-a7a1-42e4-8951-fab1e20a5f39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:14:32.907972 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-83a7b8a7-a7a1-42e4-8951-fab1e20a5f39 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:14:32.907972 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:32.907972 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:32.907972 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:32.907972 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:32.907972 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:32.907972 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:32.907972 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:32.907972 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:32.907972 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:32.907972 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:32.907972 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:32.907972 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:14:32.907972 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:14:32.907972 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:14:32.907972 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:14:32.909137 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:14:32.909137 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:14:32.909137 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:14:32.909137 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:14:32.909137 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:32.909137 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:32.909137 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:32.909137 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:32.909137 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:32.909137 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:32.909137 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:32.909137 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:32.909137 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:32.909137 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:32.909137 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:32.909137 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:32.910172 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:32.910172 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:32.910172 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:32.910172 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:32.910172 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:14:32.910172 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:14:32.910172 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:14:32.910172 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:14:32.910172 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:14:32.910172 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:14:32.910172 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:14:32.910172 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:32.910172 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 331/640] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Aug 29 22:14:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:32.910172 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7b8a7-a7a1-42e4-8951-fab1e20a5f39 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:32.915135 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a709c8c4-6a69-4d53-9f22-2b61e43c46f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:32.916015 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709c8c4-6a69-4d53-9f22-2b61e43c46f4 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:32.916303 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709c8c4-6a69-4d53-9f22-2b61e43c46f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:32.919179 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709c8c4-6a69-4d53-9f22-2b61e43c46f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:32.919879 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a709c8c4-6a69-4d53-9f22-2b61e43c46f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:32.920190 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a709c8c4-6a69-4d53-9f22-2b61e43c46f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:32.921654 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a709c8c4-6a69-4d53-9f22-2b61e43c46f4 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:32.937940 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 310/641] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:14:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:32.939846 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3e482-3cee-4f1a-9b8b-76a10f4d396b None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:32.940301 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3e482-3cee-4f1a-9b8b-76a10f4d396b None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:32.940767 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3e482-3cee-4f1a-9b8b-76a10f4d396b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:32.964371 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-18a3e482-3cee-4f1a-9b8b-76a10f4d396b None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:14:32.965596 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-18a3e482-3cee-4f1a-9b8b-76a10f4d396b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:14:32.979876 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:32.993514 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:33.046271 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7b8a7-a7a1-42e4-8951-fab1e20a5f39 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:33.064482 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 311/642] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:14:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:14:33.064482 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a3e482-3cee-4f1a-9b8b-76a10f4d396b None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:33.107381 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8db3f-af29-41ef-b0fb-b8e15e4cf6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:33.108180 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8db3f-af29-41ef-b0fb-b8e15e4cf6d6 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:33.108586 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8db3f-af29-41ef-b0fb-b8e15e4cf6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:33.108961 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8db3f-af29-41ef-b0fb-b8e15e4cf6d6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:33.120104 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c8db3f-af29-41ef-b0fb-b8e15e4cf6d6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:33.122591 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c8db3f-af29-41ef-b0fb-b8e15e4cf6d6 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:33.139679 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-54c8db3f-af29-41ef-b0fb-b8e15e4cf6d6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 29 22:14:33.139679 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:33.139679 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:33.139679 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:33.139679 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:33.139679 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:33.139679 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:33.139679 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:33.139679 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:33.139679 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:33.139679 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:33.139679 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:33.139679 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:14:33.139679 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:14:33.139679 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:14:33.139679 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:14:33.141149 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:33.141149 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:33.141149 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:14:33.141149 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:14:33.141149 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:14:33.141149 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:14:33.141149 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:33.141149 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:33.141149 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:33.141149 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:33.141149 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:33.141149 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:33.141149 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:33.141149 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:33.141149 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:33.141149 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:33.141149 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:33.141149 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:33.143702 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:33.143702 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:33.143702 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:14:33.143702 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:14:33.143702 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:14:33.143702 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:14:33.143702 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:14:33.143702 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:14:33.143702 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 29 22:14:33.143702 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:33.143702 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 332/643] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:14:32 2022] GET /identity/v3/users/glance => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:33.148831 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8db3f-af29-41ef-b0fb-b8e15e4cf6d6 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:33.198934 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a3e482-3cee-4f1a-9b8b-76a10f4d396b None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:33.242375 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc23a7-bac4-42e6-aed8-330523873cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:33.243050 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc23a7-bac4-42e6-aed8-330523873cf8 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:33.243414 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc23a7-bac4-42e6-aed8-330523873cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:33.243703 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc23a7-bac4-42e6-aed8-330523873cf8 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:33.244410 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cc23a7-bac4-42e6-aed8-330523873cf8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:33.244752 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cc23a7-bac4-42e6-aed8-330523873cf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:33.246152 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cc23a7-bac4-42e6-aed8-330523873cf8 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:33.260585 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 312/644] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Aug 29 22:14:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:33.261546 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc23a7-bac4-42e6-aed8-330523873cf8 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:33.286104 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8db3f-af29-41ef-b0fb-b8e15e4cf6d6 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:33.296913 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:33.301833 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:33.338159 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15285ebc-97e3-4119-acd7-281200bf94aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:33.339504 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15285ebc-97e3-4119-acd7-281200bf94aa None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:33.340433 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15285ebc-97e3-4119-acd7-281200bf94aa None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:33.341086 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15285ebc-97e3-4119-acd7-281200bf94aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:33.350169 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15285ebc-97e3-4119-acd7-281200bf94aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:33.352264 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15285ebc-97e3-4119-acd7-281200bf94aa None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:33.371429 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-15285ebc-97e3-4119-acd7-281200bf94aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:14:33.371429 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:33.371429 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:33.371429 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:33.371429 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:33.371429 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:33.371429 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:33.371429 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:33.371429 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:33.371429 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:33.371429 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:33.371429 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:33.371429 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:14:33.371429 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:14:33.371429 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:14:33.372799 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:14:33.372799 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:33.372799 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:33.372799 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:33.372799 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:33.372799 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:33.372799 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:33.372799 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:33.372799 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:33.372799 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:33.372799 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:33.372799 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:33.372799 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:33.372799 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:33.372799 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:33.372799 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:33.372799 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:33.374079 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:14:33.374079 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:14:33.374079 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:14:33.374079 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:14:33.374079 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:14:33.374079 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:14:33.374079 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:14:33.374079 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:33.376683 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 333/645] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Aug 29 22:14:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:33.378263 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15285ebc-97e3-4119-acd7-281200bf94aa None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:33.404653 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc23a7-bac4-42e6-aed8-330523873cf8 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:33.443071 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9456b5dd-cfd4-4d8e-b9f8-6a5bf8e1b1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:33.444219 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456b5dd-cfd4-4d8e-b9f8-6a5bf8e1b1f9 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:33.444541 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456b5dd-cfd4-4d8e-b9f8-6a5bf8e1b1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:33.444818 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456b5dd-cfd4-4d8e-b9f8-6a5bf8e1b1f9 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:33.445617 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9456b5dd-cfd4-4d8e-b9f8-6a5bf8e1b1f9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:33.446019 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9456b5dd-cfd4-4d8e-b9f8-6a5bf8e1b1f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:33.447745 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9456b5dd-cfd4-4d8e-b9f8-6a5bf8e1b1f9 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:33.472496 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 313/646] 10.222.0.36 () {56 vars in 1137 bytes} [Mon Aug 29 22:14:33 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:33.472496 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9456b5dd-cfd4-4d8e-b9f8-6a5bf8e1b1f9 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:33.500758 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15285ebc-97e3-4119-acd7-281200bf94aa None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:33.537469 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27175cf8-1003-45c2-b572-853775be2eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:33.538410 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27175cf8-1003-45c2-b572-853775be2eee None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:33.538846 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27175cf8-1003-45c2-b572-853775be2eee None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:33.539331 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27175cf8-1003-45c2-b572-853775be2eee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:33.552373 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27175cf8-1003-45c2-b572-853775be2eee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:33.554003 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27175cf8-1003-45c2-b572-853775be2eee None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:33.559467 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:33.569408 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-27175cf8-1003-45c2-b572-853775be2eee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:33.569408 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:33.569408 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:33.569408 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:33.569408 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:33.569408 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:33.569408 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:33.569408 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:33.569408 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:33.569408 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:33.569408 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:33.569408 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:33.569408 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:14:33.569408 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:14:33.569408 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:14:33.569408 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:14:33.570445 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:33.570445 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:33.570445 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:33.570445 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:33.570445 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:33.570445 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:33.570445 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:33.570445 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:33.570445 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:33.570445 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:33.570445 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:33.570445 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:33.570445 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:33.570445 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:33.570445 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:33.570445 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:33.570445 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:14:33.571674 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:14:33.571674 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:33.571674 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:33.571674 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 334/647] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:14:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:33.572004 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27175cf8-1003-45c2-b572-853775be2eee None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:33.587774 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9456b5dd-cfd4-4d8e-b9f8-6a5bf8e1b1f9 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:33.595348 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:33.624638 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6da964c-df01-4744-9850-e9ad4732f76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:33.625255 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da964c-df01-4744-9850-e9ad4732f76a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:33.625546 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da964c-df01-4744-9850-e9ad4732f76a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:33.625813 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da964c-df01-4744-9850-e9ad4732f76a None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:33.626511 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6da964c-df01-4744-9850-e9ad4732f76a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:33.626821 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6da964c-df01-4744-9850-e9ad4732f76a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:33.628250 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6da964c-df01-4744-9850-e9ad4732f76a None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:33.641352 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 314/648] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Aug 29 22:14:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:33.642196 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6da964c-df01-4744-9850-e9ad4732f76a None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:33.700219 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27175cf8-1003-45c2-b572-853775be2eee None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:33.737000 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bdebf7-9782-4a3b-b2ab-cce2be3c0558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:33.737642 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bdebf7-9782-4a3b-b2ab-cce2be3c0558 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:33.737919 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bdebf7-9782-4a3b-b2ab-cce2be3c0558 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:33.738189 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bdebf7-9782-4a3b-b2ab-cce2be3c0558 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:33.748594 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bdebf7-9782-4a3b-b2ab-cce2be3c0558 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:14:33.753853 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-c1bdebf7-9782-4a3b-b2ab-cce2be3c0558 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:14:33.753853 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:33.753853 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:33.753853 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:33.753853 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:33.753853 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:33.753853 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:33.753853 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:33.753853 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:33.753853 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:33.753853 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:33.753853 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:33.753853 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:14:33.753853 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:14:33.753853 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:14:33.753853 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:14:33.754975 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:14:33.754975 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:14:33.754975 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:14:33.754975 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:14:33.754975 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:33.754975 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:33.754975 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:33.754975 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:33.754975 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:33.754975 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:33.754975 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:33.754975 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:33.754975 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:33.754975 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:33.754975 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:33.754975 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:33.755826 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:33.755826 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:33.755826 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:33.755826 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:33.755826 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:14:33.755826 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:14:33.755826 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:14:33.755826 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:14:33.755826 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:14:33.755826 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:14:33.755826 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:14:33.755826 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:33.755826 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 335/649] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Aug 29 22:14:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:33.755826 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bdebf7-9782-4a3b-b2ab-cce2be3c0558 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:33.763651 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6da964c-df01-4744-9850-e9ad4732f76a None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:33.798166 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d7d5ff-a80c-49bc-8849-aeaa9df27415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:33.798769 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7d5ff-a80c-49bc-8849-aeaa9df27415 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:33.799058 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7d5ff-a80c-49bc-8849-aeaa9df27415 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:33.799358 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7d5ff-a80c-49bc-8849-aeaa9df27415 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:33.811476 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:33.834027 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:33.857271 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bdebf7-9782-4a3b-b2ab-cce2be3c0558 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:33.887611 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d7d5ff-a80c-49bc-8849-aeaa9df27415 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:33.889902 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d7d5ff-a80c-49bc-8849-aeaa9df27415 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:33.891749 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7184f56-b9d0-411a-8fe0-fe5a714457f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:33.892375 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7184f56-b9d0-411a-8fe0-fe5a714457f6 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:33.892697 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7184f56-b9d0-411a-8fe0-fe5a714457f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:33.892964 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7184f56-b9d0-411a-8fe0-fe5a714457f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:33.893639 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7184f56-b9d0-411a-8fe0-fe5a714457f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:33.893910 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7184f56-b9d0-411a-8fe0-fe5a714457f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:33.895318 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7184f56-b9d0-411a-8fe0-fe5a714457f6 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:33.907278 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 336/650] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:14:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:33.908089 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7184f56-b9d0-411a-8fe0-fe5a714457f6 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:33.995069 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 315/651] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:14:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:14:33.996266 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291b0be-6daf-4c19-993a-52a94a89cae7 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:33.996691 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291b0be-6daf-4c19-993a-52a94a89cae7 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:33.996867 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291b0be-6daf-4c19-993a-52a94a89cae7 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:33.998086 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 316/652] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:14:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:14:33.998773 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291b0be-6daf-4c19-993a-52a94a89cae7 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:34.018511 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7184f56-b9d0-411a-8fe0-fe5a714457f6 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:34.042402 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:34.054697 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd12016-46a5-4d41-88d5-4046ceedf9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:34.055533 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd12016-46a5-4d41-88d5-4046ceedf9b9 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:34.055893 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd12016-46a5-4d41-88d5-4046ceedf9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:34.056161 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd12016-46a5-4d41-88d5-4046ceedf9b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:34.056977 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd12016-46a5-4d41-88d5-4046ceedf9b9 None admin] RBAC: Adding query filter params (role.id=bc7b902c0870483ba03c139d941f78ac, scope.project.id=696ed25cc0cb43fab4bfaf762a90da54, user.id=90b7213b7111456a93e294ce40b95b21) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:34.057287 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd12016-46a5-4d41-88d5-4046ceedf9b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:34.058740 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd12016-46a5-4d41-88d5-4046ceedf9b9 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:34.064711 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 337/653] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Aug 29 22:14:33 2022] GET /identity/v3/role_assignments?user.id=90b7213b7111456a93e294ce40b95b21&scope.project.id=696ed25cc0cb43fab4bfaf762a90da54&role.id=bc7b902c0870483ba03c139d941f78ac => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:34.065335 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd12016-46a5-4d41-88d5-4046ceedf9b9 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:34.067931 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:34.125124 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291b0be-6daf-4c19-993a-52a94a89cae7 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:34.164614 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3bf2dc-00a3-4aba-b0f0-a7d43926b79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:34.165549 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3bf2dc-00a3-4aba-b0f0-a7d43926b79a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:34.165817 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3bf2dc-00a3-4aba-b0f0-a7d43926b79a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:34.166210 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3bf2dc-00a3-4aba-b0f0-a7d43926b79a None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:34.166882 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3bf2dc-00a3-4aba-b0f0-a7d43926b79a None admin] RBAC: Adding query filter params (name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:34.167201 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3bf2dc-00a3-4aba-b0f0-a7d43926b79a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:34.168790 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3bf2dc-00a3-4aba-b0f0-a7d43926b79a None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:34.185701 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 317/654] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Aug 29 22:14:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:34.185701 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3bf2dc-00a3-4aba-b0f0-a7d43926b79a None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:34.190203 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd12016-46a5-4d41-88d5-4046ceedf9b9 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:34.242191 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0661c51-60aa-43a8-b91a-aa832a4c185d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:34.243415 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0661c51-60aa-43a8-b91a-aa832a4c185d None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:34.243577 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0661c51-60aa-43a8-b91a-aa832a4c185d None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:34.243919 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0661c51-60aa-43a8-b91a-aa832a4c185d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:34.253285 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0661c51-60aa-43a8-b91a-aa832a4c185d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:34.254262 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0661c51-60aa-43a8-b91a-aa832a4c185d None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:34.272382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-c0661c51-60aa-43a8-b91a-aa832a4c185d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 22:14:34.272382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:34.272382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:34.272382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:34.272382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:34.272382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:34.272382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:34.272382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:34.272382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:34.272382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:34.272382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:34.272382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:34.272382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:14:34.272382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:14:34.272382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:14:34.272382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:14:34.273727 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:34.273727 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:34.273727 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:14:34.273727 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:14:34.273727 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:14:34.273727 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:14:34.273727 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:34.273727 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:34.273727 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:34.273727 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:34.273727 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:34.273727 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:34.273727 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:34.273727 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:34.273727 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:34.273727 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:34.273727 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:34.273727 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:34.277642 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:34.277642 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:34.277642 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:14:34.277642 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:14:34.277642 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:14:34.277642 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:14:34.277642 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:14:34.277642 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:14:34.277642 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 22:14:34.277642 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:34.277642 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 338/655] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:14:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:34.277642 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4daa07-fdd5-4fe9-9d65-d7cf77bb3b3e None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:34.277642 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4daa07-fdd5-4fe9-9d65-d7cf77bb3b3e None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:34.278502 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4daa07-fdd5-4fe9-9d65-d7cf77bb3b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:34.299294 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-ff4daa07-fdd5-4fe9-9d65-d7cf77bb3b3e None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:14:34.301955 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ff4daa07-fdd5-4fe9-9d65-d7cf77bb3b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:14:34.327196 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:34.331205 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3bf2dc-00a3-4aba-b0f0-a7d43926b79a None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:34.375339 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef69820-5add-4bfb-b32c-c1bde1cfc354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:34.376100 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef69820-5add-4bfb-b32c-c1bde1cfc354 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:34.376470 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef69820-5add-4bfb-b32c-c1bde1cfc354 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:34.376836 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef69820-5add-4bfb-b32c-c1bde1cfc354 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:34.379198 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:34.390422 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef69820-5add-4bfb-b32c-c1bde1cfc354 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:34.391975 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef69820-5add-4bfb-b32c-c1bde1cfc354 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:34.404274 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 339/656] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:14:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:14:34.404274 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4daa07-fdd5-4fe9-9d65-d7cf77bb3b3e None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:34.407812 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-6ef69820-5add-4bfb-b32c-c1bde1cfc354 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:34.407812 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:34.407812 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:34.407812 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:34.407812 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:34.407812 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:34.407812 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:34.407812 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:34.407812 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:34.407812 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:34.407812 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:34.407812 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:34.407812 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:14:34.407812 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:14:34.407812 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:14:34.407812 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:14:34.408785 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:34.408785 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:34.408785 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:34.408785 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:34.408785 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:34.408785 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:34.408785 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:34.408785 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:34.408785 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:34.408785 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:34.408785 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:34.408785 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:34.408785 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:34.408785 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:34.408785 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:34.408785 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:34.408785 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:14:34.409779 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:14:34.409779 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:34.409779 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:34.409779 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 318/657] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:14:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:34.410403 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef69820-5add-4bfb-b32c-c1bde1cfc354 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:34.523355 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4daa07-fdd5-4fe9-9d65-d7cf77bb3b3e None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:34.525613 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef69820-5add-4bfb-b32c-c1bde1cfc354 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:34.559109 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9cd1aa-a512-4038-b85b-5c8a6366a2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:34.559748 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9cd1aa-a512-4038-b85b-5c8a6366a2cd None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:34.560024 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9cd1aa-a512-4038-b85b-5c8a6366a2cd None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:34.560293 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9cd1aa-a512-4038-b85b-5c8a6366a2cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:34.562574 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f7ef4-7797-4ae6-aa4b-ff415c0be768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:34.563259 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f7ef4-7797-4ae6-aa4b-ff415c0be768 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:34.563627 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f7ef4-7797-4ae6-aa4b-ff415c0be768 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:34.563968 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f7ef4-7797-4ae6-aa4b-ff415c0be768 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:34.564811 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f7ef4-7797-4ae6-aa4b-ff415c0be768 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:34.565188 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f7ef4-7797-4ae6-aa4b-ff415c0be768 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:34.566694 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f7ef4-7797-4ae6-aa4b-ff415c0be768 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:34.572000 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9cd1aa-a512-4038-b85b-5c8a6366a2cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:34.573642 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9cd1aa-a512-4038-b85b-5c8a6366a2cd None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:34.587067 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 319/658] 10.222.0.36 () {56 vars in 1137 bytes} [Mon Aug 29 22:14:34 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:34.588014 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f7ef4-7797-4ae6-aa4b-ff415c0be768 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:34.589383 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-3b9cd1aa-a512-4038-b85b-5c8a6366a2cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:34.589383 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:34.589383 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:34.589383 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:34.589383 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:34.589383 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:34.589383 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:34.589383 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:34.589383 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:34.589383 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:34.589383 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:34.589383 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:34.589383 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:14:34.589383 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:14:34.589383 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:14:34.589383 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:14:34.591090 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:34.591090 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:34.591090 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:34.591090 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:34.591090 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:34.591090 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:34.591090 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:34.591090 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:34.591090 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:34.591090 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:34.591090 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:34.591090 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:34.591090 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:34.591090 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:34.591090 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:34.591090 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:34.591090 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:14:34.592188 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:14:34.592188 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:34.592188 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:34.592188 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 340/659] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:14:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:34.601454 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9cd1aa-a512-4038-b85b-5c8a6366a2cd None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:34.603075 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:34.666377 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:34.710831 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f7ef4-7797-4ae6-aa4b-ff415c0be768 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:34.734056 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9cd1aa-a512-4038-b85b-5c8a6366a2cd None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:34.752257 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee3b7f-4aa8-47fd-b38b-2f8752b68727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:34.752908 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee3b7f-4aa8-47fd-b38b-2f8752b68727 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:34.753191 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee3b7f-4aa8-47fd-b38b-2f8752b68727 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:34.753469 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee3b7f-4aa8-47fd-b38b-2f8752b68727 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:34.754176 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ee3b7f-4aa8-47fd-b38b-2f8752b68727 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:34.754479 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ee3b7f-4aa8-47fd-b38b-2f8752b68727 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:34.755857 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ee3b7f-4aa8-47fd-b38b-2f8752b68727 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:34.768964 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 320/660] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:14:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:34.769817 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee3b7f-4aa8-47fd-b38b-2f8752b68727 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:34.780565 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b7d3d2-279f-433f-be69-dc9dee9be497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:34.781653 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b7d3d2-279f-433f-be69-dc9dee9be497 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:34.782166 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b7d3d2-279f-433f-be69-dc9dee9be497 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:34.782780 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b7d3d2-279f-433f-be69-dc9dee9be497 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:34.783472 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b7d3d2-279f-433f-be69-dc9dee9be497 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:34.783774 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b7d3d2-279f-433f-be69-dc9dee9be497 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:34.785653 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b7d3d2-279f-433f-be69-dc9dee9be497 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:34.803254 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 341/661] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:14:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:34.803254 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b7d3d2-279f-433f-be69-dc9dee9be497 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:34.849430 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:34.883420 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee3b7f-4aa8-47fd-b38b-2f8752b68727 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:34.919969 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b7d3d2-279f-433f-be69-dc9dee9be497 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:34.921433 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d95d067-a55a-4a89-a18e-b50b23bf5253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:34.922046 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95d067-a55a-4a89-a18e-b50b23bf5253 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:34.922326 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95d067-a55a-4a89-a18e-b50b23bf5253 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:34.922600 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95d067-a55a-4a89-a18e-b50b23bf5253 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:34.923608 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:34.966108 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14276e6d-27eb-497d-893e-d5ed959b7604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:34.966748 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14276e6d-27eb-497d-893e-d5ed959b7604 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:34.967024 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14276e6d-27eb-497d-893e-d5ed959b7604 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:34.967650 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14276e6d-27eb-497d-893e-d5ed959b7604 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:34.978706 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14276e6d-27eb-497d-893e-d5ed959b7604 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:14:34.983544 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-14276e6d-27eb-497d-893e-d5ed959b7604 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:14:34.983544 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:34.983544 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:34.983544 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:34.983544 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:34.983544 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:34.983544 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:34.983544 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:34.983544 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:34.983544 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:34.983544 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:34.983544 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:34.983544 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:14:34.983544 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:14:34.983544 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:14:34.983544 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:14:34.984486 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:14:34.984486 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:14:34.984486 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:14:34.984486 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:14:34.984486 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:34.984486 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:34.984486 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:34.984486 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:34.984486 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:34.984486 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:34.984486 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:34.984486 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:34.984486 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:34.984486 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:34.984486 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:34.984486 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:34.985351 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:34.985351 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:34.985351 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:34.985351 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:34.985351 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:14:34.985351 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:14:34.985351 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:14:34.985351 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:14:34.985351 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:14:34.985351 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:14:34.985351 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:14:34.985351 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:34.989874 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 342/662] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Aug 29 22:14:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:34.990826 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14276e6d-27eb-497d-893e-d5ed959b7604 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:34.998716 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d95d067-a55a-4a89-a18e-b50b23bf5253 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:35.000620 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d95d067-a55a-4a89-a18e-b50b23bf5253 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:35.075056 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:35.099602 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14276e6d-27eb-497d-893e-d5ed959b7604 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:35.112253 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 321/663] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:14:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:14:35.112253 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d95d067-a55a-4a89-a18e-b50b23bf5253 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:35.140318 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833f809-a120-4868-a21e-8a57b3d08a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:35.140987 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833f809-a120-4868-a21e-8a57b3d08a9d None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:35.141274 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833f809-a120-4868-a21e-8a57b3d08a9d None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:35.141549 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833f809-a120-4868-a21e-8a57b3d08a9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:35.148431 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0833f809-a120-4868-a21e-8a57b3d08a9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:35.150535 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0833f809-a120-4868-a21e-8a57b3d08a9d None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:35.162152 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-0833f809-a120-4868-a21e-8a57b3d08a9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:14:35.162152 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:35.162152 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:35.162152 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:35.162152 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:35.162152 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:35.162152 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:35.162152 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:35.162152 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:35.162152 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:35.162152 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:35.162152 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:35.162152 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:14:35.162152 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:14:35.162152 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:14:35.163287 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:14:35.163287 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:35.163287 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:35.163287 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:35.163287 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:35.163287 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:35.163287 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:35.163287 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:35.163287 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:35.163287 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:35.163287 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:35.163287 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:35.163287 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:35.163287 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:35.163287 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:35.163287 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:35.163287 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:35.164683 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:14:35.164683 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:14:35.164683 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:14:35.164683 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:14:35.164683 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:14:35.164683 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:14:35.164683 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:14:35.164683 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:35.168100 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 343/664] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Aug 29 22:14:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:35.168963 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833f809-a120-4868-a21e-8a57b3d08a9d None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:35.196393 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:35.225856 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d95d067-a55a-4a89-a18e-b50b23bf5253 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:35.269930 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefafe34-bec4-4dfc-92b9-495e446a0d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:35.270862 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefafe34-bec4-4dfc-92b9-495e446a0d15 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:35.271144 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefafe34-bec4-4dfc-92b9-495e446a0d15 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:35.271420 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefafe34-bec4-4dfc-92b9-495e446a0d15 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:35.279284 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833f809-a120-4868-a21e-8a57b3d08a9d None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:35.279448 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefafe34-bec4-4dfc-92b9-495e446a0d15 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:35.280996 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefafe34-bec4-4dfc-92b9-495e446a0d15 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:35.293566 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-fefafe34-bec4-4dfc-92b9-495e446a0d15 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 22:14:35.293566 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:35.293566 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:35.293566 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:35.293566 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:35.293566 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:35.293566 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:35.293566 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:35.293566 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:35.293566 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:35.293566 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:35.293566 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:35.293566 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:14:35.293566 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:14:35.293566 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:14:35.293566 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:14:35.294569 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:35.294569 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:35.294569 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:14:35.294569 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:14:35.294569 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:14:35.294569 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:14:35.294569 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:35.294569 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:35.294569 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:35.294569 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:35.294569 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:35.294569 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:35.294569 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:35.294569 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:35.294569 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:35.294569 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:35.294569 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:35.294569 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:35.295541 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:35.295541 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:35.295541 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:14:35.295541 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:14:35.295541 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:14:35.295541 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:14:35.295541 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:14:35.295541 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:14:35.295541 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 22:14:35.295541 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:35.295541 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 322/665] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Aug 29 22:14:35 2022] GET /identity/v3/users/neutron => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:35.295541 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefafe34-bec4-4dfc-92b9-495e446a0d15 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:35.322236 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe82d49-70ad-415a-b589-2124cbec2a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:35.322886 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe82d49-70ad-415a-b589-2124cbec2a64 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:35.323141 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe82d49-70ad-415a-b589-2124cbec2a64 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:35.323425 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe82d49-70ad-415a-b589-2124cbec2a64 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:35.324081 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe82d49-70ad-415a-b589-2124cbec2a64 None admin] RBAC: Adding query filter params (name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:35.324385 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe82d49-70ad-415a-b589-2124cbec2a64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:35.325876 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe82d49-70ad-415a-b589-2124cbec2a64 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:35.330210 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:35.335773 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 344/666] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Aug 29 22:14:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:35.336830 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe82d49-70ad-415a-b589-2124cbec2a64 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:35.410316 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefafe34-bec4-4dfc-92b9-495e446a0d15 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:35.430093 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:35.446709 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe82d49-70ad-415a-b589-2124cbec2a64 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:35.448584 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb42c3-55a2-4bea-b2ad-6dceb0daf678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:35.449635 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb42c3-55a2-4bea-b2ad-6dceb0daf678 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:35.449635 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb42c3-55a2-4bea-b2ad-6dceb0daf678 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:35.449810 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb42c3-55a2-4bea-b2ad-6dceb0daf678 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:35.460890 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beb42c3-55a2-4bea-b2ad-6dceb0daf678 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:35.462986 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beb42c3-55a2-4bea-b2ad-6dceb0daf678 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:35.477949 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-2beb42c3-55a2-4bea-b2ad-6dceb0daf678 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:35.477949 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:35.477949 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:35.477949 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:35.477949 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:35.477949 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:35.477949 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:35.477949 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:35.477949 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:35.477949 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:35.477949 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:35.477949 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:35.477949 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:14:35.477949 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:14:35.477949 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:14:35.477949 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:14:35.478968 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:35.478968 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:35.478968 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:35.478968 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:35.478968 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:35.478968 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:35.478968 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:35.478968 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:35.478968 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:35.478968 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:35.478968 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:35.478968 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:35.478968 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:35.478968 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:35.478968 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:35.478968 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:35.478968 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:14:35.479883 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:14:35.479883 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:35.479883 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:35.479883 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 323/667] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:14:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:35.479883 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb42c3-55a2-4bea-b2ad-6dceb0daf678 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:35.486126 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16238359-17c0-4b16-8e24-976a1342d6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:35.486745 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16238359-17c0-4b16-8e24-976a1342d6af None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:35.487022 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16238359-17c0-4b16-8e24-976a1342d6af None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:35.487291 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16238359-17c0-4b16-8e24-976a1342d6af None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:35.487981 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16238359-17c0-4b16-8e24-976a1342d6af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:35.488287 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16238359-17c0-4b16-8e24-976a1342d6af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:35.489762 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16238359-17c0-4b16-8e24-976a1342d6af None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:35.502338 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 345/668] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Aug 29 22:14:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:35.505736 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16238359-17c0-4b16-8e24-976a1342d6af None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:35.568112 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:35.588876 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb42c3-55a2-4bea-b2ad-6dceb0daf678 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:35.611139 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16238359-17c0-4b16-8e24-976a1342d6af None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:35.625491 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71fc213-50d8-4225-9e36-52d8d03b660e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:35.626148 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71fc213-50d8-4225-9e36-52d8d03b660e None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:35.626385 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71fc213-50d8-4225-9e36-52d8d03b660e None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:35.626655 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71fc213-50d8-4225-9e36-52d8d03b660e None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:35.627386 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71fc213-50d8-4225-9e36-52d8d03b660e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:35.627683 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71fc213-50d8-4225-9e36-52d8d03b660e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:35.629370 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71fc213-50d8-4225-9e36-52d8d03b660e None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:35.652358 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 324/669] 10.222.0.36 () {56 vars in 1139 bytes} [Mon Aug 29 22:14:35 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:35.652358 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71fc213-50d8-4225-9e36-52d8d03b660e None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:35.655451 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a1050-feee-49f0-b8de-94a4340b22bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:35.656164 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a1050-feee-49f0-b8de-94a4340b22bf None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:35.656503 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a1050-feee-49f0-b8de-94a4340b22bf None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:35.656797 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a1050-feee-49f0-b8de-94a4340b22bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:35.669674 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2a1050-feee-49f0-b8de-94a4340b22bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:35.671436 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2a1050-feee-49f0-b8de-94a4340b22bf None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:35.679994 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:35.690742 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-cd2a1050-feee-49f0-b8de-94a4340b22bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:35.690742 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:35.690742 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:35.690742 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:35.690742 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:35.690742 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:35.690742 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:35.690742 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:35.690742 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:35.690742 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:35.690742 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:35.690742 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:35.690742 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:14:35.690742 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:14:35.690742 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:14:35.690742 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:14:35.691780 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:35.691780 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:35.691780 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:35.691780 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:35.691780 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:35.691780 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:35.691780 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:35.691780 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:35.691780 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:35.691780 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:35.691780 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:35.691780 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:35.691780 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:35.691780 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:35.691780 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:35.691780 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:35.691780 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:14:35.692799 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:14:35.692799 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:35.692799 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:35.700137 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 346/670] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:14:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:35.700982 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a1050-feee-49f0-b8de-94a4340b22bf None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:35.768795 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71fc213-50d8-4225-9e36-52d8d03b660e None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:35.808208 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a1050-feee-49f0-b8de-94a4340b22bf None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:35.814437 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc6d01-d1d2-4830-8ae8-fce5b97d19a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:35.816111 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc6d01-d1d2-4830-8ae8-fce5b97d19a4 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:35.816572 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc6d01-d1d2-4830-8ae8-fce5b97d19a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:35.817010 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc6d01-d1d2-4830-8ae8-fce5b97d19a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:35.818240 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fc6d01-d1d2-4830-8ae8-fce5b97d19a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:35.818690 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fc6d01-d1d2-4830-8ae8-fce5b97d19a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:35.820950 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fc6d01-d1d2-4830-8ae8-fce5b97d19a4 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:35.832525 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:35.839004 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 325/671] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:14:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:35.839795 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc6d01-d1d2-4830-8ae8-fce5b97d19a4 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:35.849302 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85276411-8858-4e04-a1c4-cfedb1de0747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:35.849919 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85276411-8858-4e04-a1c4-cfedb1de0747 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:35.850194 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85276411-8858-4e04-a1c4-cfedb1de0747 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:35.850462 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85276411-8858-4e04-a1c4-cfedb1de0747 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:35.851191 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85276411-8858-4e04-a1c4-cfedb1de0747 None admin] RBAC: Adding query filter params (role.id=bc7b902c0870483ba03c139d941f78ac, scope.project.id=696ed25cc0cb43fab4bfaf762a90da54, user.id=e7a399ee5db44100a88a4ffb451512aa) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:35.851497 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85276411-8858-4e04-a1c4-cfedb1de0747 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:35.853012 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85276411-8858-4e04-a1c4-cfedb1de0747 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:35.864783 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 347/672] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Aug 29 22:14:35 2022] GET /identity/v3/role_assignments?user.id=e7a399ee5db44100a88a4ffb451512aa&scope.project.id=696ed25cc0cb43fab4bfaf762a90da54&role.id=bc7b902c0870483ba03c139d941f78ac => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:35.866761 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85276411-8858-4e04-a1c4-cfedb1de0747 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:35.962632 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:35.991717 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc6d01-d1d2-4830-8ae8-fce5b97d19a4 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:36.013474 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85276411-8858-4e04-a1c4-cfedb1de0747 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:36.031357 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a30a673-96bd-4c64-b075-76eed4d67440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:36.032476 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30a673-96bd-4c64-b075-76eed4d67440 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:36.033077 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30a673-96bd-4c64-b075-76eed4d67440 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:36.033448 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30a673-96bd-4c64-b075-76eed4d67440 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:36.056929 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb61702-738a-436c-9b31-987c9487dcf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:36.057143 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb61702-738a-436c-9b31-987c9487dcf2 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:36.057346 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb61702-738a-436c-9b31-987c9487dcf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:36.057589 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb61702-738a-436c-9b31-987c9487dcf2 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:36.058241 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb61702-738a-436c-9b31-987c9487dcf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:36.058542 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb61702-738a-436c-9b31-987c9487dcf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:36.059918 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb61702-738a-436c-9b31-987c9487dcf2 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:36.073951 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 348/673] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:14:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:36.074537 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb61702-738a-436c-9b31-987c9487dcf2 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:36.121543 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:36.124654 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a30a673-96bd-4c64-b075-76eed4d67440 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:36.126703 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a30a673-96bd-4c64-b075-76eed4d67440 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:36.184895 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb61702-738a-436c-9b31-987c9487dcf2 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:36.208982 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:36.222363 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18788d2a-7f90-44bd-9520-9f50af7699c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:36.223018 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18788d2a-7f90-44bd-9520-9f50af7699c9 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:36.223291 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18788d2a-7f90-44bd-9520-9f50af7699c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:36.223572 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18788d2a-7f90-44bd-9520-9f50af7699c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:36.232885 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 326/674] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:14:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:14:36.234495 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830be1a-83c8-41f0-9c37-598757fb9565 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:36.234945 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830be1a-83c8-41f0-9c37-598757fb9565 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:36.235378 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830be1a-83c8-41f0-9c37-598757fb9565 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:36.236852 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 327/675] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:14:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:14:36.238121 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2830be1a-83c8-41f0-9c37-598757fb9565 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:36.241694 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18788d2a-7f90-44bd-9520-9f50af7699c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:36.243440 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18788d2a-7f90-44bd-9520-9f50af7699c9 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:36.256669 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-18788d2a-7f90-44bd-9520-9f50af7699c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:14:36.256669 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:36.256669 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:36.256669 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:36.256669 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:36.256669 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:36.256669 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:36.256669 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:36.256669 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:36.256669 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:36.256669 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:36.256669 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:36.256669 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:14:36.256669 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:14:36.256669 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:14:36.257626 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:14:36.257626 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:36.257626 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:36.257626 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:36.257626 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:36.257626 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:36.257626 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:36.257626 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:36.257626 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:36.257626 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:36.257626 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:36.257626 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:36.257626 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:36.257626 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:36.257626 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:36.257626 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:36.257626 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:36.263898 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:14:36.263898 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:14:36.263898 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:14:36.263898 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:14:36.263898 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:14:36.263898 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:14:36.263898 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:14:36.263898 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:36.263898 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 349/676] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Aug 29 22:14:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:36.263898 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18788d2a-7f90-44bd-9520-9f50af7699c9 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:36.353616 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:36.358733 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2830be1a-83c8-41f0-9c37-598757fb9565 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:36.374434 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18788d2a-7f90-44bd-9520-9f50af7699c9 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:36.397091 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c569640b-7f8a-4740-b0a1-98f7deb8f1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:36.397736 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c569640b-7f8a-4740-b0a1-98f7deb8f1c0 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:36.398019 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c569640b-7f8a-4740-b0a1-98f7deb8f1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:36.398290 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c569640b-7f8a-4740-b0a1-98f7deb8f1c0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:36.405910 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c569640b-7f8a-4740-b0a1-98f7deb8f1c0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:36.407353 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c569640b-7f8a-4740-b0a1-98f7deb8f1c0 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:36.413661 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc012c-ea78-4ff9-b222-b570d3ec8a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:36.414599 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc012c-ea78-4ff9-b222-b570d3ec8a2e None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:36.415029 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc012c-ea78-4ff9-b222-b570d3ec8a2e None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:36.415443 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc012c-ea78-4ff9-b222-b570d3ec8a2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:36.420220 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-c569640b-7f8a-4740-b0a1-98f7deb8f1c0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 22:14:36.420220 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:36.420220 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:36.420220 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:36.420220 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:36.420220 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:36.420220 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:36.420220 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:36.420220 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:36.420220 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:36.420220 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:36.420220 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:36.420220 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:14:36.420220 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:14:36.420220 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:14:36.420220 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:14:36.421393 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:36.421393 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:36.421393 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:14:36.421393 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:14:36.421393 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:14:36.421393 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:14:36.421393 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:36.421393 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:36.421393 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:36.421393 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:36.421393 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:36.421393 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:36.421393 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:36.421393 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:36.421393 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:36.421393 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:36.421393 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:36.421393 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:36.422380 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:36.422380 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:36.422380 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:14:36.422380 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:14:36.422380 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:14:36.422380 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:14:36.422380 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:14:36.422380 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:14:36.422380 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 22:14:36.422380 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:36.422380 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 328/677] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Aug 29 22:14:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:36.422992 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90530c-3dac-4f88-abe2-0a363afa752a None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:36.422992 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90530c-3dac-4f88-abe2-0a363afa752a None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:36.423140 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90530c-3dac-4f88-abe2-0a363afa752a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:36.430291 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc012c-ea78-4ff9-b222-b570d3ec8a2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:36.432230 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc012c-ea78-4ff9-b222-b570d3ec8a2e None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:36.442491 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-3a90530c-3dac-4f88-abe2-0a363afa752a None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:14:36.443711 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3a90530c-3dac-4f88-abe2-0a363afa752a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:14:36.448004 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-ccfc012c-ea78-4ff9-b222-b570d3ec8a2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:36.448004 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:36.448004 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:36.448004 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:36.448004 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:36.448004 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:36.448004 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:36.448004 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:36.448004 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:36.448004 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:36.448004 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:36.448004 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:36.448004 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:14:36.448004 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:14:36.448004 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:14:36.448004 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:14:36.449131 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:36.449131 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:36.449131 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:36.449131 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:36.449131 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:36.449131 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:36.449131 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:36.449131 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:36.449131 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:36.449131 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:36.449131 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:36.449131 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:36.449131 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:36.449131 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:36.449131 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:36.449131 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:36.449131 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:14:36.450169 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:14:36.450169 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:36.450169 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:36.451618 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 350/678] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:14:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:36.452701 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc012c-ea78-4ff9-b222-b570d3ec8a2e None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:36.491521 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:36.527589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 329/679] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:14:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:14:36.527589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90530c-3dac-4f88-abe2-0a363afa752a None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:36.586337 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc012c-ea78-4ff9-b222-b570d3ec8a2e None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:36.623211 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:36.635221 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90530c-3dac-4f88-abe2-0a363afa752a None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:36.638470 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd2401-f72e-489f-ae7d-ed57d33f89cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:36.639910 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd2401-f72e-489f-ae7d-ed57d33f89cd None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:36.640356 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd2401-f72e-489f-ae7d-ed57d33f89cd None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:36.640819 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd2401-f72e-489f-ae7d-ed57d33f89cd None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:36.641661 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccd2401-f72e-489f-ae7d-ed57d33f89cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:36.642201 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccd2401-f72e-489f-ae7d-ed57d33f89cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:36.644387 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccd2401-f72e-489f-ae7d-ed57d33f89cd None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:36.662088 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 351/680] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Aug 29 22:14:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:36.663225 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd2401-f72e-489f-ae7d-ed57d33f89cd None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:36.685010 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef5359-94b5-449e-857a-1ac21d71a089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:36.686238 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef5359-94b5-449e-857a-1ac21d71a089 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:36.686669 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef5359-94b5-449e-857a-1ac21d71a089 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:36.687110 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef5359-94b5-449e-857a-1ac21d71a089 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:36.688013 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef5359-94b5-449e-857a-1ac21d71a089 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:36.688481 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef5359-94b5-449e-857a-1ac21d71a089 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:36.691024 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef5359-94b5-449e-857a-1ac21d71a089 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:36.715073 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 330/681] 10.222.0.36 () {56 vars in 1135 bytes} [Mon Aug 29 22:14:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:36.716203 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef5359-94b5-449e-857a-1ac21d71a089 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:36.775688 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:36.785989 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd2401-f72e-489f-ae7d-ed57d33f89cd None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:36.825719 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e1580a-80b5-4171-b5e1-3f67aa29a422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:36.826330 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1580a-80b5-4171-b5e1-3f67aa29a422 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:36.826611 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1580a-80b5-4171-b5e1-3f67aa29a422 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:36.826884 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1580a-80b5-4171-b5e1-3f67aa29a422 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:36.827528 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e1580a-80b5-4171-b5e1-3f67aa29a422 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:36.827832 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e1580a-80b5-4171-b5e1-3f67aa29a422 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:36.829252 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e1580a-80b5-4171-b5e1-3f67aa29a422 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:36.840729 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef5359-94b5-449e-857a-1ac21d71a089 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:36.845699 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 352/682] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:14:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:36.846730 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e1580a-80b5-4171-b5e1-3f67aa29a422 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:36.880366 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7fd59e-d309-4372-b023-03f7b3454b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:36.881014 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7fd59e-d309-4372-b023-03f7b3454b50 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:36.881302 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7fd59e-d309-4372-b023-03f7b3454b50 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:36.881630 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7fd59e-d309-4372-b023-03f7b3454b50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:36.882369 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7fd59e-d309-4372-b023-03f7b3454b50 None admin] RBAC: Adding query filter params (role.id=bc7b902c0870483ba03c139d941f78ac, scope.project.id=696ed25cc0cb43fab4bfaf762a90da54, user.id=d14db90aa108495e9c48584cdc2f7206) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:36.882689 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7fd59e-d309-4372-b023-03f7b3454b50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:36.884391 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7fd59e-d309-4372-b023-03f7b3454b50 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:36.894442 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 331/683] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Aug 29 22:14:36 2022] GET /identity/v3/role_assignments?user.id=d14db90aa108495e9c48584cdc2f7206&scope.project.id=696ed25cc0cb43fab4bfaf762a90da54&role.id=bc7b902c0870483ba03c139d941f78ac => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:36.895409 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7fd59e-d309-4372-b023-03f7b3454b50 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:36.919345 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:37.012757 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e1580a-80b5-4171-b5e1-3f67aa29a422 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:37.032403 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7fd59e-d309-4372-b023-03f7b3454b50 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:37.069349 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc28618-4178-40e3-890b-d7cd0261b915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:37.070656 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc28618-4178-40e3-890b-d7cd0261b915 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:37.070656 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc28618-4178-40e3-890b-d7cd0261b915 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:37.070656 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc28618-4178-40e3-890b-d7cd0261b915 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:37.085210 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7846ba2-e321-42ac-93bb-d664a26eb30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:37.086052 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7846ba2-e321-42ac-93bb-d664a26eb30f None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:37.086276 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7846ba2-e321-42ac-93bb-d664a26eb30f None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:37.086687 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7846ba2-e321-42ac-93bb-d664a26eb30f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:37.104442 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7846ba2-e321-42ac-93bb-d664a26eb30f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:14:37.106431 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:37.111045 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-e7846ba2-e321-42ac-93bb-d664a26eb30f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:14:37.111045 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:37.111045 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:37.111045 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:37.111045 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:37.111045 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:37.111045 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:37.111045 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:37.111045 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:37.111045 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:37.111045 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:37.111045 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:37.111045 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:14:37.111045 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:14:37.111045 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:14:37.111045 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:14:37.112259 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:14:37.112259 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:14:37.112259 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:14:37.112259 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:14:37.112259 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:37.112259 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:37.112259 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:37.112259 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:37.112259 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:37.112259 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:37.112259 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:37.112259 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:37.112259 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:37.112259 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:37.112259 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:37.112259 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:37.113201 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:37.113201 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:37.113201 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:37.113201 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:37.113201 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:14:37.113201 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:14:37.113201 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:14:37.113201 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:14:37.113201 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:14:37.113201 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:14:37.113201 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:14:37.113201 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:37.113201 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 332/684] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Aug 29 22:14:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:37.113987 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7846ba2-e321-42ac-93bb-d664a26eb30f None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:37.178701 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc28618-4178-40e3-890b-d7cd0261b915 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:37.180511 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc28618-4178-40e3-890b-d7cd0261b915 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:37.223553 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:37.265681 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7846ba2-e321-42ac-93bb-d664a26eb30f None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:37.308388 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3db3a2-ad96-4a60-862c-db623a92b3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:37.310059 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3db3a2-ad96-4a60-862c-db623a92b3e9 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:37.310913 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3db3a2-ad96-4a60-862c-db623a92b3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:37.311652 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3db3a2-ad96-4a60-862c-db623a92b3e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:37.317981 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 353/685] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:14:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:14:37.318974 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc28618-4178-40e3-890b-d7cd0261b915 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:37.320610 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3db3a2-ad96-4a60-862c-db623a92b3e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:37.322519 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3db3a2-ad96-4a60-862c-db623a92b3e9 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:37.337527 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-5d3db3a2-ad96-4a60-862c-db623a92b3e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:14:37.337527 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:37.337527 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:37.337527 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:37.337527 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:37.337527 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:37.337527 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:37.337527 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:37.337527 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:37.337527 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:37.337527 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:37.337527 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:37.337527 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:14:37.337527 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:14:37.337527 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:14:37.338527 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:14:37.338527 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:37.338527 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:37.338527 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:37.338527 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:37.338527 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:37.338527 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:37.338527 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:37.338527 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:37.338527 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:37.338527 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:37.338527 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:37.338527 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:37.338527 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:37.338527 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:37.338527 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:37.338527 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:37.339444 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:14:37.339444 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:14:37.339444 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:14:37.339444 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:14:37.339444 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:14:37.339444 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:14:37.339444 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:14:37.339444 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:37.342048 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 333/686] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Aug 29 22:14:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:37.343059 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3db3a2-ad96-4a60-862c-db623a92b3e9 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:37.387403 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:37.454797 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc28618-4178-40e3-890b-d7cd0261b915 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:37.497077 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3db3a2-ad96-4a60-862c-db623a92b3e9 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:37.504434 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ef619-e99c-4ae4-971f-e1f8816c3638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:37.505082 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ef619-e99c-4ae4-971f-e1f8816c3638 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:37.505358 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ef619-e99c-4ae4-971f-e1f8816c3638 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:37.505615 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ef619-e99c-4ae4-971f-e1f8816c3638 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:37.506292 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1ef619-e99c-4ae4-971f-e1f8816c3638 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:37.506589 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1ef619-e99c-4ae4-971f-e1f8816c3638 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:37.508131 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1ef619-e99c-4ae4-971f-e1f8816c3638 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:37.519598 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 354/687] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:14:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:37.520624 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ef619-e99c-4ae4-971f-e1f8816c3638 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:37.541303 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:37.547611 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9c152-285f-4977-adde-9dda251ebe7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:37.548579 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9c152-285f-4977-adde-9dda251ebe7a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:37.549052 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9c152-285f-4977-adde-9dda251ebe7a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:37.549534 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9c152-285f-4977-adde-9dda251ebe7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:37.561041 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b9c152-285f-4977-adde-9dda251ebe7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:37.562829 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b9c152-285f-4977-adde-9dda251ebe7a None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:37.579363 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-99b9c152-285f-4977-adde-9dda251ebe7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:37.579363 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:37.579363 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:37.579363 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:37.579363 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:37.579363 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:37.579363 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:37.579363 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:37.579363 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:37.579363 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:37.579363 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:37.579363 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:37.579363 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:14:37.579363 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:14:37.579363 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:14:37.579363 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:14:37.581214 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:37.581214 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:37.581214 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:37.581214 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:37.581214 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:37.581214 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:37.581214 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:37.581214 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:37.581214 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:37.581214 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:37.581214 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:37.581214 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:37.581214 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:37.581214 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:37.581214 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:37.581214 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:37.581214 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:14:37.583114 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:14:37.583114 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:37.583114 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:37.585814 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 334/688] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:14:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:37.587658 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9c152-285f-4977-adde-9dda251ebe7a None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:37.652730 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ef619-e99c-4ae4-971f-e1f8816c3638 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:37.677214 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:37.705189 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f123a-32d6-484b-bf7d-6f8571a7a266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:37.705991 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f123a-32d6-484b-bf7d-6f8571a7a266 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:37.706267 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f123a-32d6-484b-bf7d-6f8571a7a266 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:37.706536 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f123a-32d6-484b-bf7d-6f8571a7a266 None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:37.707351 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8f123a-32d6-484b-bf7d-6f8571a7a266 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:37.707859 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8f123a-32d6-484b-bf7d-6f8571a7a266 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:37.709595 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8f123a-32d6-484b-bf7d-6f8571a7a266 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:37.729553 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 355/689] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Aug 29 22:14:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:37.730867 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f123a-32d6-484b-bf7d-6f8571a7a266 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:37.771338 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9c152-285f-4977-adde-9dda251ebe7a None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:37.857804 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971bb1ed-b655-40fe-af89-77f14009bb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:37.858755 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bb1ed-b655-40fe-af89-77f14009bb4a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:37.859169 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bb1ed-b655-40fe-af89-77f14009bb4a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:37.859569 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bb1ed-b655-40fe-af89-77f14009bb4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:37.885858 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971bb1ed-b655-40fe-af89-77f14009bb4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:37.889227 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971bb1ed-b655-40fe-af89-77f14009bb4a None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:37.900525 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f123a-32d6-484b-bf7d-6f8571a7a266 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:37.911161 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-971bb1ed-b655-40fe-af89-77f14009bb4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:37.911161 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:37.911161 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:37.911161 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:37.911161 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:37.911161 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:37.911161 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:37.911161 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:37.911161 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:37.911161 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:37.911161 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:37.911161 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:37.911161 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:14:37.911161 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:14:37.911161 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:14:37.911161 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:14:37.912598 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:37.912598 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:37.912598 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:37.912598 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:37.912598 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:37.912598 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:37.912598 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:37.912598 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:37.912598 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:37.912598 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:37.912598 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:37.912598 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:37.912598 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:37.912598 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:37.912598 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:37.912598 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:37.912598 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:14:37.913479 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:14:37.913479 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:37.913479 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:37.913479 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 335/690] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:14:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:37.913713 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971bb1ed-b655-40fe-af89-77f14009bb4a None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:37.945902 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d382c0-521e-4011-b886-f741c26a5f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:37.946521 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d382c0-521e-4011-b886-f741c26a5f54 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:37.946802 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d382c0-521e-4011-b886-f741c26a5f54 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:37.947104 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d382c0-521e-4011-b886-f741c26a5f54 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:37.947811 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d382c0-521e-4011-b886-f741c26a5f54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:37.948119 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d382c0-521e-4011-b886-f741c26a5f54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:37.949543 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d382c0-521e-4011-b886-f741c26a5f54 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:37.964563 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 356/691] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:14:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:37.964563 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d382c0-521e-4011-b886-f741c26a5f54 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:37.974162 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:38.005837 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:38.047253 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971bb1ed-b655-40fe-af89-77f14009bb4a None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:38.078067 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d382c0-521e-4011-b886-f741c26a5f54 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:38.088060 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0bbeba-01a0-4d7f-9608-9cfcdbe372b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:38.089013 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0bbeba-01a0-4d7f-9608-9cfcdbe372b9 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:38.089448 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0bbeba-01a0-4d7f-9608-9cfcdbe372b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:38.089736 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0bbeba-01a0-4d7f-9608-9cfcdbe372b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:38.090457 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0bbeba-01a0-4d7f-9608-9cfcdbe372b9 None admin] RBAC: Adding query filter params (role.id=bc7b902c0870483ba03c139d941f78ac, scope.project.id=696ed25cc0cb43fab4bfaf762a90da54, user.id=204c597d751c420796bd972f10a3d149) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:38.090771 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0bbeba-01a0-4d7f-9608-9cfcdbe372b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:38.092220 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0bbeba-01a0-4d7f-9608-9cfcdbe372b9 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:38.098206 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 336/692] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Aug 29 22:14:37 2022] GET /identity/v3/role_assignments?user.id=204c597d751c420796bd972f10a3d149&scope.project.id=696ed25cc0cb43fab4bfaf762a90da54&role.id=bc7b902c0870483ba03c139d941f78ac => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:38.099454 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e1c16-4c8c-438e-8883-be54cf2de9a2 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:38.099739 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e1c16-4c8c-438e-8883-be54cf2de9a2 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:38.100016 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e1c16-4c8c-438e-8883-be54cf2de9a2 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:38.101426 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 337/693] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:14:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:14:38.102121 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e1c16-4c8c-438e-8883-be54cf2de9a2 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:38.144394 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd798c-e149-4672-a224-d1c3f2ee679a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:38.147521 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd798c-e149-4672-a224-d1c3f2ee679a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:38.147521 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd798c-e149-4672-a224-d1c3f2ee679a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:38.147521 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd798c-e149-4672-a224-d1c3f2ee679a None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:38.147521 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cd798c-e149-4672-a224-d1c3f2ee679a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:38.147521 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cd798c-e149-4672-a224-d1c3f2ee679a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:38.148113 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cd798c-e149-4672-a224-d1c3f2ee679a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:38.163105 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 357/694] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:14:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:38.164909 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa6f4b-63a2-48a1-8d89-1f9f9ea12b48 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:38.165121 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa6f4b-63a2-48a1-8d89-1f9f9ea12b48 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:38.165418 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa6f4b-63a2-48a1-8d89-1f9f9ea12b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:38.194694 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-b7aa6f4b-63a2-48a1-8d89-1f9f9ea12b48 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:14:38.198195 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b7aa6f4b-63a2-48a1-8d89-1f9f9ea12b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:14:38.258991 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:38.270620 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e1c16-4c8c-438e-8883-be54cf2de9a2 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:38.299346 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 358/695] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:14:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:14:38.300062 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa6f4b-63a2-48a1-8d89-1f9f9ea12b48 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:38.318532 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65eeedf-7ae4-4695-87a3-eef177e0fbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:38.319181 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65eeedf-7ae4-4695-87a3-eef177e0fbbc None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:38.319457 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65eeedf-7ae4-4695-87a3-eef177e0fbbc None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:38.319727 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65eeedf-7ae4-4695-87a3-eef177e0fbbc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:38.329505 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65eeedf-7ae4-4695-87a3-eef177e0fbbc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:38.331029 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65eeedf-7ae4-4695-87a3-eef177e0fbbc None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:38.335324 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:38.349285 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-a65eeedf-7ae4-4695-87a3-eef177e0fbbc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:14:38.349285 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:38.349285 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:38.349285 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:38.349285 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:38.349285 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:38.349285 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:38.349285 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:38.349285 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:38.349285 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:38.349285 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:38.349285 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:38.349285 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:14:38.349285 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:14:38.349285 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:14:38.350240 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:14:38.350240 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:38.350240 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:38.350240 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:38.350240 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:38.350240 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:38.350240 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:38.350240 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:38.350240 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:38.350240 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:38.350240 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:38.350240 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:38.350240 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:38.350240 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:38.350240 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:38.350240 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:38.350240 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:38.351133 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:14:38.351133 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:14:38.351133 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:14:38.351133 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:14:38.351133 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:14:38.351133 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:14:38.351133 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:14:38.351133 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:38.353918 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 338/696] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Aug 29 22:14:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:38.360547 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65eeedf-7ae4-4695-87a3-eef177e0fbbc None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:38.423124 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa6f4b-63a2-48a1-8d89-1f9f9ea12b48 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:38.457376 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24489f-217e-4992-9cc4-db82ab51da4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:38.458198 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24489f-217e-4992-9cc4-db82ab51da4f None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:38.458553 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24489f-217e-4992-9cc4-db82ab51da4f None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:38.458934 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24489f-217e-4992-9cc4-db82ab51da4f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:38.467557 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e24489f-217e-4992-9cc4-db82ab51da4f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:38.468548 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e24489f-217e-4992-9cc4-db82ab51da4f None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:38.481388 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-1e24489f-217e-4992-9cc4-db82ab51da4f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:14:38.481388 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:38.481388 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:38.481388 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:38.481388 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:38.481388 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:38.481388 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:38.481388 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:38.481388 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:38.481388 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:38.481388 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:38.481388 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:38.481388 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:14:38.481388 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:14:38.481388 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:14:38.481388 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:14:38.482379 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:38.482379 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:38.482379 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:14:38.482379 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:14:38.482379 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:14:38.482379 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:14:38.482379 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:38.482379 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:38.482379 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:38.482379 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:38.482379 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:38.482379 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:38.482379 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:38.482379 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:38.482379 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:38.482379 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:38.482379 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:38.482379 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:38.483372 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:38.483372 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:38.483372 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:14:38.483372 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:14:38.483372 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:14:38.483372 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:14:38.483372 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:14:38.483372 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:14:38.483372 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:14:38.483372 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:38.484249 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 359/697] 10.222.0.36 () {56 vars in 1093 bytes} [Mon Aug 29 22:14:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:38.489344 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65eeedf-7ae4-4695-87a3-eef177e0fbbc None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:38.491230 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24489f-217e-4992-9cc4-db82ab51da4f None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:38.568640 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b21179a-f8eb-45c8-a945-752ae4a6ade0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:38.569279 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21179a-f8eb-45c8-a945-752ae4a6ade0 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:38.569562 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21179a-f8eb-45c8-a945-752ae4a6ade0 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:38.569835 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21179a-f8eb-45c8-a945-752ae4a6ade0 None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:38.570717 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b21179a-f8eb-45c8-a945-752ae4a6ade0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:38.571024 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b21179a-f8eb-45c8-a945-752ae4a6ade0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:38.572499 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b21179a-f8eb-45c8-a945-752ae4a6ade0 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:38.604385 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 339/698] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Aug 29 22:14:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:38.611210 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b21179a-f8eb-45c8-a945-752ae4a6ade0 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:38.635019 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:38.636785 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:38.667619 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24489f-217e-4992-9cc4-db82ab51da4f None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:38.719293 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634ea93-daea-40af-853e-5abf7136cbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:38.720420 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634ea93-daea-40af-853e-5abf7136cbb0 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:38.721350 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634ea93-daea-40af-853e-5abf7136cbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:38.721783 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634ea93-daea-40af-853e-5abf7136cbb0 None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:38.722985 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d634ea93-daea-40af-853e-5abf7136cbb0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:38.723488 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d634ea93-daea-40af-853e-5abf7136cbb0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:38.725766 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d634ea93-daea-40af-853e-5abf7136cbb0 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:38.741102 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b21179a-f8eb-45c8-a945-752ae4a6ade0 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:38.752991 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 360/699] 10.222.0.36 () {56 vars in 1133 bytes} [Mon Aug 29 22:14:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:38.754072 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634ea93-daea-40af-853e-5abf7136cbb0 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:38.785110 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba23d0cc-0783-4c58-b156-5ce467a3fb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:38.785728 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23d0cc-0783-4c58-b156-5ce467a3fb4b None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:38.786010 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23d0cc-0783-4c58-b156-5ce467a3fb4b None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:38.786282 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23d0cc-0783-4c58-b156-5ce467a3fb4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:38.787069 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba23d0cc-0783-4c58-b156-5ce467a3fb4b None admin] RBAC: Adding query filter params (role.id=bc7b902c0870483ba03c139d941f78ac, scope.project.id=696ed25cc0cb43fab4bfaf762a90da54, user.id=5f3472d8ffa748d8828c6a2d89ee7ac7) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:38.787376 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba23d0cc-0783-4c58-b156-5ce467a3fb4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:38.788911 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba23d0cc-0783-4c58-b156-5ce467a3fb4b None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:38.805001 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 340/700] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Aug 29 22:14:38 2022] GET /identity/v3/role_assignments?user.id=5f3472d8ffa748d8828c6a2d89ee7ac7&scope.project.id=696ed25cc0cb43fab4bfaf762a90da54&role.id=bc7b902c0870483ba03c139d941f78ac => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:38.806417 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba23d0cc-0783-4c58-b156-5ce467a3fb4b None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:38.897160 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634ea93-daea-40af-853e-5abf7136cbb0 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:38.953049 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2794bc21-1ba5-4c99-8bc2-2cffde1f25b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:38.953722 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794bc21-1ba5-4c99-8bc2-2cffde1f25b2 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:38.954003 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794bc21-1ba5-4c99-8bc2-2cffde1f25b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:38.954280 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794bc21-1ba5-4c99-8bc2-2cffde1f25b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:38.967941 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2794bc21-1ba5-4c99-8bc2-2cffde1f25b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:38.969594 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2794bc21-1ba5-4c99-8bc2-2cffde1f25b2 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:38.980829 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:38.989363 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-2794bc21-1ba5-4c99-8bc2-2cffde1f25b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:38.989363 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:38.989363 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:38.989363 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:38.989363 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:38.989363 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:38.989363 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:38.989363 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:38.989363 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:38.989363 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:38.989363 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:38.989363 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:38.989363 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:14:38.989363 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:14:38.989363 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:14:38.989363 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:14:38.990576 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:38.990576 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:38.990576 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:38.990576 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:38.990576 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:38.990576 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:38.990576 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:38.990576 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:38.990576 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:38.990576 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:38.990576 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:38.990576 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:38.990576 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:38.990576 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:38.990576 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:38.990576 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:38.990576 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:14:38.991672 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:14:38.991672 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:38.991672 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:39.004980 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 361/701] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:14:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:39.010949 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2794bc21-1ba5-4c99-8bc2-2cffde1f25b2 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:39.028948 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:39.050247 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba23d0cc-0783-4c58-b156-5ce467a3fb4b None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:39.098407 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36a195-f5b0-4b86-8ae8-ccb6d1ffac8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:39.099048 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36a195-f5b0-4b86-8ae8-ccb6d1ffac8d None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:39.099332 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36a195-f5b0-4b86-8ae8-ccb6d1ffac8d None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:39.099605 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36a195-f5b0-4b86-8ae8-ccb6d1ffac8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:39.134857 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2794bc21-1ba5-4c99-8bc2-2cffde1f25b2 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:39.181143 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce36a195-f5b0-4b86-8ae8-ccb6d1ffac8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:39.182616 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce36a195-f5b0-4b86-8ae8-ccb6d1ffac8d None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:39.182892 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d0aa6c-9b7a-4245-b5bc-306fdfc32a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:39.183522 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0aa6c-9b7a-4245-b5bc-306fdfc32a25 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:39.183803 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0aa6c-9b7a-4245-b5bc-306fdfc32a25 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:39.184074 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0aa6c-9b7a-4245-b5bc-306fdfc32a25 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:39.185021 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d0aa6c-9b7a-4245-b5bc-306fdfc32a25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:39.185331 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d0aa6c-9b7a-4245-b5bc-306fdfc32a25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:39.186682 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d0aa6c-9b7a-4245-b5bc-306fdfc32a25 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:39.205023 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 362/702] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:14:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:39.206417 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da154d0c-50a9-46f8-b412-bcae0cee4dbb None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:39.206702 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da154d0c-50a9-46f8-b412-bcae0cee4dbb None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:39.206972 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da154d0c-50a9-46f8-b412-bcae0cee4dbb None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:39.208415 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 363/703] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:14:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:14:39.213700 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6666865-7cb6-4fba-a04e-c67fac668aa4 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:39.214032 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6666865-7cb6-4fba-a04e-c67fac668aa4 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:39.214239 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6666865-7cb6-4fba-a04e-c67fac668aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:39.237195 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-f6666865-7cb6-4fba-a04e-c67fac668aa4 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:14:39.238385 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f6666865-7cb6-4fba-a04e-c67fac668aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:14:39.295238 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:39.313316 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:39.325385 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 341/704] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:14:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:14:39.326913 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36a195-f5b0-4b86-8ae8-ccb6d1ffac8d None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:39.336658 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 364/705] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:14:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:14:39.337714 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6666865-7cb6-4fba-a04e-c67fac668aa4 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:39.452066 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36a195-f5b0-4b86-8ae8-ccb6d1ffac8d None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:39.490374 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d600f2-7407-46e6-a2fc-10f21d80876a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:39.491368 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d600f2-7407-46e6-a2fc-10f21d80876a None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:39.491936 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d600f2-7407-46e6-a2fc-10f21d80876a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:39.492581 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d600f2-7407-46e6-a2fc-10f21d80876a None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:39.493441 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d600f2-7407-46e6-a2fc-10f21d80876a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:39.495132 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d600f2-7407-46e6-a2fc-10f21d80876a None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:39.522587 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 342/706] 10.222.0.36 () {60 vars in 1132 bytes} [Mon Aug 29 22:14:39 2022] POST /identity/v3/users => generated 254 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:14:39.558914 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6666865-7cb6-4fba-a04e-c67fac668aa4 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:39.598197 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e448a155-9c1c-4dc9-883d-82b3b1c1be18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:39.598844 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e448a155-9c1c-4dc9-883d-82b3b1c1be18 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:39.599166 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e448a155-9c1c-4dc9-883d-82b3b1c1be18 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:39.599492 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e448a155-9c1c-4dc9-883d-82b3b1c1be18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:39.611072 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e448a155-9c1c-4dc9-883d-82b3b1c1be18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:39.612743 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e448a155-9c1c-4dc9-883d-82b3b1c1be18 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:39.629540 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-e448a155-9c1c-4dc9-883d-82b3b1c1be18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:39.629540 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:39.629540 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:39.629540 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:39.629540 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:39.629540 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:39.629540 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:39.629540 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:39.629540 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:39.629540 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:39.629540 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:39.629540 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:39.629540 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:14:39.629540 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:14:39.629540 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:14:39.629540 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:14:39.630574 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:39.630574 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:39.630574 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:39.630574 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:39.630574 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:39.630574 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:39.630574 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:39.630574 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:39.630574 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:39.630574 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:39.630574 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:39.630574 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:39.630574 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:39.630574 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:39.630574 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:39.630574 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:39.630574 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:14:39.631476 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:14:39.631476 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:39.631476 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:39.631476 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 365/707] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:14:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:39.637457 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d600f2-7407-46e6-a2fc-10f21d80876a None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:39.708599 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:39.730350 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e448a155-9c1c-4dc9-883d-82b3b1c1be18 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:39.779066 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d600f2-7407-46e6-a2fc-10f21d80876a None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:39.789530 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:39.815902 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe03e7a-78a1-495f-930f-30c8bc7a5d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:39.816549 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe03e7a-78a1-495f-930f-30c8bc7a5d02 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:39.816829 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe03e7a-78a1-495f-930f-30c8bc7a5d02 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:39.817103 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe03e7a-78a1-495f-930f-30c8bc7a5d02 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:39.817748 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe03e7a-78a1-495f-930f-30c8bc7a5d02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:39.818048 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe03e7a-78a1-495f-930f-30c8bc7a5d02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:39.820080 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe03e7a-78a1-495f-930f-30c8bc7a5d02 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:39.832063 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 343/708] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:14:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:39.837376 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe03e7a-78a1-495f-930f-30c8bc7a5d02 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:39.861664 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e448a155-9c1c-4dc9-883d-82b3b1c1be18 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:39.911976 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1614aa-d30e-466e-90f2-9cfb0b04c7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:39.913022 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1614aa-d30e-466e-90f2-9cfb0b04c7ec None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:39.913483 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1614aa-d30e-466e-90f2-9cfb0b04c7ec None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:39.913930 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1614aa-d30e-466e-90f2-9cfb0b04c7ec None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:39.914787 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1614aa-d30e-466e-90f2-9cfb0b04c7ec None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:39.916592 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1614aa-d30e-466e-90f2-9cfb0b04c7ec None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:39.931010 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-ea1614aa-d30e-466e-90f2-9cfb0b04c7ec None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 22:14:39.931010 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:39.931010 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:14:39.931010 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:14:39.931010 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:14:39.931010 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:14:39.931010 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:14:39.931010 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:14:39.931010 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 22:14:39.931010 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:39.931010 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:14:39.931010 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:39.931010 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:39.931010 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:39.931010 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:39.931010 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:39.931010 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:39.932178 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:39.932178 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:39.932178 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:39.932178 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:39.932178 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:39.932178 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:39.932178 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:14:39.932178 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:14:39.932178 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:14:39.932178 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:14:39.932178 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:39.932178 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:39.932178 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:39.932178 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:39.932178 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:39.932178 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:39.933117 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:39.933117 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:39.933117 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:39.933117 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:39.933117 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:39.933117 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:39.933117 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:39.933117 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:39.933117 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:39.933117 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:39.933117 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:14:39.933117 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:14:39.933117 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 22:14:39.933117 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:39.940467 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 366/709] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Aug 29 22:14:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:14:39.941945 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1614aa-d30e-466e-90f2-9cfb0b04c7ec None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:39.957249 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:39.961950 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe03e7a-78a1-495f-930f-30c8bc7a5d02 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:40.026157 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3729f5ff-0750-4157-8c0c-e27546dc1a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:40.027082 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729f5ff-0750-4157-8c0c-e27546dc1a52 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:40.027507 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729f5ff-0750-4157-8c0c-e27546dc1a52 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:40.027919 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729f5ff-0750-4157-8c0c-e27546dc1a52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:40.039854 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3729f5ff-0750-4157-8c0c-e27546dc1a52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:40.042173 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3729f5ff-0750-4157-8c0c-e27546dc1a52 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:40.060754 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-3729f5ff-0750-4157-8c0c-e27546dc1a52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:14:40.060754 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:40.060754 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:40.060754 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:40.060754 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:40.060754 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:40.060754 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:40.060754 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:40.060754 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:40.060754 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:40.060754 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:40.060754 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:40.060754 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:14:40.060754 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:14:40.060754 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:14:40.061897 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:14:40.061897 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:40.061897 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:40.061897 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:40.061897 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:40.061897 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:40.061897 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:40.061897 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:40.061897 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:40.061897 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:40.061897 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:40.061897 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:40.061897 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:40.061897 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:40.061897 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:40.061897 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:40.061897 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:40.063021 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:14:40.063021 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:14:40.063021 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:14:40.063021 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:14:40.063021 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:14:40.063021 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:14:40.063021 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:14:40.063021 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:40.074074 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 344/710] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Aug 29 22:14:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:40.077496 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3729f5ff-0750-4157-8c0c-e27546dc1a52 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:40.147412 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1614aa-d30e-466e-90f2-9cfb0b04c7ec None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:40.149531 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:40.191302 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3729f5ff-0750-4157-8c0c-e27546dc1a52 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:40.227122 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc67093-af5a-4bfe-9c7c-398e9999e516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:40.227843 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc67093-af5a-4bfe-9c7c-398e9999e516 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:40.228125 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc67093-af5a-4bfe-9c7c-398e9999e516 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:40.228397 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc67093-af5a-4bfe-9c7c-398e9999e516 None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:40.229155 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc67093-af5a-4bfe-9c7c-398e9999e516 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:40.229366 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c411a-8584-44ad-b928-5c6f0c17d971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:40.229487 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc67093-af5a-4bfe-9c7c-398e9999e516 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:40.230013 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c411a-8584-44ad-b928-5c6f0c17d971 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:40.230295 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c411a-8584-44ad-b928-5c6f0c17d971 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:40.230568 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c411a-8584-44ad-b928-5c6f0c17d971 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:40.230906 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc67093-af5a-4bfe-9c7c-398e9999e516 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:40.231228 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c411a-8584-44ad-b928-5c6f0c17d971 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:40.231530 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c411a-8584-44ad-b928-5c6f0c17d971 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:40.241174 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c411a-8584-44ad-b928-5c6f0c17d971 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:40.244410 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 345/711] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Aug 29 22:14:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:40.246808 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 367/712] 10.222.0.36 () {56 vars in 1124 bytes} [Mon Aug 29 22:14:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:14:40.251864 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc67093-af5a-4bfe-9c7c-398e9999e516 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:40.253589 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c411a-8584-44ad-b928-5c6f0c17d971 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:40.277192 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:40.405502 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c411a-8584-44ad-b928-5c6f0c17d971 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:40.409115 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc67093-af5a-4bfe-9c7c-398e9999e516 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:40.460655 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d16fc-d8e2-4f9b-842f-00490f8d23ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:40.462967 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d16fc-d8e2-4f9b-842f-00490f8d23ac None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:40.463248 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d16fc-d8e2-4f9b-842f-00490f8d23ac None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:40.463521 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d16fc-d8e2-4f9b-842f-00490f8d23ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:40.465804 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d16fc-d8e2-4f9b-842f-00490f8d23ac None admin] RBAC: Adding query filter params (role.id=ff59a239a50b4bd899a83bf3c3fd1f63, scope.project.id=696ed25cc0cb43fab4bfaf762a90da54, user.id=90b7213b7111456a93e294ce40b95b21) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:40.466116 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d16fc-d8e2-4f9b-842f-00490f8d23ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:40.467576 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d16fc-d8e2-4f9b-842f-00490f8d23ac None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:40.480127 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 346/713] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Aug 29 22:14:40 2022] GET /identity/v3/role_assignments?user.id=90b7213b7111456a93e294ce40b95b21&scope.project.id=696ed25cc0cb43fab4bfaf762a90da54&role.id=ff59a239a50b4bd899a83bf3c3fd1f63 => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:40.501829 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687fc6da-5708-432b-81ff-d5fc3ad22d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:40.502922 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687fc6da-5708-432b-81ff-d5fc3ad22d7d None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:40.503482 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687fc6da-5708-432b-81ff-d5fc3ad22d7d None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:40.503962 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687fc6da-5708-432b-81ff-d5fc3ad22d7d None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:40.505283 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687fc6da-5708-432b-81ff-d5fc3ad22d7d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:40.505844 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687fc6da-5708-432b-81ff-d5fc3ad22d7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:40.508609 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687fc6da-5708-432b-81ff-d5fc3ad22d7d None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:40.522110 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 368/714] 10.222.0.36 () {56 vars in 1124 bytes} [Mon Aug 29 22:14:40 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:14:40.657854 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87027f07-2ca5-4fe3-ad92-f84b75a124d4 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:40.658188 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87027f07-2ca5-4fe3-ad92-f84b75a124d4 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:40.658422 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87027f07-2ca5-4fe3-ad92-f84b75a124d4 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:40.660108 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 347/715] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:14:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:14:40.665817 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb62ac-a9d9-43d8-8887-b74b3ea00c21 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:40.666126 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb62ac-a9d9-43d8-8887-b74b3ea00c21 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:40.666372 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb62ac-a9d9-43d8-8887-b74b3ea00c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:40.693712 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-69fb62ac-a9d9-43d8-8887-b74b3ea00c21 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:14:40.694951 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-69fb62ac-a9d9-43d8-8887-b74b3ea00c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:14:40.729571 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:40.785978 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 369/716] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:14:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:14:41.063990 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87027f07-2ca5-4fe3-ad92-f84b75a124d4 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:41.155948 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2bcfd5-7db1-453d-ae46-ae0a72b217cf None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:41.155948 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2bcfd5-7db1-453d-ae46-ae0a72b217cf None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:41.155948 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2bcfd5-7db1-453d-ae46-ae0a72b217cf None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:41.158266 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:41.160934 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 370/717] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:14:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:14:41.166471 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745117b7-c624-4472-ab25-735ec4211eb8 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:41.166742 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745117b7-c624-4472-ab25-735ec4211eb8 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:41.167020 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745117b7-c624-4472-ab25-735ec4211eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:41.177487 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87027f07-2ca5-4fe3-ad92-f84b75a124d4 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:41.217097 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-745117b7-c624-4472-ab25-735ec4211eb8 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:14:41.218315 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-745117b7-c624-4472-ab25-735ec4211eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:14:41.235136 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a1e95d-dc0a-4fb7-878b-b6a8c2277e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:41.235801 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1e95d-dc0a-4fb7-878b-b6a8c2277e51 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:41.236084 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1e95d-dc0a-4fb7-878b-b6a8c2277e51 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:41.236361 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1e95d-dc0a-4fb7-878b-b6a8c2277e51 None admin] PATH_INFO: `/v3/services/network` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:41.236984 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a1e95d-dc0a-4fb7-878b-b6a8c2277e51 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:41.238379 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a1e95d-dc0a-4fb7-878b-b6a8c2277e51 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:41.250381 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-b2a1e95d-dc0a-4fb7-878b-b6a8c2277e51 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 22:14:41.250381 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:41.250381 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:14:41.250381 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:14:41.250381 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:14:41.250381 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:14:41.250381 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:14:41.250381 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:14:41.250381 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 22:14:41.250381 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:41.250381 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:14:41.250381 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:41.250381 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:41.250381 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:41.250381 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:41.250381 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:41.250381 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:41.251430 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:41.251430 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:41.251430 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:41.251430 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:41.251430 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:41.251430 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:41.251430 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:14:41.251430 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:14:41.251430 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:14:41.251430 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:14:41.251430 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:41.251430 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:41.251430 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:41.251430 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:41.251430 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:41.251430 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:41.253172 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:41.253172 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:41.253172 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:41.253172 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:41.253172 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:41.253172 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:41.253172 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:41.253172 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:41.253172 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:41.253172 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:41.253172 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:14:41.253172 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:14:41.253172 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 22:14:41.253172 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:41.253172 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 348/718] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Aug 29 22:14:41 2022] GET /identity/v3/services/network => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:41.257585 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a1e95d-dc0a-4fb7-878b-b6a8c2277e51 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:41.378633 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 371/719] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:14:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:14:41.458723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a1e95d-dc0a-4fb7-878b-b6a8c2277e51 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:41.502615 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e5505-166b-4c04-98e2-bb52546fcfe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:41.503233 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e5505-166b-4c04-98e2-bb52546fcfe2 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:41.503514 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e5505-166b-4c04-98e2-bb52546fcfe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:41.503785 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e5505-166b-4c04-98e2-bb52546fcfe2 None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:41.504429 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9e5505-166b-4c04-98e2-bb52546fcfe2 None admin] RBAC: Adding query filter params (name=network) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:41.504770 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9e5505-166b-4c04-98e2-bb52546fcfe2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:41.506171 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9e5505-166b-4c04-98e2-bb52546fcfe2 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:41.515943 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 349/720] 10.222.0.36 () {56 vars in 1112 bytes} [Mon Aug 29 22:14:41 2022] GET /identity/v3/services?name=network => generated 124 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:14:41.521380 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745117b7-c624-4472-ab25-735ec4211eb8 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:41.631941 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:41.644896 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745117b7-c624-4472-ab25-735ec4211eb8 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:41.679512 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c3e75-53f7-436e-9d75-6bdd6dd795ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:41.680715 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c3e75-53f7-436e-9d75-6bdd6dd795ad None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:41.681200 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c3e75-53f7-436e-9d75-6bdd6dd795ad None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:41.681666 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c3e75-53f7-436e-9d75-6bdd6dd795ad None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:41.682496 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110c3e75-53f7-436e-9d75-6bdd6dd795ad None admin] RBAC: Adding query filter params (type=network) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:41.683014 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110c3e75-53f7-436e-9d75-6bdd6dd795ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:41.684600 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110c3e75-53f7-436e-9d75-6bdd6dd795ad None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:41.689827 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 372/721] 10.222.0.36 () {56 vars in 1112 bytes} [Mon Aug 29 22:14:41 2022] GET /identity/v3/services?type=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:41.755335 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e5505-166b-4c04-98e2-bb52546fcfe2 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:41.785618 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:41.924011 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e5505-166b-4c04-98e2-bb52546fcfe2 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:41.946118 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ecdddd-7938-438e-96e5-1d5105e820f1 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:41.946666 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ecdddd-7938-438e-96e5-1d5105e820f1 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:41.946878 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ecdddd-7938-438e-96e5-1d5105e820f1 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:41.948404 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 373/722] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:14:41.956082 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef212ee-e4f6-40b5-acbc-3bdbc0a1807d None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:41.956414 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef212ee-e4f6-40b5-acbc-3bdbc0a1807d None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:41.956673 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef212ee-e4f6-40b5-acbc-3bdbc0a1807d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:41.980584 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-aef212ee-e4f6-40b5-acbc-3bdbc0a1807d None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:14:41.982832 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-aef212ee-e4f6-40b5-acbc-3bdbc0a1807d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:14:41.993780 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ae45b-06bf-4271-ab05-e1cc030d4645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:41.994751 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ae45b-06bf-4271-ab05-e1cc030d4645 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:41.995036 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ae45b-06bf-4271-ab05-e1cc030d4645 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:41.995309 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ae45b-06bf-4271-ab05-e1cc030d4645 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:42.018918 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690ae45b-06bf-4271-ab05-e1cc030d4645 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:14:42.029238 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-690ae45b-06bf-4271-ab05-e1cc030d4645 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:14:42.029238 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:42.029238 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:42.029238 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:42.029238 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:42.029238 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:42.029238 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:42.029238 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:42.029238 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:42.029238 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:42.029238 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:42.029238 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:42.029238 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:14:42.029238 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:14:42.029238 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:14:42.029238 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:14:42.030249 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:14:42.030249 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:14:42.030249 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:14:42.030249 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:14:42.030249 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:42.030249 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:42.030249 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:42.030249 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:42.030249 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:42.030249 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:42.030249 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:42.030249 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:42.030249 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:42.030249 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:42.030249 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:42.030249 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:42.031138 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:42.031138 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:42.031138 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:42.031138 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:42.031138 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:14:42.031138 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:14:42.031138 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:14:42.031138 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:14:42.031138 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:14:42.031138 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:14:42.031138 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:14:42.031138 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:42.032841 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 350/723] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Aug 29 22:14:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:42.040775 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ae45b-06bf-4271-ab05-e1cc030d4645 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:42.127431 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:42.162151 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ae45b-06bf-4271-ab05-e1cc030d4645 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:42.182378 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 374/724] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:14:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:14:42.225370 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbcdb67-a20e-40a4-9e31-7e7b4303b4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:42.226356 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcdb67-a20e-40a4-9e31-7e7b4303b4af None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:42.226977 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcdb67-a20e-40a4-9e31-7e7b4303b4af None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:42.227470 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcdb67-a20e-40a4-9e31-7e7b4303b4af None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:42.228360 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbcdb67-a20e-40a4-9e31-7e7b4303b4af None admin] RBAC: Adding query filter params (name=admin) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:42.228903 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbcdb67-a20e-40a4-9e31-7e7b4303b4af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:42.230502 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbcdb67-a20e-40a4-9e31-7e7b4303b4af None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:42.244746 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 351/725] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:14:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:42.252230 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef212ee-e4f6-40b5-acbc-3bdbc0a1807d None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:42.375936 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:42.397016 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef212ee-e4f6-40b5-acbc-3bdbc0a1807d None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:42.449293 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51a3d68-857e-4809-80a2-3b6a8724ed58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:42.449864 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a3d68-857e-4809-80a2-3b6a8724ed58 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:42.450142 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a3d68-857e-4809-80a2-3b6a8724ed58 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:42.450406 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a3d68-857e-4809-80a2-3b6a8724ed58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:42.470692 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51a3d68-857e-4809-80a2-3b6a8724ed58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:42.472203 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51a3d68-857e-4809-80a2-3b6a8724ed58 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:42.489514 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-e51a3d68-857e-4809-80a2-3b6a8724ed58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:42.489514 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:42.489514 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:42.489514 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:42.489514 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:42.489514 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:42.489514 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:42.489514 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:42.489514 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:42.489514 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:42.489514 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:42.489514 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:42.489514 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:14:42.489514 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:14:42.489514 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:14:42.489514 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:14:42.490516 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:42.490516 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:42.490516 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:42.490516 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:42.490516 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:42.490516 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:42.490516 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:42.490516 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:42.490516 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:42.490516 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:42.490516 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:42.490516 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:42.490516 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:42.490516 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:42.490516 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:42.490516 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:42.490516 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:14:42.491414 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:14:42.491414 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:42.491414 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:42.491597 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 375/726] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:14:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:42.496621 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbcdb67-a20e-40a4-9e31-7e7b4303b4af None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:42.554928 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51a3d68-857e-4809-80a2-3b6a8724ed58 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:42.674414 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51a3d68-857e-4809-80a2-3b6a8724ed58 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:42.681074 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbcdb67-a20e-40a4-9e31-7e7b4303b4af None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:42.715139 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a439eaf7-2b62-4329-9aa2-68498b783b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:42.716135 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439eaf7-2b62-4329-9aa2-68498b783b97 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:42.716638 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439eaf7-2b62-4329-9aa2-68498b783b97 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:42.717108 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439eaf7-2b62-4329-9aa2-68498b783b97 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:42.720167 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:42.731089 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a439eaf7-2b62-4329-9aa2-68498b783b97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:14:42.737869 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-a439eaf7-2b62-4329-9aa2-68498b783b97 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:14:42.737869 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:42.737869 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:42.737869 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:42.737869 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:42.737869 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:42.737869 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:42.737869 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:42.737869 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:42.737869 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:42.737869 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:42.737869 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:42.737869 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:14:42.737869 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:14:42.737869 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:14:42.737869 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:14:42.738812 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:14:42.738812 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:14:42.738812 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:14:42.738812 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:14:42.738812 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:42.738812 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:42.738812 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:42.738812 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:42.738812 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:42.738812 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:42.738812 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:42.738812 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:42.738812 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:42.738812 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:42.738812 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:42.738812 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:42.739658 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:42.739658 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:42.739658 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:42.739658 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:42.739658 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:14:42.739658 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:14:42.739658 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:14:42.739658 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:14:42.739658 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:14:42.739658 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:14:42.739658 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:14:42.739658 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:42.742729 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 376/727] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Aug 29 22:14:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:14:42.749437 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a439eaf7-2b62-4329-9aa2-68498b783b97 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:42.777166 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db3492f-69ad-4326-9417-e03201a8edb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:42.777781 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3492f-69ad-4326-9417-e03201a8edb4 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:42.778062 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3492f-69ad-4326-9417-e03201a8edb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:42.778329 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3492f-69ad-4326-9417-e03201a8edb4 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:42.778978 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db3492f-69ad-4326-9417-e03201a8edb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:42.779277 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db3492f-69ad-4326-9417-e03201a8edb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:42.780707 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db3492f-69ad-4326-9417-e03201a8edb4 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:42.782578 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:42.805977 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 352/728] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:14:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:42.811559 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db3492f-69ad-4326-9417-e03201a8edb4 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:42.913398 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a439eaf7-2b62-4329-9aa2-68498b783b97 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:42.982233 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef231d-e478-4f63-8405-8c029cd5d058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:42.982893 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef231d-e478-4f63-8405-8c029cd5d058 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:42.983191 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef231d-e478-4f63-8405-8c029cd5d058 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:42.983310 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef231d-e478-4f63-8405-8c029cd5d058 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:42.983982 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef231d-e478-4f63-8405-8c029cd5d058 None admin] RBAC: Adding query filter params (name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:42.984280 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef231d-e478-4f63-8405-8c029cd5d058 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:42.987044 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef231d-e478-4f63-8405-8c029cd5d058 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:43.004193 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 377/729] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Aug 29 22:14:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:14:43.009903 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef231d-e478-4f63-8405-8c029cd5d058 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:43.027856 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db3492f-69ad-4326-9417-e03201a8edb4 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:43.082648 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad74892c-5be2-44df-b2e6-d15f3d0a6a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:43.083648 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74892c-5be2-44df-b2e6-d15f3d0a6a02 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:43.083931 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74892c-5be2-44df-b2e6-d15f3d0a6a02 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:43.084472 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74892c-5be2-44df-b2e6-d15f3d0a6a02 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:43.093913 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad74892c-5be2-44df-b2e6-d15f3d0a6a02 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:43.095864 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad74892c-5be2-44df-b2e6-d15f3d0a6a02 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:43.095997 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:43.108998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-ad74892c-5be2-44df-b2e6-d15f3d0a6a02 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 22:14:43.108998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:43.108998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:43.108998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:43.108998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:43.108998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:43.108998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:43.108998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:43.108998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:43.108998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:43.108998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:43.108998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:43.108998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:14:43.108998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:14:43.108998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:14:43.108998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:14:43.109982 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:43.109982 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:43.109982 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:14:43.109982 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:14:43.109982 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:14:43.109982 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:14:43.109982 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:43.109982 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:43.109982 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:43.109982 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:43.109982 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:43.109982 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:43.109982 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:43.109982 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:43.109982 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:43.109982 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:43.109982 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:43.109982 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:43.110934 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:43.110934 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:43.110934 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:14:43.110934 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:14:43.110934 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:14:43.110934 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:14:43.110934 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:14:43.110934 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:14:43.110934 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 22:14:43.110934 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:43.110934 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 353/730] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Aug 29 22:14:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:43.111524 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd98d7e-346e-480d-a79c-896f8f553e3d None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:43.111524 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd98d7e-346e-480d-a79c-896f8f553e3d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:43.112385 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd98d7e-346e-480d-a79c-896f8f553e3d None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:43.116131 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 354/731] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:14:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:14:43.118188 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102b9e4-8d0c-4241-baf4-5f297ece9c7b None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:43.118488 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102b9e4-8d0c-4241-baf4-5f297ece9c7b None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:43.118771 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102b9e4-8d0c-4241-baf4-5f297ece9c7b None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:43.120161 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 355/732] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:14:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:14:43.120826 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b102b9e4-8d0c-4241-baf4-5f297ece9c7b None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:43.144946 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef231d-e478-4f63-8405-8c029cd5d058 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:43.181066 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:43.186837 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d7fc8-77ac-4653-bd5b-22bdcf22bbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:43.187584 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d7fc8-77ac-4653-bd5b-22bdcf22bbc0 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:43.187862 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d7fc8-77ac-4653-bd5b-22bdcf22bbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:43.188135 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d7fc8-77ac-4653-bd5b-22bdcf22bbc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:43.199144 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550d7fc8-77ac-4653-bd5b-22bdcf22bbc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:43.200625 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550d7fc8-77ac-4653-bd5b-22bdcf22bbc0 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:43.216069 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-550d7fc8-77ac-4653-bd5b-22bdcf22bbc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:43.216069 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:43.216069 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:43.216069 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:43.216069 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:43.216069 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:43.216069 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:43.216069 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:43.216069 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:43.216069 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:43.216069 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:43.216069 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:43.216069 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:14:43.216069 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:14:43.216069 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:14:43.216069 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:14:43.217178 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:43.217178 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:43.217178 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:43.217178 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:43.217178 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:43.217178 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:43.217178 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:43.217178 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:43.217178 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:43.217178 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:43.217178 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:43.217178 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:43.217178 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:43.217178 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:43.217178 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:43.217178 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:43.217178 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:14:43.218109 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:14:43.218109 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:43.218109 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:43.218109 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 378/733] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:14:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:43.218973 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b470e6c-139a-44fb-a301-3b4f1b1f15c6 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:43.218973 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b470e6c-139a-44fb-a301-3b4f1b1f15c6 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:43.218973 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b470e6c-139a-44fb-a301-3b4f1b1f15c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:43.239579 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-1b470e6c-139a-44fb-a301-3b4f1b1f15c6 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:14:43.240868 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-1b470e6c-139a-44fb-a301-3b4f1b1f15c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:14:43.242387 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b102b9e4-8d0c-4241-baf4-5f297ece9c7b None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:43.284892 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6cdb80-a1cc-4695-bfaf-de4013e613fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:43.285505 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6cdb80-a1cc-4695-bfaf-de4013e613fd None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:43.285783 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6cdb80-a1cc-4695-bfaf-de4013e613fd None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:43.286052 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6cdb80-a1cc-4695-bfaf-de4013e613fd None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:43.286780 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6cdb80-a1cc-4695-bfaf-de4013e613fd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:43.287081 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6cdb80-a1cc-4695-bfaf-de4013e613fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:43.289094 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6cdb80-a1cc-4695-bfaf-de4013e613fd None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:43.312563 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 356/734] 10.222.0.36 () {56 vars in 1135 bytes} [Mon Aug 29 22:14:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:43.313797 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b153afe-07c8-4c94-9a41-736066636e9b None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:43.314103 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b153afe-07c8-4c94-9a41-736066636e9b None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:43.314377 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b153afe-07c8-4c94-9a41-736066636e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:43.319771 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 379/735] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:14:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:14:43.321059 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b470e6c-139a-44fb-a301-3b4f1b1f15c6 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:43.370833 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:43.437681 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b470e6c-139a-44fb-a301-3b4f1b1f15c6 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:43.476338 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb7fae-fddb-49dc-bcce-1824149db1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:43.477318 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb7fae-fddb-49dc-bcce-1824149db1b5 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:43.477852 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb7fae-fddb-49dc-bcce-1824149db1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:43.478297 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb7fae-fddb-49dc-bcce-1824149db1b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:43.479112 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb7fae-fddb-49dc-bcce-1824149db1b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:43.479561 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb7fae-fddb-49dc-bcce-1824149db1b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:43.481146 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb7fae-fddb-49dc-bcce-1824149db1b5 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:43.490201 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-4b153afe-07c8-4c94-9a41-736066636e9b None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:14:43.491558 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-4b153afe-07c8-4c94-9a41-736066636e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:14:43.495136 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 380/736] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:14:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:43.497019 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb7fae-fddb-49dc-bcce-1824149db1b5 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:43.572652 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 357/737] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:14:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:14:43.573694 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b153afe-07c8-4c94-9a41-736066636e9b None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:43.620900 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:43.625960 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb7fae-fddb-49dc-bcce-1824149db1b5 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:43.633762 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:43.675472 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5563b0d7-95a2-4d18-ae01-919acca7df5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:43.676760 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5563b0d7-95a2-4d18-ae01-919acca7df5c None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:43.677448 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5563b0d7-95a2-4d18-ae01-919acca7df5c None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:43.677885 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5563b0d7-95a2-4d18-ae01-919acca7df5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:43.696265 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b153afe-07c8-4c94-9a41-736066636e9b None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:43.733425 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82bfac4-d27f-4e75-9ac3-4fdaf161291a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:43.734124 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82bfac4-d27f-4e75-9ac3-4fdaf161291a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:43.734411 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82bfac4-d27f-4e75-9ac3-4fdaf161291a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:43.734678 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82bfac4-d27f-4e75-9ac3-4fdaf161291a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:43.743008 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82bfac4-d27f-4e75-9ac3-4fdaf161291a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:43.744651 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82bfac4-d27f-4e75-9ac3-4fdaf161291a None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:43.758125 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-b82bfac4-d27f-4e75-9ac3-4fdaf161291a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 22:14:43.758125 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:43.758125 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:43.758125 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:43.758125 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:43.758125 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:43.758125 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:43.758125 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:43.758125 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:43.758125 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:43.758125 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:43.758125 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:43.758125 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:14:43.758125 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:14:43.758125 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:14:43.758125 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:14:43.759391 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:43.759391 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:43.759391 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:14:43.759391 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:14:43.759391 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:14:43.759391 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:14:43.759391 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:43.759391 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:43.759391 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:43.759391 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:43.759391 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:43.759391 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:43.759391 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:43.759391 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:43.759391 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:43.759391 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:43.759391 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:43.759391 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:43.760543 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:43.760543 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:43.760543 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:14:43.760543 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:14:43.760543 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:14:43.760543 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:14:43.760543 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:14:43.760543 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:14:43.760543 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 22:14:43.760543 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:43.763929 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 358/738] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Aug 29 22:14:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:43.764903 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5563b0d7-95a2-4d18-ae01-919acca7df5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:43.765207 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82bfac4-d27f-4e75-9ac3-4fdaf161291a None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:43.766669 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5563b0d7-95a2-4d18-ae01-919acca7df5c None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:43.877599 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82bfac4-d27f-4e75-9ac3-4fdaf161291a None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:43.879162 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:43.886197 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:43.897034 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 381/739] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:14:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:14:43.897034 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5563b0d7-95a2-4d18-ae01-919acca7df5c None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:43.926037 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7520f65-a803-4d70-ad16-e5a2364fee6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:43.927141 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7520f65-a803-4d70-ad16-e5a2364fee6c None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:43.927730 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7520f65-a803-4d70-ad16-e5a2364fee6c None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:43.928039 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7520f65-a803-4d70-ad16-e5a2364fee6c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:43.943990 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7520f65-a803-4d70-ad16-e5a2364fee6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:14:43.948892 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-e7520f65-a803-4d70-ad16-e5a2364fee6c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:14:43.948892 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:43.948892 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:43.948892 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:43.948892 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:43.948892 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:43.948892 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:43.948892 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:43.948892 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:43.948892 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:43.948892 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:43.948892 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:43.948892 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:14:43.948892 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:14:43.948892 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:14:43.948892 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:14:43.949837 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:14:43.949837 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:14:43.949837 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:14:43.949837 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:14:43.949837 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:43.949837 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:43.949837 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:43.949837 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:43.949837 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:43.949837 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:43.949837 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:43.949837 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:43.949837 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:43.949837 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:43.949837 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:43.949837 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:43.950685 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:43.950685 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:43.950685 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:43.950685 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:43.950685 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:14:43.950685 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:14:43.950685 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:14:43.950685 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:14:43.950685 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:14:43.950685 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:14:43.950685 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:14:43.950685 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:43.950685 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 359/740] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Aug 29 22:14:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:43.951368 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7520f65-a803-4d70-ad16-e5a2364fee6c None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:44.017015 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5563b0d7-95a2-4d18-ae01-919acca7df5c None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:44.051980 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14860c93-28ec-4f07-9361-f62e82687990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:44.052625 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14860c93-28ec-4f07-9361-f62e82687990 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:44.052908 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14860c93-28ec-4f07-9361-f62e82687990 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:44.053180 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14860c93-28ec-4f07-9361-f62e82687990 None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:44.053908 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14860c93-28ec-4f07-9361-f62e82687990 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:44.054223 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14860c93-28ec-4f07-9361-f62e82687990 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:44.055915 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14860c93-28ec-4f07-9361-f62e82687990 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:44.061121 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7520f65-a803-4d70-ad16-e5a2364fee6c None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:44.073575 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 382/741] 10.222.0.36 () {56 vars in 1149 bytes} [Mon Aug 29 22:14:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:44.074408 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14860c93-28ec-4f07-9361-f62e82687990 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:44.105836 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9473c66-a999-4e70-9916-09efda547dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:44.106688 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9473c66-a999-4e70-9916-09efda547dad None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:44.107020 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9473c66-a999-4e70-9916-09efda547dad None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:44.107349 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9473c66-a999-4e70-9916-09efda547dad None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:44.108108 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9473c66-a999-4e70-9916-09efda547dad None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:44.109783 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9473c66-a999-4e70-9916-09efda547dad None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:44.132533 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 360/742] 10.222.0.36 () {60 vars in 1141 bytes} [Mon Aug 29 22:14:43 2022] POST /identity/v3/services => generated 251 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:14:44.133459 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9473c66-a999-4e70-9916-09efda547dad None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:44.158858 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:44.169415 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:44.212952 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14860c93-28ec-4f07-9361-f62e82687990 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:44.262463 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9473c66-a999-4e70-9916-09efda547dad None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:44.263909 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff51ad63-6b06-45e6-83fc-49830225e4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:44.264936 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51ad63-6b06-45e6-83fc-49830225e4da None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:44.265263 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51ad63-6b06-45e6-83fc-49830225e4da None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:44.265544 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51ad63-6b06-45e6-83fc-49830225e4da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:44.279038 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff51ad63-6b06-45e6-83fc-49830225e4da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:44.280418 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff51ad63-6b06-45e6-83fc-49830225e4da None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:44.297108 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-ff51ad63-6b06-45e6-83fc-49830225e4da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:44.297108 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:44.297108 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:44.297108 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:44.297108 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:44.297108 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:44.297108 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:44.297108 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:44.297108 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:44.297108 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:44.297108 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:44.297108 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:44.297108 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:14:44.297108 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:14:44.297108 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:14:44.297108 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:14:44.298102 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:44.298102 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:44.298102 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:44.298102 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:44.298102 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:44.298102 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:44.298102 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:44.298102 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:44.298102 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:44.298102 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:44.298102 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:44.298102 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:44.298102 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:44.298102 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:44.298102 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:44.298102 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:44.298102 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:14:44.299044 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:14:44.299044 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:44.299044 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:44.299044 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 383/743] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:14:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:44.299044 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff51ad63-6b06-45e6-83fc-49830225e4da None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:44.305729 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23902a2-9570-4c9f-adb9-e127bca3fb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:44.306369 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23902a2-9570-4c9f-adb9-e127bca3fb61 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:44.306708 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23902a2-9570-4c9f-adb9-e127bca3fb61 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:44.306987 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23902a2-9570-4c9f-adb9-e127bca3fb61 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:44.307685 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23902a2-9570-4c9f-adb9-e127bca3fb61 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:44.309409 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23902a2-9570-4c9f-adb9-e127bca3fb61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:44.310384 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23902a2-9570-4c9f-adb9-e127bca3fb61 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:44.320171 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 361/744] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:14:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:44.321730 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6fddb-80ec-4e81-b17e-4f51372f0931 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:44.322021 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6fddb-80ec-4e81-b17e-4f51372f0931 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:44.322297 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6fddb-80ec-4e81-b17e-4f51372f0931 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:44.323540 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 362/745] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:14:44.324249 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec6fddb-80ec-4e81-b17e-4f51372f0931 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:44.421817 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff51ad63-6b06-45e6-83fc-49830225e4da None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:44.428505 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:44.430191 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:44.454766 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec6fddb-80ec-4e81-b17e-4f51372f0931 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:44.462471 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec461f3-65e0-4d85-a097-8d11d9b54a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:44.463523 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec461f3-65e0-4d85-a097-8d11d9b54a95 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:44.463805 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec461f3-65e0-4d85-a097-8d11d9b54a95 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:44.464113 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec461f3-65e0-4d85-a097-8d11d9b54a95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:44.498768 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60387eec-1c26-4544-afc6-66290c8e581b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:44.499390 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60387eec-1c26-4544-afc6-66290c8e581b None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:44.499673 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60387eec-1c26-4544-afc6-66290c8e581b None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:44.499945 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60387eec-1c26-4544-afc6-66290c8e581b None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:44.500645 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60387eec-1c26-4544-afc6-66290c8e581b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:44.500943 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60387eec-1c26-4544-afc6-66290c8e581b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:44.502327 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60387eec-1c26-4544-afc6-66290c8e581b None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:44.516154 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 363/746] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:14:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:44.517053 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60387eec-1c26-4544-afc6-66290c8e581b None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:44.552844 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec461f3-65e0-4d85-a097-8d11d9b54a95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:44.554408 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec461f3-65e0-4d85-a097-8d11d9b54a95 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:44.661476 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60387eec-1c26-4544-afc6-66290c8e581b None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:44.676488 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 384/747] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:14:44 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:14:44.677776 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26dc17-9e0f-4ce2-80de-dcb77356e1d0 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:44.678085 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26dc17-9e0f-4ce2-80de-dcb77356e1d0 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:44.678377 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26dc17-9e0f-4ce2-80de-dcb77356e1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:44.693656 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:44.703465 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-cf26dc17-9e0f-4ce2-80de-dcb77356e1d0 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:14:44.704732 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-cf26dc17-9e0f-4ce2-80de-dcb77356e1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:14:44.706714 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef278afd-e44d-4af6-b8b8-02c4a86074df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:44.707410 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef278afd-e44d-4af6-b8b8-02c4a86074df None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:44.707694 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef278afd-e44d-4af6-b8b8-02c4a86074df None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:44.708660 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef278afd-e44d-4af6-b8b8-02c4a86074df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:44.716996 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:44.720658 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef278afd-e44d-4af6-b8b8-02c4a86074df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:44.722135 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef278afd-e44d-4af6-b8b8-02c4a86074df None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:44.740597 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-ef278afd-e44d-4af6-b8b8-02c4a86074df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:44.740597 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:44.740597 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:44.740597 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:44.740597 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:44.740597 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:44.740597 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:44.740597 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:44.740597 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:44.740597 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:44.740597 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:44.740597 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:44.740597 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:14:44.740597 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:14:44.740597 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:14:44.740597 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:14:44.741746 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:44.741746 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:44.741746 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:44.741746 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:44.741746 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:44.741746 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:44.741746 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:44.741746 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:44.741746 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:44.741746 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:44.741746 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:44.741746 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:44.741746 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:44.741746 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:44.741746 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:44.741746 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:44.741746 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:14:44.743129 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:14:44.743129 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:44.743129 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:44.743129 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 364/748] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:14:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:44.743731 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef278afd-e44d-4af6-b8b8-02c4a86074df None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:44.792508 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 385/749] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:14:44 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:14:44.793371 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26dc17-9e0f-4ce2-80de-dcb77356e1d0 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:44.898908 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef278afd-e44d-4af6-b8b8-02c4a86074df None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:44.929345 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26dc17-9e0f-4ce2-80de-dcb77356e1d0 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:44.938837 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb0b616-be42-4b37-8c21-af3077b52253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:44.939748 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0b616-be42-4b37-8c21-af3077b52253 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:44.940200 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0b616-be42-4b37-8c21-af3077b52253 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:44.940771 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0b616-be42-4b37-8c21-af3077b52253 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:44.949952 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb0b616-be42-4b37-8c21-af3077b52253 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:44.952913 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb0b616-be42-4b37-8c21-af3077b52253 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:44.966561 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-0fb0b616-be42-4b37-8c21-af3077b52253 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:14:44.966561 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:44.966561 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:44.966561 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:44.966561 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:44.966561 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:44.966561 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:44.966561 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:44.966561 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:44.966561 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:44.966561 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:44.966561 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:44.966561 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:14:44.966561 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:14:44.966561 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:14:44.967539 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:14:44.967539 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:44.967539 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:44.967539 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:44.967539 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:44.967539 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:44.967539 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:44.967539 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:44.967539 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:44.967539 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:44.967539 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:44.967539 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:44.967539 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:44.967539 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:44.967539 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:44.967539 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:44.967539 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:44.968880 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:14:44.968880 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:14:44.968880 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:14:44.968880 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:14:44.968880 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:14:44.968880 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:14:44.968880 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:14:44.968880 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:44.975731 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57936817-e820-4f6a-aff8-55fe897513c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:44.975731 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57936817-e820-4f6a-aff8-55fe897513c1 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:44.975731 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57936817-e820-4f6a-aff8-55fe897513c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:44.976283 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57936817-e820-4f6a-aff8-55fe897513c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:44.976964 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 365/750] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Aug 29 22:14:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:44.978331 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb0b616-be42-4b37-8c21-af3077b52253 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:44.980183 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:44.991936 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57936817-e820-4f6a-aff8-55fe897513c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:44.994290 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57936817-e820-4f6a-aff8-55fe897513c1 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:45.020702 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-57936817-e820-4f6a-aff8-55fe897513c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:45.020702 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:45.020702 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:45.020702 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:45.020702 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:45.020702 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:45.020702 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:45.020702 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:45.020702 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:45.020702 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:45.020702 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:45.020702 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:45.020702 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:14:45.020702 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:14:45.020702 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:14:45.020702 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:14:45.022634 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:45.022634 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:45.022634 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:45.022634 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:45.022634 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:45.022634 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:45.022634 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:45.022634 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:45.022634 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:45.022634 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:45.022634 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:45.022634 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:45.022634 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:45.022634 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:45.022634 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:45.022634 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:45.022634 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:14:45.023859 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:14:45.023859 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:45.023859 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:45.032841 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 386/751] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:14:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:45.034022 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57936817-e820-4f6a-aff8-55fe897513c1 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:45.049250 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:45.121822 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb0b616-be42-4b37-8c21-af3077b52253 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:45.166886 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd33be0-99dd-46a0-922f-69102e0b49d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:45.167461 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd33be0-99dd-46a0-922f-69102e0b49d5 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:45.167571 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57936817-e820-4f6a-aff8-55fe897513c1 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:45.167727 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd33be0-99dd-46a0-922f-69102e0b49d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:45.167960 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd33be0-99dd-46a0-922f-69102e0b49d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:45.170502 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd33be0-99dd-46a0-922f-69102e0b49d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:45.170502 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd33be0-99dd-46a0-922f-69102e0b49d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:45.170502 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd33be0-99dd-46a0-922f-69102e0b49d5 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:45.185392 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 366/752] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:14:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:45.191280 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd33be0-99dd-46a0-922f-69102e0b49d5 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:45.218707 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c933d9-8152-4a86-9573-b5b0a86322dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:45.220367 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c933d9-8152-4a86-9573-b5b0a86322dd None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:45.221027 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c933d9-8152-4a86-9573-b5b0a86322dd None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:45.221525 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c933d9-8152-4a86-9573-b5b0a86322dd None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:45.224008 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c933d9-8152-4a86-9573-b5b0a86322dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:45.224343 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c933d9-8152-4a86-9573-b5b0a86322dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:45.226343 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c933d9-8152-4a86-9573-b5b0a86322dd None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:45.241923 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 387/753] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Aug 29 22:14:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:45.242968 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c933d9-8152-4a86-9573-b5b0a86322dd None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:45.302466 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:45.329860 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd33be0-99dd-46a0-922f-69102e0b49d5 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:45.344648 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:45.359524 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c933d9-8152-4a86-9573-b5b0a86322dd None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:45.367206 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f0b58-7540-49a2-a7f2-c5534d394d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:45.368193 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f0b58-7540-49a2-a7f2-c5534d394d3f None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:45.368699 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f0b58-7540-49a2-a7f2-c5534d394d3f None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:45.369168 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f0b58-7540-49a2-a7f2-c5534d394d3f None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:45.370316 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8f0b58-7540-49a2-a7f2-c5534d394d3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:45.370841 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8f0b58-7540-49a2-a7f2-c5534d394d3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:45.372809 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8f0b58-7540-49a2-a7f2-c5534d394d3f None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:45.384515 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 367/754] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:14:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:45.385133 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f0b58-7540-49a2-a7f2-c5534d394d3f None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:45.399478 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ecaf8-e7ac-4a59-8963-16b2bff76045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:45.400096 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ecaf8-e7ac-4a59-8963-16b2bff76045 None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:45.400374 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ecaf8-e7ac-4a59-8963-16b2bff76045 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:45.400694 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ecaf8-e7ac-4a59-8963-16b2bff76045 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:45.401330 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435ecaf8-e7ac-4a59-8963-16b2bff76045 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:45.402695 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435ecaf8-e7ac-4a59-8963-16b2bff76045 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:45.421650 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 388/755] 10.222.0.36 () {60 vars in 1141 bytes} [Mon Aug 29 22:14:45 2022] POST /identity/v3/services => generated 240 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:14:45.422401 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ecaf8-e7ac-4a59-8963-16b2bff76045 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:45.528303 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f0b58-7540-49a2-a7f2-c5534d394d3f None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:45.578422 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ecaf8-e7ac-4a59-8963-16b2bff76045 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:45.583699 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:45.585067 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb65fec-f526-41da-a5c2-5802139202a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:45.586466 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb65fec-f526-41da-a5c2-5802139202a7 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:45.586793 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb65fec-f526-41da-a5c2-5802139202a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:45.587068 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb65fec-f526-41da-a5c2-5802139202a7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:45.598011 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb65fec-f526-41da-a5c2-5802139202a7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:45.599472 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb65fec-f526-41da-a5c2-5802139202a7 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:45.613587 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-feb65fec-f526-41da-a5c2-5802139202a7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:14:45.613587 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:45.613587 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:45.613587 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:45.613587 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:45.613587 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:45.613587 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:45.613587 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:45.613587 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:45.613587 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:45.613587 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:45.613587 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:45.613587 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:14:45.613587 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:14:45.613587 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:14:45.613587 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:14:45.614664 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:45.614664 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:45.614664 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:14:45.614664 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:14:45.614664 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:14:45.614664 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:14:45.614664 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:45.614664 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:45.614664 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:45.614664 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:45.614664 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:45.614664 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:45.614664 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:45.614664 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:45.614664 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:45.614664 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:45.614664 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:45.614664 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:45.616903 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:45.616903 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:45.616903 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:14:45.616903 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:14:45.616903 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:14:45.616903 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:14:45.616903 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:14:45.616903 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:14:45.616903 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:14:45.616903 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:45.616903 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 368/756] 10.222.0.36 () {56 vars in 1093 bytes} [Mon Aug 29 22:14:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:45.616903 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb65fec-f526-41da-a5c2-5802139202a7 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:45.629346 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fce593-d824-44f2-9d33-2258ff780208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:45.629970 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fce593-d824-44f2-9d33-2258ff780208 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:45.630251 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fce593-d824-44f2-9d33-2258ff780208 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:45.630522 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fce593-d824-44f2-9d33-2258ff780208 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:45.631257 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fce593-d824-44f2-9d33-2258ff780208 None admin] RBAC: Adding query filter params (role.id=ff59a239a50b4bd899a83bf3c3fd1f63, scope.project.id=696ed25cc0cb43fab4bfaf762a90da54, user.id=5f3472d8ffa748d8828c6a2d89ee7ac7) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:45.631567 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fce593-d824-44f2-9d33-2258ff780208 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:45.633091 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fce593-d824-44f2-9d33-2258ff780208 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:45.640863 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 389/757] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Aug 29 22:14:45 2022] GET /identity/v3/role_assignments?user.id=5f3472d8ffa748d8828c6a2d89ee7ac7&scope.project.id=696ed25cc0cb43fab4bfaf762a90da54&role.id=ff59a239a50b4bd899a83bf3c3fd1f63 => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:45.641508 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fce593-d824-44f2-9d33-2258ff780208 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:45.661824 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:45.768985 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fce593-d824-44f2-9d33-2258ff780208 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:45.782831 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb65fec-f526-41da-a5c2-5802139202a7 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:45.821478 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fab9c6-f50c-47a2-9209-310a9ca706d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:45.822106 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fab9c6-f50c-47a2-9209-310a9ca706d5 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:45.822381 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fab9c6-f50c-47a2-9209-310a9ca706d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:45.822651 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fab9c6-f50c-47a2-9209-310a9ca706d5 None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:45.824836 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fab9c6-f50c-47a2-9209-310a9ca706d5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:45.825149 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fab9c6-f50c-47a2-9209-310a9ca706d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:45.827433 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fab9c6-f50c-47a2-9209-310a9ca706d5 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:45.857097 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b662d70c-38c6-4d36-91c0-c62ef976c255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:45.857737 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662d70c-38c6-4d36-91c0-c62ef976c255 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:45.858013 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662d70c-38c6-4d36-91c0-c62ef976c255 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:45.858279 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662d70c-38c6-4d36-91c0-c62ef976c255 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:45.864285 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 390/758] 10.222.0.36 () {56 vars in 1133 bytes} [Mon Aug 29 22:14:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:45.869698 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fab9c6-f50c-47a2-9209-310a9ca706d5 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:45.873452 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b662d70c-38c6-4d36-91c0-c62ef976c255 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:45.876253 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b662d70c-38c6-4d36-91c0-c62ef976c255 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:45.892237 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-b662d70c-38c6-4d36-91c0-c62ef976c255 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:14:45.892237 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:45.892237 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:45.892237 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:45.892237 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:45.892237 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:45.892237 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:45.892237 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:45.892237 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:45.892237 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:45.892237 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:45.892237 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:45.892237 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:14:45.892237 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:14:45.892237 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:14:45.893210 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:14:45.893210 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:45.893210 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:45.893210 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:45.893210 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:45.893210 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:45.893210 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:45.893210 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:45.893210 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:45.893210 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:45.893210 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:45.893210 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:45.893210 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:45.893210 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:45.893210 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:45.893210 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:45.893210 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:45.894603 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:14:45.894603 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:14:45.894603 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:14:45.894603 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:14:45.894603 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:14:45.894603 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:14:45.894603 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:14:45.894603 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:45.898237 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 369/759] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Aug 29 22:14:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:45.899712 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b662d70c-38c6-4d36-91c0-c62ef976c255 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:45.946735 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:46.000347 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:46.019354 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b662d70c-38c6-4d36-91c0-c62ef976c255 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:46.061980 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7818d6-899f-48cd-a37e-43cf2f626039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:46.062844 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7818d6-899f-48cd-a37e-43cf2f626039 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:46.063272 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7818d6-899f-48cd-a37e-43cf2f626039 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:46.063678 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7818d6-899f-48cd-a37e-43cf2f626039 None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:46.064558 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7818d6-899f-48cd-a37e-43cf2f626039 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:46.064999 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7818d6-899f-48cd-a37e-43cf2f626039 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:46.066608 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7818d6-899f-48cd-a37e-43cf2f626039 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:46.092352 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 370/760] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Aug 29 22:14:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:46.098749 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7818d6-899f-48cd-a37e-43cf2f626039 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:46.116666 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fab9c6-f50c-47a2-9209-310a9ca706d5 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:46.214142 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72559bc3-8cf4-4333-89a1-f98d5a5618af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:46.214398 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7818d6-899f-48cd-a37e-43cf2f626039 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:46.214961 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72559bc3-8cf4-4333-89a1-f98d5a5618af None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:46.215312 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72559bc3-8cf4-4333-89a1-f98d5a5618af None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:46.215650 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72559bc3-8cf4-4333-89a1-f98d5a5618af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:46.226441 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72559bc3-8cf4-4333-89a1-f98d5a5618af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:46.228151 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72559bc3-8cf4-4333-89a1-f98d5a5618af None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:46.243524 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-72559bc3-8cf4-4333-89a1-f98d5a5618af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:46.243524 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:46.243524 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:46.243524 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:46.243524 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:46.243524 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:46.243524 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:46.243524 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:46.243524 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:46.243524 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:46.243524 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:46.243524 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:46.243524 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:14:46.243524 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:14:46.243524 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:14:46.243524 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:14:46.244737 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:46.244737 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:46.244737 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:46.244737 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:46.244737 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:46.244737 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:46.244737 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:46.244737 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:46.244737 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:46.244737 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:46.244737 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:46.244737 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:46.244737 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:46.244737 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:46.244737 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:46.244737 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:46.244737 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:14:46.245832 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:14:46.245832 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:46.245832 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:46.246805 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 391/761] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:14:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:14:46.258220 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd95fa0-719f-4a69-9728-b7e5331e925a None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:46.258470 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd95fa0-719f-4a69-9728-b7e5331e925a None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:46.258609 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd95fa0-719f-4a69-9728-b7e5331e925a None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:46.260401 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 392/762] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:14:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:14:46.260965 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd95fa0-719f-4a69-9728-b7e5331e925a None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:46.281577 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3232efb0-8cdd-4b17-8806-03cd4be5c379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:46.282734 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3232efb0-8cdd-4b17-8806-03cd4be5c379 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:46.283215 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3232efb0-8cdd-4b17-8806-03cd4be5c379 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:46.283695 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3232efb0-8cdd-4b17-8806-03cd4be5c379 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:46.284666 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3232efb0-8cdd-4b17-8806-03cd4be5c379 None admin] RBAC: Adding query filter params (role.id=bc7b902c0870483ba03c139d941f78ac, scope.project.id=696ed25cc0cb43fab4bfaf762a90da54, user.id=b32922d090564162810dd8b28c3a322b) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:46.285290 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3232efb0-8cdd-4b17-8806-03cd4be5c379 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:46.286919 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3232efb0-8cdd-4b17-8806-03cd4be5c379 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:46.293916 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 371/763] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Aug 29 22:14:46 2022] GET /identity/v3/role_assignments?user.id=b32922d090564162810dd8b28c3a322b&scope.project.id=696ed25cc0cb43fab4bfaf762a90da54&role.id=bc7b902c0870483ba03c139d941f78ac => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:46.295588 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa88bb-7244-4ea2-a060-e1e1373e9991 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:46.296189 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa88bb-7244-4ea2-a060-e1e1373e9991 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:46.296732 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa88bb-7244-4ea2-a060-e1e1373e9991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:46.317094 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-3caa88bb-7244-4ea2-a060-e1e1373e9991 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:14:46.318631 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3caa88bb-7244-4ea2-a060-e1e1373e9991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:14:46.329284 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:46.348444 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:46.372982 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd95fa0-719f-4a69-9728-b7e5331e925a None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:46.403535 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 372/764] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:14:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:14:46.457297 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c34e596-aeb6-455b-804a-e6d3eceb6597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:46.457938 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34e596-aeb6-455b-804a-e6d3eceb6597 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:46.458216 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34e596-aeb6-455b-804a-e6d3eceb6597 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:46.458486 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34e596-aeb6-455b-804a-e6d3eceb6597 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:46.459151 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c34e596-aeb6-455b-804a-e6d3eceb6597 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:46.459452 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c34e596-aeb6-455b-804a-e6d3eceb6597 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:46.461235 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c34e596-aeb6-455b-804a-e6d3eceb6597 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:46.478099 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 393/765] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:14:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:46.483640 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caa88bb-7244-4ea2-a060-e1e1373e9991 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:46.600312 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caa88bb-7244-4ea2-a060-e1e1373e9991 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:46.645357 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccac9c3-d647-48a4-a0ea-e90d9b75a5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:46.646354 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccac9c3-d647-48a4-a0ea-e90d9b75a5da None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:46.646824 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccac9c3-d647-48a4-a0ea-e90d9b75a5da None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:46.647272 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccac9c3-d647-48a4-a0ea-e90d9b75a5da None admin] PATH_INFO: `/v3/projects/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:46.658296 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccac9c3-d647-48a4-a0ea-e90d9b75a5da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:46.659972 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccac9c3-d647-48a4-a0ea-e90d9b75a5da None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:46.672311 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-cccac9c3-d647-48a4-a0ea-e90d9b75a5da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:14:46.672311 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:46.672311 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:46.672311 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:46.672311 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:46.672311 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:46.672311 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:46.672311 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:46.672311 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:46.672311 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:46.672311 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:46.672311 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:46.672311 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:14:46.672311 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:14:46.672311 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:14:46.673283 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:14:46.673283 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:46.673283 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:46.673283 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:46.673283 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:46.673283 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:46.673283 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:46.673283 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:46.673283 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:46.673283 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:46.673283 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:46.673283 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:46.673283 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:46.673283 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:46.673283 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:46.673283 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:46.673283 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:46.674183 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:14:46.674183 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:14:46.674183 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:14:46.674183 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:14:46.674183 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:14:46.674183 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:14:46.674183 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:14:46.674183 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:46.676277 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 373/766] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Aug 29 22:14:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:46.681811 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c34e596-aeb6-455b-804a-e6d3eceb6597 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:46.733771 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccac9c3-d647-48a4-a0ea-e90d9b75a5da None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:46.737072 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:46.831279 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c34e596-aeb6-455b-804a-e6d3eceb6597 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:46.870448 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46e3a6a-f64d-4296-96c7-2cee54b8e457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:46.871115 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e3a6a-f64d-4296-96c7-2cee54b8e457 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:46.871463 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e3a6a-f64d-4296-96c7-2cee54b8e457 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:46.871941 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e3a6a-f64d-4296-96c7-2cee54b8e457 None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:46.872649 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46e3a6a-f64d-4296-96c7-2cee54b8e457 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:46.880474 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46e3a6a-f64d-4296-96c7-2cee54b8e457 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:46.880474 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46e3a6a-f64d-4296-96c7-2cee54b8e457 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:46.881699 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:46.892477 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 394/767] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Aug 29 22:14:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:46.897658 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46e3a6a-f64d-4296-96c7-2cee54b8e457 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:46.964772 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccac9c3-d647-48a4-a0ea-e90d9b75a5da None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:47.017250 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46e3a6a-f64d-4296-96c7-2cee54b8e457 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:47.018468 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5decd1b-20b0-4256-8f48-00297b212eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:47.019132 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5decd1b-20b0-4256-8f48-00297b212eb2 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:47.019561 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5decd1b-20b0-4256-8f48-00297b212eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:47.019768 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5decd1b-20b0-4256-8f48-00297b212eb2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:47.020371 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5decd1b-20b0-4256-8f48-00297b212eb2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:47.021892 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5decd1b-20b0-4256-8f48-00297b212eb2 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:47.036315 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-e5decd1b-20b0-4256-8f48-00297b212eb2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 22:14:47.036315 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:47.036315 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:14:47.036315 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:14:47.036315 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:14:47.036315 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:14:47.036315 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:14:47.036315 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:14:47.036315 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 22:14:47.036315 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:47.036315 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:14:47.036315 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:47.036315 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:47.036315 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:47.036315 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:47.036315 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:47.036315 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:47.037456 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:47.037456 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:47.037456 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:47.037456 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:47.037456 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:47.037456 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:47.037456 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:14:47.037456 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:14:47.037456 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:14:47.037456 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:14:47.037456 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:47.037456 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:47.037456 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:47.037456 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:47.037456 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:47.037456 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:47.038303 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:47.038303 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:47.038303 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:47.038303 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:47.038303 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:47.038303 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:47.038303 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:47.038303 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:47.038303 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:47.038303 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:47.038303 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:14:47.038303 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:14:47.038303 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 22:14:47.038303 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:47.045936 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 374/768] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Aug 29 22:14:46 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:14:47.051385 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5decd1b-20b0-4256-8f48-00297b212eb2 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:47.061463 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa07d93-11b1-4195-bddd-a38fa7061b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:47.062424 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa07d93-11b1-4195-bddd-a38fa7061b13 None admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:47.062924 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa07d93-11b1-4195-bddd-a38fa7061b13 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:47.063441 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa07d93-11b1-4195-bddd-a38fa7061b13 None admin] PATH_INFO: `/v3/projects/696ed25cc0cb43fab4bfaf762a90da54/users/90b7213b7111456a93e294ce40b95b21/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:47.065642 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa07d93-11b1-4195-bddd-a38fa7061b13 None admin] RBAC: Authorizing `identity:create_grant(project_id=696ed25cc0cb43fab4bfaf762a90da54, user_id=90b7213b7111456a93e294ce40b95b21, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:47.067293 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa07d93-11b1-4195-bddd-a38fa7061b13 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:47.089301 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 395/769] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Aug 29 22:14:46 2022] PUT /identity/v3/projects/696ed25cc0cb43fab4bfaf762a90da54/users/90b7213b7111456a93e294ce40b95b21/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:14:47.168626 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:47.219903 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5decd1b-20b0-4256-8f48-00297b212eb2 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:47.274443 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8dd942-8be4-44e8-81b0-9a63a9d07efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:47.275149 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8dd942-8be4-44e8-81b0-9a63a9d07efd None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:47.275507 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8dd942-8be4-44e8-81b0-9a63a9d07efd None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:47.275787 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8dd942-8be4-44e8-81b0-9a63a9d07efd None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:47.276434 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8dd942-8be4-44e8-81b0-9a63a9d07efd None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:47.276755 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8dd942-8be4-44e8-81b0-9a63a9d07efd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:47.278134 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8dd942-8be4-44e8-81b0-9a63a9d07efd None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:47.284875 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 375/770] 10.222.0.36 () {56 vars in 1124 bytes} [Mon Aug 29 22:14:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:14:47.289747 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa07d93-11b1-4195-bddd-a38fa7061b13 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:47.368895 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:47.420663 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa07d93-11b1-4195-bddd-a38fa7061b13 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:47.464064 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83dc5a1-5d63-421f-8518-876b6e0e0a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:47.464710 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83dc5a1-5d63-421f-8518-876b6e0e0a45 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:47.464985 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83dc5a1-5d63-421f-8518-876b6e0e0a45 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:47.465252 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83dc5a1-5d63-421f-8518-876b6e0e0a45 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:47.465892 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83dc5a1-5d63-421f-8518-876b6e0e0a45 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:47.466189 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83dc5a1-5d63-421f-8518-876b6e0e0a45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:47.467566 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83dc5a1-5d63-421f-8518-876b6e0e0a45 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:47.473003 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 396/771] 10.222.0.36 () {56 vars in 1124 bytes} [Mon Aug 29 22:14:47 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:47.481572 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8dd942-8be4-44e8-81b0-9a63a9d07efd None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:47.602875 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8dd942-8be4-44e8-81b0-9a63a9d07efd None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:47.649039 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:47.654015 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98808d9-4dff-45f1-b90e-26ae7a72bcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:47.654692 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98808d9-4dff-45f1-b90e-26ae7a72bcb4 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:47.654981 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98808d9-4dff-45f1-b90e-26ae7a72bcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:47.655228 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98808d9-4dff-45f1-b90e-26ae7a72bcb4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:47.655966 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98808d9-4dff-45f1-b90e-26ae7a72bcb4 None admin] RBAC: Adding query filter params (interface=public, service_id=7f92c01dfa5b48d5a4c7df9abd32bc54, region_id=RegionOne) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:47.656278 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98808d9-4dff-45f1-b90e-26ae7a72bcb4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:47.657722 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98808d9-4dff-45f1-b90e-26ae7a72bcb4 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:47.671848 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 376/772] 10.222.0.36 () {56 vars in 1251 bytes} [Mon Aug 29 22:14:47 2022] GET /identity/v3/endpoints?service_id=7f92c01dfa5b48d5a4c7df9abd32bc54&interface=public®ion_id=RegionOne => generated 194 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:47.677211 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83dc5a1-5d63-421f-8518-876b6e0e0a45 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:47.794144 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ddbf87-82e3-4cc8-a934-7057b98c6510 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:47.794433 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ddbf87-82e3-4cc8-a934-7057b98c6510 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:47.794708 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ddbf87-82e3-4cc8-a934-7057b98c6510 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:47.796054 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 377/773] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:14:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:14:47.813434 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c363983-2509-48ed-ade8-d218800fbd53 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:47.813754 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c363983-2509-48ed-ade8-d218800fbd53 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:47.813991 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c363983-2509-48ed-ade8-d218800fbd53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:47.828830 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83dc5a1-5d63-421f-8518-876b6e0e0a45 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:47.855842 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-1c363983-2509-48ed-ade8-d218800fbd53 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:14:47.855842 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-1c363983-2509-48ed-ade8-d218800fbd53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:14:47.864847 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:47.881156 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb60892f-72a1-4fa1-a050-672f25a4bb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:47.882060 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60892f-72a1-4fa1-a050-672f25a4bb4f None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:47.882491 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60892f-72a1-4fa1-a050-672f25a4bb4f None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:47.882951 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60892f-72a1-4fa1-a050-672f25a4bb4f None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:47.883702 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb60892f-72a1-4fa1-a050-672f25a4bb4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:47.885254 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb60892f-72a1-4fa1-a050-672f25a4bb4f None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:47.901758 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 397/774] 10.222.0.36 () {56 vars in 1087 bytes} [Mon Aug 29 22:14:47 2022] GET /identity/v3/services => generated 772 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:47.955402 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b0459-dec5-45a6-8557-e2af28df9385 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:47.955600 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b0459-dec5-45a6-8557-e2af28df9385 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:47.955998 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b0459-dec5-45a6-8557-e2af28df9385 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:47.959732 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 398/775] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:14:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:14:47.964790 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097fa61b-e913-46e9-bd23-8aeb2d34ef25 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:47.965078 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097fa61b-e913-46e9-bd23-8aeb2d34ef25 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:47.965361 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097fa61b-e913-46e9-bd23-8aeb2d34ef25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:47.967492 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 378/776] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:14:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:14:48.010132 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-097fa61b-e913-46e9-bd23-8aeb2d34ef25 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:14:48.011364 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-097fa61b-e913-46e9-bd23-8aeb2d34ef25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:14:48.104176 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 399/777] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:14:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:14:48.270204 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c363983-2509-48ed-ade8-d218800fbd53 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:48.408632 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c363983-2509-48ed-ade8-d218800fbd53 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:48.438669 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097fa61b-e913-46e9-bd23-8aeb2d34ef25 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:48.445537 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:48.468563 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c843228-0ba6-43b0-9fa0-ebfbdce48c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:48.469231 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c843228-0ba6-43b0-9fa0-ebfbdce48c26 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:48.469512 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c843228-0ba6-43b0-9fa0-ebfbdce48c26 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:48.469786 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c843228-0ba6-43b0-9fa0-ebfbdce48c26 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:48.501450 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c843228-0ba6-43b0-9fa0-ebfbdce48c26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:14:48.506372 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-5c843228-0ba6-43b0-9fa0-ebfbdce48c26 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:14:48.506372 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:48.506372 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:48.506372 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:48.506372 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:48.506372 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:48.506372 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:48.506372 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:48.506372 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:48.506372 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:48.506372 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:48.506372 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:48.506372 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:14:48.506372 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:14:48.506372 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:14:48.506372 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:14:48.507321 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:14:48.507321 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:14:48.507321 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:14:48.507321 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:14:48.507321 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:48.507321 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:48.507321 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:48.507321 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:48.507321 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:48.507321 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:48.507321 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:48.507321 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:48.507321 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:48.507321 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:48.507321 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:48.507321 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:48.508215 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:48.508215 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:48.508215 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:48.508215 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:48.508215 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:14:48.508215 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:14:48.508215 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:14:48.508215 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:14:48.508215 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:14:48.508215 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:14:48.508215 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:14:48.508215 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:48.508215 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 379/778] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Aug 29 22:14:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:48.516026 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c843228-0ba6-43b0-9fa0-ebfbdce48c26 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:48.567072 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097fa61b-e913-46e9-bd23-8aeb2d34ef25 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:48.588060 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:48.611463 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ecdc30-1c44-4fb8-a027-a9265f8c7128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:48.612597 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ecdc30-1c44-4fb8-a027-a9265f8c7128 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:48.613076 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ecdc30-1c44-4fb8-a027-a9265f8c7128 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:48.613634 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ecdc30-1c44-4fb8-a027-a9265f8c7128 None admin] PATH_INFO: `/v3/services/network` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:48.614447 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ecdc30-1c44-4fb8-a027-a9265f8c7128 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:48.616056 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ecdc30-1c44-4fb8-a027-a9265f8c7128 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:48.627272 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-00ecdc30-1c44-4fb8-a027-a9265f8c7128 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 22:14:48.627272 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:48.627272 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:14:48.627272 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:14:48.627272 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:14:48.627272 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:14:48.627272 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:14:48.627272 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:14:48.627272 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 22:14:48.627272 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:48.627272 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:14:48.627272 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:48.627272 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:48.627272 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:48.627272 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:48.627272 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:48.627272 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:48.628381 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:48.628381 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:48.628381 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:48.628381 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:48.628381 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:48.628381 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:48.628381 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:14:48.628381 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:14:48.628381 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:14:48.628381 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:14:48.628381 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:48.628381 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:48.628381 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:48.628381 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:48.628381 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:48.628381 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:48.629262 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:48.629262 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:48.629262 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:48.629262 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:48.629262 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:48.629262 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:48.629262 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:48.629262 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:48.629262 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:48.629262 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:48.629262 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:14:48.629262 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:14:48.629262 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 22:14:48.629262 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:48.632833 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 400/779] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Aug 29 22:14:48 2022] GET /identity/v3/services/network => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:14:48.642356 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ecdc30-1c44-4fb8-a027-a9265f8c7128 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:48.756300 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c843228-0ba6-43b0-9fa0-ebfbdce48c26 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:48.768158 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ecdc30-1c44-4fb8-a027-a9265f8c7128 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:48.802217 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d505c3-b1ef-48e0-8028-1d45698204c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:48.803575 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d505c3-b1ef-48e0-8028-1d45698204c2 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:48.804600 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d505c3-b1ef-48e0-8028-1d45698204c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:48.805272 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d505c3-b1ef-48e0-8028-1d45698204c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:48.807473 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d505c3-b1ef-48e0-8028-1d45698204c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:48.808429 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d505c3-b1ef-48e0-8028-1d45698204c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:48.810574 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d505c3-b1ef-48e0-8028-1d45698204c2 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:48.811629 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80cfb1-ddcc-4845-9e91-5f0c4764eed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:48.812256 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80cfb1-ddcc-4845-9e91-5f0c4764eed1 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:48.812568 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80cfb1-ddcc-4845-9e91-5f0c4764eed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:48.812844 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80cfb1-ddcc-4845-9e91-5f0c4764eed1 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:48.813490 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80cfb1-ddcc-4845-9e91-5f0c4764eed1 None admin] RBAC: Adding query filter params (name=network) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:48.813821 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80cfb1-ddcc-4845-9e91-5f0c4764eed1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:48.815174 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80cfb1-ddcc-4845-9e91-5f0c4764eed1 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:48.822904 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 380/781] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:14:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:14:48.827492 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 401/781] 10.222.0.36 () {56 vars in 1112 bytes} [Mon Aug 29 22:14:48 2022] GET /identity/v3/services?name=network => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:48.827492 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476aad5-8583-4852-a8bb-64d2171d3101 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:48.827492 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476aad5-8583-4852-a8bb-64d2171d3101 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:48.827492 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476aad5-8583-4852-a8bb-64d2171d3101 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:48.829336 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 402/782] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:14:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:14:48.830133 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476aad5-8583-4852-a8bb-64d2171d3101 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:48.830359 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d505c3-b1ef-48e0-8028-1d45698204c2 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:48.890401 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:48.900718 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:48.971218 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476aad5-8583-4852-a8bb-64d2171d3101 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:48.972419 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d505c3-b1ef-48e0-8028-1d45698204c2 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:49.011468 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ada5d-a976-460a-8b5c-1c5b2eb11e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:49.011989 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ada5d-a976-460a-8b5c-1c5b2eb11e6c None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:49.012271 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ada5d-a976-460a-8b5c-1c5b2eb11e6c None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:49.012571 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ada5d-a976-460a-8b5c-1c5b2eb11e6c None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:49.013222 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ada5d-a976-460a-8b5c-1c5b2eb11e6c None admin] RBAC: Adding query filter params (type=network) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:49.013688 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ada5d-a976-460a-8b5c-1c5b2eb11e6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:49.015243 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ada5d-a976-460a-8b5c-1c5b2eb11e6c None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:49.021356 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6269695d-0a35-4533-aaa9-5fd9335be9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:49.022270 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6269695d-0a35-4533-aaa9-5fd9335be9bf None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:49.022752 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6269695d-0a35-4533-aaa9-5fd9335be9bf None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:49.023223 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6269695d-0a35-4533-aaa9-5fd9335be9bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:49.027650 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 381/783] 10.222.0.36 () {56 vars in 1112 bytes} [Mon Aug 29 22:14:48 2022] GET /identity/v3/services?type=network => generated 350 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:14:49.029066 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991097a-248f-4977-bb34-bb521ece420b None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:49.029364 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991097a-248f-4977-bb34-bb521ece420b None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:49.029640 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991097a-248f-4977-bb34-bb521ece420b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:49.038324 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6269695d-0a35-4533-aaa9-5fd9335be9bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:49.040266 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6269695d-0a35-4533-aaa9-5fd9335be9bf None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:49.048846 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-e991097a-248f-4977-bb34-bb521ece420b None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:14:49.050037 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e991097a-248f-4977-bb34-bb521ece420b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:14:49.059320 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-6269695d-0a35-4533-aaa9-5fd9335be9bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:49.059320 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:49.059320 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:49.059320 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:49.059320 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:49.059320 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:49.059320 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:49.059320 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:49.059320 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:49.059320 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:49.059320 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:49.059320 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:49.059320 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:14:49.059320 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:14:49.059320 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:14:49.059320 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:14:49.060338 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:49.060338 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:49.060338 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:49.060338 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:49.060338 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:49.060338 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:49.060338 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:49.060338 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:49.060338 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:49.060338 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:49.060338 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:49.060338 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:49.060338 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:49.060338 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:49.060338 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:49.060338 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:49.060338 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:14:49.061292 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:14:49.061292 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:49.061292 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:49.068680 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 403/784] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:14:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:49.069716 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6269695d-0a35-4533-aaa9-5fd9335be9bf None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:49.130163 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 382/785] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:14:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:14:49.131358 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991097a-248f-4977-bb34-bb521ece420b None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:49.175230 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:49.180874 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:49.184307 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6269695d-0a35-4533-aaa9-5fd9335be9bf None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:49.225414 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab06c2-1d6f-4af3-958d-ccafcf68fcf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:49.226042 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab06c2-1d6f-4af3-958d-ccafcf68fcf7 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:49.226323 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab06c2-1d6f-4af3-958d-ccafcf68fcf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:49.226626 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab06c2-1d6f-4af3-958d-ccafcf68fcf7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:49.228004 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ab06c2-1d6f-4af3-958d-ccafcf68fcf7 None admin] RBAC: Adding query filter params (interface=public, service_id=68672c7f9c4e467b908882f1d674666c, region_id=RegionOne) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:49.228318 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ab06c2-1d6f-4af3-958d-ccafcf68fcf7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:49.229739 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ab06c2-1d6f-4af3-958d-ccafcf68fcf7 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:49.248691 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 404/786] 10.222.0.36 () {56 vars in 1251 bytes} [Mon Aug 29 22:14:49 2022] GET /identity/v3/endpoints?service_id=68672c7f9c4e467b908882f1d674666c&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:49.260183 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab06c2-1d6f-4af3-958d-ccafcf68fcf7 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:49.339822 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991097a-248f-4977-bb34-bb521ece420b None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:49.431994 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd7f6d3-1ce9-4989-ac74-afea5087b59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:49.432582 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7f6d3-1ce9-4989-ac74-afea5087b59c None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:49.433152 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7f6d3-1ce9-4989-ac74-afea5087b59c None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:49.433427 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7f6d3-1ce9-4989-ac74-afea5087b59c None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:49.434101 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd7f6d3-1ce9-4989-ac74-afea5087b59c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:49.434408 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd7f6d3-1ce9-4989-ac74-afea5087b59c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:49.435897 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd7f6d3-1ce9-4989-ac74-afea5087b59c None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:49.467098 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 383/787] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:14:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:49.486317 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd7f6d3-1ce9-4989-ac74-afea5087b59c None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:49.617461 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab06c2-1d6f-4af3-958d-ccafcf68fcf7 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:49.631895 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:49.640043 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd7f6d3-1ce9-4989-ac74-afea5087b59c None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:49.660781 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23b945-572a-431b-9963-793dd1c4267a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:49.661393 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23b945-572a-431b-9963-793dd1c4267a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:49.661667 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23b945-572a-431b-9963-793dd1c4267a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:49.661931 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23b945-572a-431b-9963-793dd1c4267a None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:49.662537 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd23b945-572a-431b-9963-793dd1c4267a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:49.663900 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd23b945-572a-431b-9963-793dd1c4267a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:49.669890 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 405/788] 10.222.0.36 () {56 vars in 1087 bytes} [Mon Aug 29 22:14:49 2022] GET /identity/v3/services => generated 772 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:49.670659 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23b945-572a-431b-9963-793dd1c4267a None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:49.688813 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbbbb8b-0631-4d68-a776-6e5a25254ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:49.689366 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbbbb8b-0631-4d68-a776-6e5a25254ea5 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:49.689648 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbbbb8b-0631-4d68-a776-6e5a25254ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:49.689918 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbbbb8b-0631-4d68-a776-6e5a25254ea5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:49.700350 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbbbb8b-0631-4d68-a776-6e5a25254ea5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:49.701889 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbbbb8b-0631-4d68-a776-6e5a25254ea5 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:49.717011 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:49.719184 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-ecbbbb8b-0631-4d68-a776-6e5a25254ea5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 22:14:49.719184 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:49.719184 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:49.719184 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:49.719184 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:49.719184 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:49.719184 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:49.719184 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:49.719184 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:49.719184 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:49.719184 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:49.719184 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:49.719184 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:14:49.719184 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:14:49.719184 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:14:49.719184 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:14:49.720536 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:49.720536 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:49.720536 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:14:49.720536 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:14:49.720536 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:14:49.720536 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:14:49.720536 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:49.720536 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:49.720536 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:49.720536 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:49.720536 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:49.720536 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:49.720536 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:49.720536 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:49.720536 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:49.720536 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:49.720536 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:49.720536 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:49.721493 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:49.721493 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:49.721493 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:14:49.721493 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:14:49.721493 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:14:49.721493 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:14:49.721493 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:14:49.721493 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:14:49.721493 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 22:14:49.721493 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:49.724504 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 384/789] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Aug 29 22:14:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:49.726235 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c2cc2-fd78-490c-ae58-3e45970aa9bc None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:49.726802 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c2cc2-fd78-490c-ae58-3e45970aa9bc None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:49.727212 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c2cc2-fd78-490c-ae58-3e45970aa9bc None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:49.735019 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 385/790] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:14:49 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:14:49.736303 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c2cc2-fd78-490c-ae58-3e45970aa9bc None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:49.839418 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23b945-572a-431b-9963-793dd1c4267a None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:49.892702 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e378eb62-b5cb-4b8d-9f03-685fabc3c335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:49.893400 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378eb62-b5cb-4b8d-9f03-685fabc3c335 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:49.893632 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378eb62-b5cb-4b8d-9f03-685fabc3c335 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:49.893899 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378eb62-b5cb-4b8d-9f03-685fabc3c335 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:49.894923 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c2cc2-fd78-490c-ae58-3e45970aa9bc None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:49.906500 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e378eb62-b5cb-4b8d-9f03-685fabc3c335 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:14:49.911798 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-e378eb62-b5cb-4b8d-9f03-685fabc3c335 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:14:49.911798 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:49.911798 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:49.911798 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:49.911798 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:49.911798 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:49.911798 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:49.911798 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:49.911798 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:49.911798 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:49.911798 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:49.911798 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:49.911798 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:14:49.911798 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:14:49.911798 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:14:49.911798 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:14:49.912828 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:14:49.912828 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:14:49.912828 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:14:49.912828 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:14:49.912828 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:49.912828 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:49.912828 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:49.912828 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:49.912828 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:49.912828 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:49.912828 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:49.912828 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:49.912828 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:49.912828 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:49.912828 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:49.912828 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:49.913669 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:49.913669 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:49.913669 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:49.913669 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:49.913669 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:14:49.913669 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:14:49.913669 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:14:49.913669 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:14:49.913669 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:14:49.913669 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:14:49.913669 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:14:49.913669 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:49.918410 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 406/791] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Aug 29 22:14:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:49.920221 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20184165-2a3e-4d22-9161-1fb72439a317 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:49.920565 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20184165-2a3e-4d22-9161-1fb72439a317 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:49.920835 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20184165-2a3e-4d22-9161-1fb72439a317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:49.940038 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-20184165-2a3e-4d22-9161-1fb72439a317 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:14:49.941164 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-20184165-2a3e-4d22-9161-1fb72439a317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:14:49.955848 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5ee6b4-8353-4faa-82d6-6a8af4da2bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:49.957293 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ee6b4-8353-4faa-82d6-6a8af4da2bcc None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:49.958665 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ee6b4-8353-4faa-82d6-6a8af4da2bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:49.959143 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ee6b4-8353-4faa-82d6-6a8af4da2bcc None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:49.960514 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5ee6b4-8353-4faa-82d6-6a8af4da2bcc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:49.961584 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5ee6b4-8353-4faa-82d6-6a8af4da2bcc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:49.964608 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5ee6b4-8353-4faa-82d6-6a8af4da2bcc None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:49.989184 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 386/792] 10.222.0.36 () {56 vars in 1135 bytes} [Mon Aug 29 22:14:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:49.990630 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5ee6b4-8353-4faa-82d6-6a8af4da2bcc None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:50.012760 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:50.052626 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 407/793] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:14:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:14:50.053870 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20184165-2a3e-4d22-9161-1fb72439a317 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:50.087006 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:50.137637 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5ee6b4-8353-4faa-82d6-6a8af4da2bcc None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:50.180514 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b956a-b2c8-4de7-b7ed-8e94996fc725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:50.181680 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b956a-b2c8-4de7-b7ed-8e94996fc725 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:50.182164 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b956a-b2c8-4de7-b7ed-8e94996fc725 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:50.182634 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b956a-b2c8-4de7-b7ed-8e94996fc725 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:50.183812 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b956a-b2c8-4de7-b7ed-8e94996fc725 None admin] RBAC: Adding query filter params (name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:50.184323 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b956a-b2c8-4de7-b7ed-8e94996fc725 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:50.186548 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b956a-b2c8-4de7-b7ed-8e94996fc725 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:50.202680 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 387/794] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Aug 29 22:14:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:50.203926 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b956a-b2c8-4de7-b7ed-8e94996fc725 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:50.265480 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20184165-2a3e-4d22-9161-1fb72439a317 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:50.293081 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:50.309072 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81489fec-e2d4-4f8e-b790-dd6efebf40fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:50.309945 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81489fec-e2d4-4f8e-b790-dd6efebf40fe None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:50.310221 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81489fec-e2d4-4f8e-b790-dd6efebf40fe None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:50.310671 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81489fec-e2d4-4f8e-b790-dd6efebf40fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:50.315190 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b956a-b2c8-4de7-b7ed-8e94996fc725 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:50.325647 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81489fec-e2d4-4f8e-b790-dd6efebf40fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:50.327953 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81489fec-e2d4-4f8e-b790-dd6efebf40fe None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:50.344248 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-81489fec-e2d4-4f8e-b790-dd6efebf40fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:50.344248 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:50.344248 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:50.344248 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:50.344248 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:50.344248 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:50.344248 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:50.344248 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:50.344248 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:50.344248 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:50.344248 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:50.344248 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:50.344248 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:14:50.344248 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:14:50.344248 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:14:50.344248 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:14:50.345301 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:50.345301 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:50.345301 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:50.345301 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:50.345301 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:50.345301 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:50.345301 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:50.345301 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:50.345301 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:50.345301 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:50.345301 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:50.345301 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:50.345301 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:50.345301 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:50.345301 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:50.345301 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:50.345301 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:14:50.346216 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:14:50.346216 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:50.346216 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:50.346216 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 408/795] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:14:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:50.348471 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef5fc1-ffc5-4e82-a708-97704fab3d4c None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:50.348471 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef5fc1-ffc5-4e82-a708-97704fab3d4c None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:50.348471 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef5fc1-ffc5-4e82-a708-97704fab3d4c None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:50.348914 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 409/796] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:14:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:14:50.352225 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11568121-43e7-489c-9c54-893d3b47d459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:50.353084 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11568121-43e7-489c-9c54-893d3b47d459 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:50.353373 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11568121-43e7-489c-9c54-893d3b47d459 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:50.353647 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11568121-43e7-489c-9c54-893d3b47d459 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:50.354541 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8609a-7071-41fd-b49c-e8885a6037eb None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:50.354833 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8609a-7071-41fd-b49c-e8885a6037eb None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:50.355109 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8609a-7071-41fd-b49c-e8885a6037eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:50.365468 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11568121-43e7-489c-9c54-893d3b47d459 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:50.366940 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11568121-43e7-489c-9c54-893d3b47d459 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:50.378282 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-7ef8609a-7071-41fd-b49c-e8885a6037eb None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:14:50.379482 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7ef8609a-7071-41fd-b49c-e8885a6037eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:14:50.382557 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-11568121-43e7-489c-9c54-893d3b47d459 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:50.382557 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:50.382557 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:50.382557 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:50.382557 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:50.382557 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:50.382557 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:50.382557 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:50.382557 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:50.382557 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:50.382557 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:50.382557 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:50.382557 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:14:50.382557 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:14:50.382557 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:14:50.382557 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:14:50.383868 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:50.383868 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:50.383868 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:50.383868 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:50.383868 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:50.383868 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:50.383868 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:50.383868 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:50.383868 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:50.383868 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:50.383868 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:50.383868 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:50.383868 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:50.383868 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:50.383868 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:50.383868 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:50.383868 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:14:50.384814 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:14:50.384814 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:50.384814 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:50.388779 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 388/797] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:14:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:50.390072 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11568121-43e7-489c-9c54-893d3b47d459 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:50.453555 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:50.462754 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 410/798] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:14:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:14:50.463459 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef8609a-7071-41fd-b49c-e8885a6037eb None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:50.507320 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11568121-43e7-489c-9c54-893d3b47d459 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:50.558512 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:50.566208 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47da35ec-ca2c-4b8a-b074-567f0e2654ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:50.566834 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da35ec-ca2c-4b8a-b074-567f0e2654ce None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:50.567113 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da35ec-ca2c-4b8a-b074-567f0e2654ce None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:50.567438 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da35ec-ca2c-4b8a-b074-567f0e2654ce None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:50.568102 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47da35ec-ca2c-4b8a-b074-567f0e2654ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:50.568406 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47da35ec-ca2c-4b8a-b074-567f0e2654ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:50.569940 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47da35ec-ca2c-4b8a-b074-567f0e2654ce None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:50.591433 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 389/799] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:14:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:50.591433 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47da35ec-ca2c-4b8a-b074-567f0e2654ce None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:50.607694 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef8609a-7071-41fd-b49c-e8885a6037eb None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:50.660511 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1767b1-023c-4d13-836e-07c4f764577a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:50.661317 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1767b1-023c-4d13-836e-07c4f764577a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:50.661560 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1767b1-023c-4d13-836e-07c4f764577a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:50.661888 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1767b1-023c-4d13-836e-07c4f764577a None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:50.662785 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1767b1-023c-4d13-836e-07c4f764577a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:50.663145 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1767b1-023c-4d13-836e-07c4f764577a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:50.664939 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1767b1-023c-4d13-836e-07c4f764577a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:50.679933 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 411/800] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:14:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:50.681003 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1767b1-023c-4d13-836e-07c4f764577a None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:50.719718 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47da35ec-ca2c-4b8a-b074-567f0e2654ce None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:50.753312 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:50.759584 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e9f005-dd2d-4290-9adb-f46d0f576f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:50.760599 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9f005-dd2d-4290-9adb-f46d0f576f45 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:50.761091 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9f005-dd2d-4290-9adb-f46d0f576f45 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:50.761520 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9f005-dd2d-4290-9adb-f46d0f576f45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:50.774460 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e9f005-dd2d-4290-9adb-f46d0f576f45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:14:50.780624 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-76e9f005-dd2d-4290-9adb-f46d0f576f45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:14:50.780624 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:50.780624 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:50.780624 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:50.780624 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:50.780624 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:50.780624 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:50.780624 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:50.780624 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:50.780624 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:50.780624 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:50.780624 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:50.780624 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:14:50.780624 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:14:50.780624 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:14:50.780624 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:14:50.781737 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:14:50.781737 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:14:50.781737 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:14:50.781737 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:14:50.781737 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:50.781737 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:50.781737 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:50.781737 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:50.781737 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:50.781737 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:50.781737 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:50.781737 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:50.781737 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:50.781737 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:50.781737 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:50.781737 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:50.782702 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:50.782702 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:50.782702 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:50.782702 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:50.782702 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:14:50.782702 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:14:50.782702 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:14:50.782702 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:14:50.782702 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:14:50.782702 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:14:50.782702 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:14:50.782702 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:50.785865 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 390/801] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Aug 29 22:14:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:50.787190 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e9f005-dd2d-4290-9adb-f46d0f576f45 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:50.805102 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1767b1-023c-4d13-836e-07c4f764577a None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:50.851950 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:50.855056 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f74c05-217b-476d-b9cb-497914bd4a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:50.855876 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f74c05-217b-476d-b9cb-497914bd4a02 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:50.856281 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f74c05-217b-476d-b9cb-497914bd4a02 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:50.856839 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f74c05-217b-476d-b9cb-497914bd4a02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:50.864812 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f74c05-217b-476d-b9cb-497914bd4a02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:50.866266 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f74c05-217b-476d-b9cb-497914bd4a02 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:50.878281 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-43f74c05-217b-476d-b9cb-497914bd4a02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:14:50.878281 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:50.878281 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:50.878281 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:50.878281 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:50.878281 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:50.878281 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:50.878281 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:50.878281 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:50.878281 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:50.878281 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:50.878281 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:50.878281 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:14:50.878281 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:14:50.878281 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:14:50.879267 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:14:50.879267 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:50.879267 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:50.879267 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:50.879267 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:50.879267 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:50.879267 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:50.879267 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:50.879267 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:50.879267 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:50.879267 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:50.879267 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:50.879267 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:50.879267 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:50.879267 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:50.879267 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:50.879267 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:50.885254 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:14:50.885254 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:14:50.885254 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:14:50.885254 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:14:50.885254 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:14:50.885254 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:14:50.885254 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:14:50.885254 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:50.885254 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 412/802] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Aug 29 22:14:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:50.885254 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f74c05-217b-476d-b9cb-497914bd4a02 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:50.918662 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e9f005-dd2d-4290-9adb-f46d0f576f45 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:50.960948 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04887ef-df37-4c13-b0d5-7f6b3381bf06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:50.961581 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04887ef-df37-4c13-b0d5-7f6b3381bf06 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:50.961893 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04887ef-df37-4c13-b0d5-7f6b3381bf06 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:50.962197 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04887ef-df37-4c13-b0d5-7f6b3381bf06 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:50.971014 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04887ef-df37-4c13-b0d5-7f6b3381bf06 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:50.972386 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04887ef-df37-4c13-b0d5-7f6b3381bf06 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:50.985346 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-c04887ef-df37-4c13-b0d5-7f6b3381bf06 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 22:14:50.985346 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:50.985346 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:50.985346 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:50.985346 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:50.985346 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:50.985346 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:50.985346 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:50.985346 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:50.985346 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:50.985346 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:50.985346 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:50.985346 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:14:50.985346 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:14:50.985346 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:14:50.985346 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:14:50.986350 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:50.986350 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:50.986350 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:14:50.986350 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:14:50.986350 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:14:50.986350 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:14:50.986350 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:50.986350 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:50.986350 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:50.986350 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:50.986350 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:50.986350 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:50.986350 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:50.986350 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:50.986350 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:50.986350 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:50.986350 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:50.986350 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:50.987793 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:50.987793 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:50.987793 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:14:50.987793 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:14:50.987793 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:14:50.987793 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:14:50.987793 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:14:50.987793 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:14:50.987793 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 22:14:50.987793 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:50.987793 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 391/803] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Aug 29 22:14:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:50.987793 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04887ef-df37-4c13-b0d5-7f6b3381bf06 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:50.997744 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f74c05-217b-476d-b9cb-497914bd4a02 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:51.015121 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:51.034236 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df464949-c717-4226-b550-4594195f15f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:51.034853 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df464949-c717-4226-b550-4594195f15f2 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:51.035110 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df464949-c717-4226-b550-4594195f15f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:51.035375 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df464949-c717-4226-b550-4594195f15f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:51.036052 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df464949-c717-4226-b550-4594195f15f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:51.036349 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df464949-c717-4226-b550-4594195f15f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:51.040526 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df464949-c717-4226-b550-4594195f15f2 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:51.051549 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 413/804] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:14:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:51.052615 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df464949-c717-4226-b550-4594195f15f2 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:51.106009 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04887ef-df37-4c13-b0d5-7f6b3381bf06 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:51.119109 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:51.141669 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9182d5a6-b0c2-4cdc-b07b-21047d8d6894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:51.142409 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182d5a6-b0c2-4cdc-b07b-21047d8d6894 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:51.142688 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182d5a6-b0c2-4cdc-b07b-21047d8d6894 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:51.143053 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182d5a6-b0c2-4cdc-b07b-21047d8d6894 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:51.143637 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9182d5a6-b0c2-4cdc-b07b-21047d8d6894 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:51.145175 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9182d5a6-b0c2-4cdc-b07b-21047d8d6894 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:51.155092 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-9182d5a6-b0c2-4cdc-b07b-21047d8d6894 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 22:14:51.155092 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:51.155092 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:14:51.155092 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:14:51.155092 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:14:51.155092 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:14:51.155092 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:14:51.155092 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:14:51.155092 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 22:14:51.155092 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:51.155092 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:14:51.155092 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:51.155092 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:51.155092 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:51.155092 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:51.155092 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:51.155092 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:51.156097 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:51.156097 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:51.156097 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:51.156097 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:51.156097 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:51.156097 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:51.156097 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:14:51.156097 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:14:51.156097 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:14:51.156097 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:14:51.156097 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:51.156097 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:51.156097 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:51.156097 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:51.156097 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:51.156097 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:51.157354 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:51.157354 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:51.157354 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:51.157354 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:51.157354 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:51.157354 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:51.157354 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:51.157354 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:51.157354 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:51.157354 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:51.157354 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:14:51.157354 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:14:51.157354 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 22:14:51.157354 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:51.157354 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 392/805] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Aug 29 22:14:50 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:51.158166 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9182d5a6-b0c2-4cdc-b07b-21047d8d6894 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:51.161273 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df464949-c717-4226-b550-4594195f15f2 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:51.198135 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6549279b-f6fe-494f-9679-17fe3ab800bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:51.198756 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549279b-f6fe-494f-9679-17fe3ab800bb None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:51.199040 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549279b-f6fe-494f-9679-17fe3ab800bb None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:51.199294 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549279b-f6fe-494f-9679-17fe3ab800bb None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:51.200486 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6549279b-f6fe-494f-9679-17fe3ab800bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:51.200800 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6549279b-f6fe-494f-9679-17fe3ab800bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:51.202593 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6549279b-f6fe-494f-9679-17fe3ab800bb None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:51.220473 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 414/806] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Aug 29 22:14:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:51.220473 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6549279b-f6fe-494f-9679-17fe3ab800bb None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:51.260759 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:51.272617 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9182d5a6-b0c2-4cdc-b07b-21047d8d6894 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:51.311395 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995515f-f717-41ff-98fa-f1727a08afbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:51.312016 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995515f-f717-41ff-98fa-f1727a08afbd None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:51.312298 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995515f-f717-41ff-98fa-f1727a08afbd None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:51.312605 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995515f-f717-41ff-98fa-f1727a08afbd None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:51.313340 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8995515f-f717-41ff-98fa-f1727a08afbd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:51.313652 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8995515f-f717-41ff-98fa-f1727a08afbd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:51.315091 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8995515f-f717-41ff-98fa-f1727a08afbd None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:51.327127 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6549279b-f6fe-494f-9679-17fe3ab800bb None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:51.339116 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 393/807] 10.222.0.36 () {56 vars in 1149 bytes} [Mon Aug 29 22:14:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:51.339116 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995515f-f717-41ff-98fa-f1727a08afbd None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:51.367041 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b50ae6-fa8b-4dc5-b082-587837fa8704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:51.367710 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b50ae6-fa8b-4dc5-b082-587837fa8704 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:51.367985 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b50ae6-fa8b-4dc5-b082-587837fa8704 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:51.368248 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b50ae6-fa8b-4dc5-b082-587837fa8704 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:51.373123 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:51.379925 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b50ae6-fa8b-4dc5-b082-587837fa8704 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:51.381403 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b50ae6-fa8b-4dc5-b082-587837fa8704 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:51.396488 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-f7b50ae6-fa8b-4dc5-b082-587837fa8704 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:51.396488 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:51.396488 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:51.396488 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:51.396488 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:51.396488 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:51.396488 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:51.396488 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:51.396488 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:51.396488 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:51.396488 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:51.396488 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:51.396488 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:14:51.396488 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:14:51.396488 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:14:51.396488 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:14:51.397480 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:51.397480 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:51.397480 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:51.397480 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:51.397480 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:51.397480 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:51.397480 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:51.397480 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:51.397480 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:51.397480 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:51.397480 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:51.397480 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:51.397480 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:51.397480 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:51.397480 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:51.397480 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:51.397480 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:14:51.398951 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:14:51.398951 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:51.398951 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:51.398951 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 415/808] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:14:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:51.398951 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b50ae6-fa8b-4dc5-b082-587837fa8704 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:51.453019 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995515f-f717-41ff-98fa-f1727a08afbd None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:51.488926 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39821ca6-c5e3-4dd9-bfff-749fda5826f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:51.489908 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39821ca6-c5e3-4dd9-bfff-749fda5826f7 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:51.490363 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39821ca6-c5e3-4dd9-bfff-749fda5826f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:51.490818 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39821ca6-c5e3-4dd9-bfff-749fda5826f7 None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:51.491449 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39821ca6-c5e3-4dd9-bfff-749fda5826f7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:51.491749 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39821ca6-c5e3-4dd9-bfff-749fda5826f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:51.493579 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39821ca6-c5e3-4dd9-bfff-749fda5826f7 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:51.497923 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:51.502600 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 394/809] 10.222.0.36 () {56 vars in 1124 bytes} [Mon Aug 29 22:14:51 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:51.502600 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39821ca6-c5e3-4dd9-bfff-749fda5826f7 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:51.514624 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b50ae6-fa8b-4dc5-b082-587837fa8704 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:51.552190 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d3429a-9f61-4cd3-a05e-4ce88bd1abc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:51.552918 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3429a-9f61-4cd3-a05e-4ce88bd1abc3 None admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:51.553195 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3429a-9f61-4cd3-a05e-4ce88bd1abc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:51.553456 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3429a-9f61-4cd3-a05e-4ce88bd1abc3 None admin] PATH_INFO: `/v3/projects/696ed25cc0cb43fab4bfaf762a90da54/users/5f3472d8ffa748d8828c6a2d89ee7ac7/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:51.555440 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d3429a-9f61-4cd3-a05e-4ce88bd1abc3 None admin] RBAC: Authorizing `identity:create_grant(project_id=696ed25cc0cb43fab4bfaf762a90da54, user_id=5f3472d8ffa748d8828c6a2d89ee7ac7, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:51.557390 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d3429a-9f61-4cd3-a05e-4ce88bd1abc3 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:51.574004 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 416/810] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Aug 29 22:14:51 2022] PUT /identity/v3/projects/696ed25cc0cb43fab4bfaf762a90da54/users/5f3472d8ffa748d8828c6a2d89ee7ac7/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:14:51.575401 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d3429a-9f61-4cd3-a05e-4ce88bd1abc3 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:51.611279 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:51.617757 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39821ca6-c5e3-4dd9-bfff-749fda5826f7 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:51.657934 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415300eb-e186-456b-9b02-62cce47ed2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:51.658775 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415300eb-e186-456b-9b02-62cce47ed2da None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:51.658979 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415300eb-e186-456b-9b02-62cce47ed2da None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:51.659247 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415300eb-e186-456b-9b02-62cce47ed2da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:51.672142 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415300eb-e186-456b-9b02-62cce47ed2da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:51.673663 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415300eb-e186-456b-9b02-62cce47ed2da None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:51.690046 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-415300eb-e186-456b-9b02-62cce47ed2da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:51.690046 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:51.690046 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:51.690046 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:51.690046 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:51.690046 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:51.690046 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:51.690046 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:51.690046 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:51.690046 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:51.690046 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:51.690046 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:51.690046 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:14:51.690046 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:14:51.690046 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:14:51.690046 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:14:51.691101 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:51.691101 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:51.691101 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:51.691101 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:51.691101 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:51.691101 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:51.691101 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:51.691101 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:51.691101 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:51.691101 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:51.691101 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:51.691101 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:51.691101 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:51.691101 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:51.691101 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:51.691101 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:51.691101 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:14:51.692022 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:14:51.692022 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:51.692022 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:51.692022 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 395/811] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:14:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:51.692261 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415300eb-e186-456b-9b02-62cce47ed2da None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:51.734374 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d3429a-9f61-4cd3-a05e-4ce88bd1abc3 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:51.779540 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c259907d-019d-414d-ad8e-b2ea72bcabfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:51.780076 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c259907d-019d-414d-ad8e-b2ea72bcabfc None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:51.780350 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c259907d-019d-414d-ad8e-b2ea72bcabfc None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:51.780667 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c259907d-019d-414d-ad8e-b2ea72bcabfc None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:51.781319 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c259907d-019d-414d-ad8e-b2ea72bcabfc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:51.781641 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c259907d-019d-414d-ad8e-b2ea72bcabfc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:51.783022 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c259907d-019d-414d-ad8e-b2ea72bcabfc None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:51.796649 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 417/812] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:14:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:51.797533 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c259907d-019d-414d-ad8e-b2ea72bcabfc None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:51.814124 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:51.822312 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415300eb-e186-456b-9b02-62cce47ed2da None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:51.863206 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90902d86-f092-48f3-8e74-73e1028935ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:51.863825 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90902d86-f092-48f3-8e74-73e1028935ba None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:51.864112 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90902d86-f092-48f3-8e74-73e1028935ba None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:51.864383 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90902d86-f092-48f3-8e74-73e1028935ba None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:51.865078 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90902d86-f092-48f3-8e74-73e1028935ba None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:51.865378 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90902d86-f092-48f3-8e74-73e1028935ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:51.866805 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90902d86-f092-48f3-8e74-73e1028935ba None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:51.876813 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 396/813] 10.222.0.36 () {56 vars in 1124 bytes} [Mon Aug 29 22:14:51 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:51.878054 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4cb35-1e14-4ef8-ab6b-db63d9eeb2df None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:51.878343 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4cb35-1e14-4ef8-ab6b-db63d9eeb2df None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:51.878616 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4cb35-1e14-4ef8-ab6b-db63d9eeb2df None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:51.879988 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 397/814] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:14:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:14:51.880786 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f4cb35-1e14-4ef8-ab6b-db63d9eeb2df None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:51.904054 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:51.919708 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c259907d-019d-414d-ad8e-b2ea72bcabfc None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:51.963058 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370ca59-f152-4618-bd57-bf050452df76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:51.963675 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370ca59-f152-4618-bd57-bf050452df76 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:51.963951 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370ca59-f152-4618-bd57-bf050452df76 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:51.964221 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370ca59-f152-4618-bd57-bf050452df76 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:51.964923 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370ca59-f152-4618-bd57-bf050452df76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:51.965227 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370ca59-f152-4618-bd57-bf050452df76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:51.967041 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370ca59-f152-4618-bd57-bf050452df76 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:51.983957 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 418/815] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:14:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:51.983957 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370ca59-f152-4618-bd57-bf050452df76 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:51.997052 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f4cb35-1e14-4ef8-ab6b-db63d9eeb2df None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:52.036922 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09fc01-8bd7-41d9-9ec9-24ceeb636416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:52.037564 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09fc01-8bd7-41d9-9ec9-24ceeb636416 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:52.037841 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09fc01-8bd7-41d9-9ec9-24ceeb636416 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:52.038116 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09fc01-8bd7-41d9-9ec9-24ceeb636416 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:52.046454 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b09fc01-8bd7-41d9-9ec9-24ceeb636416 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:52.047936 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b09fc01-8bd7-41d9-9ec9-24ceeb636416 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:52.056535 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:52.059723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-8b09fc01-8bd7-41d9-9ec9-24ceeb636416 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:14:52.059723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:52.059723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:52.059723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:52.059723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:52.059723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:52.059723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:52.059723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:52.059723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:52.059723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:52.059723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:52.059723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:52.059723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:14:52.059723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:14:52.059723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:14:52.059723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:14:52.062763 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:52.062763 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:52.062763 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:14:52.062763 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:14:52.062763 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:14:52.062763 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:14:52.062763 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:52.062763 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:52.062763 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:52.062763 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:52.062763 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:52.062763 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:52.062763 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:52.062763 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:52.062763 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:52.062763 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:52.062763 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:52.062763 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:52.063731 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:52.063731 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:52.063731 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:14:52.063731 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:14:52.063731 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:14:52.063731 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:14:52.063731 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:14:52.063731 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:14:52.063731 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:14:52.063731 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:52.065767 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 398/816] 10.222.0.36 () {56 vars in 1093 bytes} [Mon Aug 29 22:14:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:52.067188 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be929b27-22c7-41ad-afac-70d58ff69d67 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:52.067479 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be929b27-22c7-41ad-afac-70d58ff69d67 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:52.068017 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be929b27-22c7-41ad-afac-70d58ff69d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:52.086112 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-be929b27-22c7-41ad-afac-70d58ff69d67 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:14:52.087262 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-be929b27-22c7-41ad-afac-70d58ff69d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:14:52.093430 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370ca59-f152-4618-bd57-bf050452df76 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:52.129283 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240a7394-2e47-4f5a-837c-a1b59b2eed49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:52.129909 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a7394-2e47-4f5a-837c-a1b59b2eed49 None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:52.130189 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a7394-2e47-4f5a-837c-a1b59b2eed49 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:52.130444 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a7394-2e47-4f5a-837c-a1b59b2eed49 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:52.131216 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240a7394-2e47-4f5a-837c-a1b59b2eed49 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:52.132994 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240a7394-2e47-4f5a-837c-a1b59b2eed49 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:52.156931 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 419/817] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:14:51 2022] POST /identity/v3/endpoints => generated 346 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:14:52.157367 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 399/818] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:14:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:14:52.167293 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be929b27-22c7-41ad-afac-70d58ff69d67 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:52.168061 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240a7394-2e47-4f5a-837c-a1b59b2eed49 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:52.176347 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:52.357475 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240a7394-2e47-4f5a-837c-a1b59b2eed49 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:52.384338 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:52.387187 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be929b27-22c7-41ad-afac-70d58ff69d67 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:52.399977 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61099efe-f9ea-451e-b085-629cd9b70619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:52.402154 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61099efe-f9ea-451e-b085-629cd9b70619 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:52.402426 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61099efe-f9ea-451e-b085-629cd9b70619 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:52.402768 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61099efe-f9ea-451e-b085-629cd9b70619 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:52.413193 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61099efe-f9ea-451e-b085-629cd9b70619 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:52.415048 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61099efe-f9ea-451e-b085-629cd9b70619 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:52.427851 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-61099efe-f9ea-451e-b085-629cd9b70619 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:14:52.427851 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:52.427851 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:52.427851 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:52.427851 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:52.427851 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:52.427851 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:52.427851 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:52.427851 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:52.427851 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:52.427851 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:52.427851 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:52.427851 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:14:52.427851 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:14:52.427851 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:14:52.428952 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:14:52.428952 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:52.428952 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:52.428952 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:52.428952 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:52.428952 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:52.428952 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:52.428952 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:52.428952 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:52.428952 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:52.428952 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:52.428952 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:52.428952 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:52.428952 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:52.428952 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:52.428952 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:52.428952 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:52.430674 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:14:52.430674 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:14:52.430674 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:14:52.430674 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:14:52.430674 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:14:52.430674 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:14:52.430674 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:14:52.430674 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:52.430674 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 420/819] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Aug 29 22:14:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:52.432054 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d0a3e-c957-45c0-8264-9a94b7efaec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:52.432904 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d0a3e-c957-45c0-8264-9a94b7efaec7 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:52.433360 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d0a3e-c957-45c0-8264-9a94b7efaec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:52.433813 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d0a3e-c957-45c0-8264-9a94b7efaec7 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:52.434732 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d0a3e-c957-45c0-8264-9a94b7efaec7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:52.435291 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d0a3e-c957-45c0-8264-9a94b7efaec7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:52.435709 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61099efe-f9ea-451e-b085-629cd9b70619 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:52.437221 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d0a3e-c957-45c0-8264-9a94b7efaec7 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:52.461830 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 400/820] 10.222.0.36 () {56 vars in 1133 bytes} [Mon Aug 29 22:14:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:52.462537 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d0a3e-c957-45c0-8264-9a94b7efaec7 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:52.541023 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:52.564768 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61099efe-f9ea-451e-b085-629cd9b70619 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:52.589691 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d0a3e-c957-45c0-8264-9a94b7efaec7 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:52.606603 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836537d-7675-4a6e-88e7-25ed0dc4332c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:52.607220 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836537d-7675-4a6e-88e7-25ed0dc4332c None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:52.607554 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836537d-7675-4a6e-88e7-25ed0dc4332c None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:52.607807 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836537d-7675-4a6e-88e7-25ed0dc4332c None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:52.608605 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0836537d-7675-4a6e-88e7-25ed0dc4332c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:52.608912 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0836537d-7675-4a6e-88e7-25ed0dc4332c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:52.610351 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0836537d-7675-4a6e-88e7-25ed0dc4332c None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:52.623834 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 421/821] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Aug 29 22:14:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:14:52.624714 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836537d-7675-4a6e-88e7-25ed0dc4332c None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:52.640362 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02fcbc-5400-4348-9401-5eb85a0f8d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:52.641307 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02fcbc-5400-4348-9401-5eb85a0f8d3c None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:52.641595 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02fcbc-5400-4348-9401-5eb85a0f8d3c None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:52.641865 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02fcbc-5400-4348-9401-5eb85a0f8d3c None admin] PATH_INFO: `/v3/services/network` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:52.642715 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d02fcbc-5400-4348-9401-5eb85a0f8d3c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:52.644868 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d02fcbc-5400-4348-9401-5eb85a0f8d3c None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:52.657485 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-7d02fcbc-5400-4348-9401-5eb85a0f8d3c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 22:14:52.657485 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:52.657485 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:14:52.657485 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:14:52.657485 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:14:52.657485 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:14:52.657485 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:14:52.657485 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:14:52.657485 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 22:14:52.657485 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:52.657485 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:14:52.657485 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:52.657485 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:52.657485 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:52.657485 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:52.657485 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:52.657485 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:52.658869 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:52.658869 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:52.658869 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:52.658869 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:52.658869 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:52.658869 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:52.658869 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:14:52.658869 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:14:52.658869 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:14:52.658869 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:14:52.658869 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:52.658869 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:52.658869 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:52.658869 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:52.658869 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:52.658869 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:52.659719 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:52.659719 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:52.659719 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:52.659719 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:52.659719 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:52.659719 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:52.659719 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:52.659719 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:52.659719 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:52.659719 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:52.659719 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:14:52.659719 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:14:52.659719 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 22:14:52.659719 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:52.659719 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 401/822] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Aug 29 22:14:52 2022] GET /identity/v3/services/network => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:52.660537 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02fcbc-5400-4348-9401-5eb85a0f8d3c None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:52.678798 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:52.744257 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836537d-7675-4a6e-88e7-25ed0dc4332c None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:52.796733 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d5e89-3da8-409d-a2c2-a838415f9de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:52.797613 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d5e89-3da8-409d-a2c2-a838415f9de7 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:52.798061 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d5e89-3da8-409d-a2c2-a838415f9de7 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:52.798176 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02fcbc-5400-4348-9401-5eb85a0f8d3c None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:52.798592 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d5e89-3da8-409d-a2c2-a838415f9de7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:52.827777 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:52.837756 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52c5462-eb6f-4041-9280-ac71b0cc96e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:52.838507 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c5462-eb6f-4041-9280-ac71b0cc96e8 None admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:52.838697 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c5462-eb6f-4041-9280-ac71b0cc96e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:52.838971 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c5462-eb6f-4041-9280-ac71b0cc96e8 None admin] PATH_INFO: `/v3/projects/696ed25cc0cb43fab4bfaf762a90da54/users/b32922d090564162810dd8b28c3a322b/roles/bc7b902c0870483ba03c139d941f78ac` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:52.861079 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52c5462-eb6f-4041-9280-ac71b0cc96e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=696ed25cc0cb43fab4bfaf762a90da54, user_id=b32922d090564162810dd8b28c3a322b, role_id=bc7b902c0870483ba03c139d941f78ac)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:52.862471 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52c5462-eb6f-4041-9280-ac71b0cc96e8 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:52.884523 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 402/823] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Aug 29 22:14:52 2022] PUT /identity/v3/projects/696ed25cc0cb43fab4bfaf762a90da54/users/b32922d090564162810dd8b28c3a322b/roles/bc7b902c0870483ba03c139d941f78ac => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:14:52.884523 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52c5462-eb6f-4041-9280-ac71b0cc96e8 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:52.896525 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d5e89-3da8-409d-a2c2-a838415f9de7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:52.900320 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d5e89-3da8-409d-a2c2-a838415f9de7 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:52.983884 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:53.045160 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 422/824] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:14:52 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:14:53.052508 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d5e89-3da8-409d-a2c2-a838415f9de7 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:53.061533 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52c5462-eb6f-4041-9280-ac71b0cc96e8 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:53.126257 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7091c-b502-4943-b122-e4b48010f652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:53.126800 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7091c-b502-4943-b122-e4b48010f652 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:53.127075 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7091c-b502-4943-b122-e4b48010f652 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:53.127343 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7091c-b502-4943-b122-e4b48010f652 None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:53.127980 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea7091c-b502-4943-b122-e4b48010f652 None admin] RBAC: Adding query filter params (name=network) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:53.128277 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea7091c-b502-4943-b122-e4b48010f652 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:53.129695 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea7091c-b502-4943-b122-e4b48010f652 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:53.139132 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 403/825] 10.222.0.36 () {56 vars in 1112 bytes} [Mon Aug 29 22:14:52 2022] GET /identity/v3/services?name=network => generated 124 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:53.145119 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7091c-b502-4943-b122-e4b48010f652 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:53.174729 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d5e89-3da8-409d-a2c2-a838415f9de7 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:53.207101 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:53.217418 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e926eb-0cbb-4743-97ee-47a1c4c03d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:53.218630 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e926eb-0cbb-4743-97ee-47a1c4c03d52 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:53.219173 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e926eb-0cbb-4743-97ee-47a1c4c03d52 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:53.219445 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e926eb-0cbb-4743-97ee-47a1c4c03d52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:53.230881 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e926eb-0cbb-4743-97ee-47a1c4c03d52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:53.232361 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e926eb-0cbb-4743-97ee-47a1c4c03d52 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:53.234337 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:53.249893 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-26e926eb-0cbb-4743-97ee-47a1c4c03d52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:53.249893 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:53.249893 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:53.249893 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:53.249893 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:53.249893 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:53.249893 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:53.249893 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:53.249893 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:53.249893 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:53.249893 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:53.249893 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:53.249893 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:14:53.249893 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:14:53.249893 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:14:53.249893 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:14:53.250925 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:53.250925 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:53.250925 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:53.250925 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:53.250925 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:53.250925 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:53.250925 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:53.250925 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:53.250925 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:53.250925 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:53.250925 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:53.250925 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:53.250925 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:53.250925 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:53.250925 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:53.250925 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:53.250925 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:14:53.251806 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:14:53.251806 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:53.251806 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:53.251806 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 423/826] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:14:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:53.257744 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e926eb-0cbb-4743-97ee-47a1c4c03d52 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:53.313978 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7091c-b502-4943-b122-e4b48010f652 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:53.380262 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c515f-0a4f-4573-9a20-3c498c7beb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:53.380835 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c515f-0a4f-4573-9a20-3c498c7beb32 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:53.381110 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c515f-0a4f-4573-9a20-3c498c7beb32 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:53.381378 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c515f-0a4f-4573-9a20-3c498c7beb32 None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:53.382016 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437c515f-0a4f-4573-9a20-3c498c7beb32 None admin] RBAC: Adding query filter params (type=network) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:53.382314 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437c515f-0a4f-4573-9a20-3c498c7beb32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:53.384181 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437c515f-0a4f-4573-9a20-3c498c7beb32 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:53.390319 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 404/827] 10.222.0.36 () {56 vars in 1112 bytes} [Mon Aug 29 22:14:53 2022] GET /identity/v3/services?type=network => generated 350 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:14:53.395630 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c515f-0a4f-4573-9a20-3c498c7beb32 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:53.451967 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e926eb-0cbb-4743-97ee-47a1c4c03d52 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:53.537266 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b8597-c236-4c13-bea2-b1ba8ca44820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:53.538298 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b8597-c236-4c13-bea2-b1ba8ca44820 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:53.538791 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b8597-c236-4c13-bea2-b1ba8ca44820 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:53.539308 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b8597-c236-4c13-bea2-b1ba8ca44820 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:53.540160 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391b8597-c236-4c13-bea2-b1ba8ca44820 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:53.540685 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391b8597-c236-4c13-bea2-b1ba8ca44820 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:53.542284 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391b8597-c236-4c13-bea2-b1ba8ca44820 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:53.565633 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 424/828] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:14:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:14:53.571365 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b8597-c236-4c13-bea2-b1ba8ca44820 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:53.603709 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c515f-0a4f-4573-9a20-3c498c7beb32 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:53.608161 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:53.664541 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6e9c6-ef2b-48d5-b9b2-6612cb2759dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:53.665251 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6e9c6-ef2b-48d5-b9b2-6612cb2759dd None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:53.665534 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6e9c6-ef2b-48d5-b9b2-6612cb2759dd None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:53.665804 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6e9c6-ef2b-48d5-b9b2-6612cb2759dd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:53.666485 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a6e9c6-ef2b-48d5-b9b2-6612cb2759dd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:53.667853 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a6e9c6-ef2b-48d5-b9b2-6612cb2759dd None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:53.690616 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:53.703609 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 405/829] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:14:53 2022] POST /identity/v3/endpoints => generated 337 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:14:53.739969 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199b0a4-b382-4b7e-8a64-31b98236ec2b None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:53.740259 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199b0a4-b382-4b7e-8a64-31b98236ec2b None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:53.740562 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199b0a4-b382-4b7e-8a64-31b98236ec2b None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:53.742102 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 406/830] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:14:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:14:53.748510 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512cb57-17cf-4177-96c6-da35fc12dcd1 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:53.748801 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512cb57-17cf-4177-96c6-da35fc12dcd1 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:53.749074 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512cb57-17cf-4177-96c6-da35fc12dcd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:53.752132 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b8597-c236-4c13-bea2-b1ba8ca44820 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:53.790143 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-2512cb57-17cf-4177-96c6-da35fc12dcd1 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:14:53.791378 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-2512cb57-17cf-4177-96c6-da35fc12dcd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:14:53.806198 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d4b49c-78ec-4148-a338-9a9f3f454c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:53.807956 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4b49c-78ec-4148-a338-9a9f3f454c64 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:53.808724 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4b49c-78ec-4148-a338-9a9f3f454c64 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:53.809561 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4b49c-78ec-4148-a338-9a9f3f454c64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:53.822027 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d4b49c-78ec-4148-a338-9a9f3f454c64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:53.825158 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d4b49c-78ec-4148-a338-9a9f3f454c64 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:53.840093 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-31d4b49c-78ec-4148-a338-9a9f3f454c64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:14:53.840093 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:53.840093 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:53.840093 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:53.840093 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:53.840093 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:53.840093 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:53.840093 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:53.840093 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:53.840093 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:53.840093 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:53.840093 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:53.840093 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:14:53.840093 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:14:53.840093 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:14:53.841136 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:14:53.841136 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:53.841136 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:53.841136 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:53.841136 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:53.841136 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:53.841136 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:53.841136 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:53.841136 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:53.841136 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:53.841136 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:53.841136 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:53.841136 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:53.841136 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:53.841136 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:53.841136 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:53.841136 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:53.842086 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:14:53.842086 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:14:53.842086 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:14:53.842086 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:14:53.842086 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:14:53.842086 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:14:53.842086 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:14:53.842086 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:53.844656 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 425/831] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Aug 29 22:14:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:53.850160 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d4b49c-78ec-4148-a338-9a9f3f454c64 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:53.944209 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 407/832] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:14:53 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:14:53.996007 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d4b49c-78ec-4148-a338-9a9f3f454c64 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:54.007125 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:54.034703 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b25fd-d6e1-4b02-8317-ea643931b787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:54.035327 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b25fd-d6e1-4b02-8317-ea643931b787 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:54.035607 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b25fd-d6e1-4b02-8317-ea643931b787 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:54.035883 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b25fd-d6e1-4b02-8317-ea643931b787 None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:54.036676 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9b25fd-d6e1-4b02-8317-ea643931b787 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:54.036985 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9b25fd-d6e1-4b02-8317-ea643931b787 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:54.038493 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9b25fd-d6e1-4b02-8317-ea643931b787 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:54.052169 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 426/833] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Aug 29 22:14:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:54.058108 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2512cb57-17cf-4177-96c6-da35fc12dcd1 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:54.175758 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:54.187283 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2512cb57-17cf-4177-96c6-da35fc12dcd1 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:54.227765 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e02a28-2809-4039-adaa-4de82b765a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:54.228097 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e02a28-2809-4039-adaa-4de82b765a24 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:54.228357 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e02a28-2809-4039-adaa-4de82b765a24 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:54.228701 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e02a28-2809-4039-adaa-4de82b765a24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:54.229457 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e02a28-2809-4039-adaa-4de82b765a24 None admin] RBAC: Adding query filter params (role.id=ff59a239a50b4bd899a83bf3c3fd1f63, scope.project.id=696ed25cc0cb43fab4bfaf762a90da54, user.id=90b7213b7111456a93e294ce40b95b21) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:54.229770 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e02a28-2809-4039-adaa-4de82b765a24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:54.231306 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e02a28-2809-4039-adaa-4de82b765a24 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:54.238318 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 408/834] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Aug 29 22:14:54 2022] GET /identity/v3/role_assignments?user.id=90b7213b7111456a93e294ce40b95b21&scope.project.id=696ed25cc0cb43fab4bfaf762a90da54&role.id=ff59a239a50b4bd899a83bf3c3fd1f63 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:54.265260 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b25fd-d6e1-4b02-8317-ea643931b787 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:54.401585 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b25fd-d6e1-4b02-8317-ea643931b787 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:54.440124 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117d20d9-e75e-4a59-81a7-68f5c8dd6eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:54.441185 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d20d9-e75e-4a59-81a7-68f5c8dd6eff None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:54.441677 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d20d9-e75e-4a59-81a7-68f5c8dd6eff None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:54.441953 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d20d9-e75e-4a59-81a7-68f5c8dd6eff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:54.453543 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117d20d9-e75e-4a59-81a7-68f5c8dd6eff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:14:54.458460 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-117d20d9-e75e-4a59-81a7-68f5c8dd6eff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:14:54.458460 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:54.458460 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:54.458460 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:54.458460 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:54.458460 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:54.458460 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:54.458460 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:54.458460 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:54.458460 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:54.458460 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:54.458460 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:54.458460 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:14:54.458460 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:14:54.458460 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:14:54.458460 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:14:54.459386 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:14:54.459386 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:14:54.459386 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:14:54.459386 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:14:54.459386 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:54.459386 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:54.459386 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:54.459386 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:54.459386 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:54.459386 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:54.459386 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:54.459386 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:54.459386 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:54.459386 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:54.459386 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:54.459386 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:54.460382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:54.460382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:54.460382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:54.460382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:54.460382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:14:54.460382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:14:54.460382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:14:54.460382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:14:54.460382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:14:54.460382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:14:54.460382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:14:54.460382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:54.460382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 427/835] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Aug 29 22:14:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:54.473835 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e02a28-2809-4039-adaa-4de82b765a24 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:54.516562 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d9431-5df3-4665-ae6a-41b32094acc8 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:54.516562 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d9431-5df3-4665-ae6a-41b32094acc8 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:54.516562 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d9431-5df3-4665-ae6a-41b32094acc8 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:54.517854 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 428/836] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:14:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:14:54.523368 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad895cd8-7828-45ed-a79d-f4f82e105bf4 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:54.523939 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad895cd8-7828-45ed-a79d-f4f82e105bf4 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:54.524382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad895cd8-7828-45ed-a79d-f4f82e105bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:54.542561 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-ad895cd8-7828-45ed-a79d-f4f82e105bf4 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:14:54.544026 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ad895cd8-7828-45ed-a79d-f4f82e105bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:14:54.576876 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:54.582704 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e02a28-2809-4039-adaa-4de82b765a24 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:54.619038 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79d114-876c-4a9f-b4f5-d3eacddb544e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:54.619638 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79d114-876c-4a9f-b4f5-d3eacddb544e None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:54.619832 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 429/837] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:14:54 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:14:54.619933 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79d114-876c-4a9f-b4f5-d3eacddb544e None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:54.620112 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79d114-876c-4a9f-b4f5-d3eacddb544e None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:54.628640 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b79d114-876c-4a9f-b4f5-d3eacddb544e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:54.628640 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b79d114-876c-4a9f-b4f5-d3eacddb544e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:54.628640 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b79d114-876c-4a9f-b4f5-d3eacddb544e None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:54.631518 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 409/838] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:14:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:54.637193 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad895cd8-7828-45ed-a79d-f4f82e105bf4 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:54.737385 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad895cd8-7828-45ed-a79d-f4f82e105bf4 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:54.775488 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22946d37-e47a-45df-ad67-7be291eb2299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:54.776112 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22946d37-e47a-45df-ad67-7be291eb2299 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:54.776334 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22946d37-e47a-45df-ad67-7be291eb2299 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:54.776628 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22946d37-e47a-45df-ad67-7be291eb2299 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:54.790657 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22946d37-e47a-45df-ad67-7be291eb2299 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:54.792907 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22946d37-e47a-45df-ad67-7be291eb2299 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:54.809961 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-22946d37-e47a-45df-ad67-7be291eb2299 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:54.809961 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:54.809961 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:54.809961 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:54.809961 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:54.809961 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:54.809961 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:54.809961 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:54.809961 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:54.809961 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:54.809961 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:54.809961 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:54.809961 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:14:54.809961 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:14:54.809961 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:14:54.809961 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:14:54.810960 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:54.810960 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:54.810960 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:54.810960 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:54.810960 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:54.810960 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:54.810960 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:54.810960 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:54.810960 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:54.810960 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:54.810960 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:54.810960 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:54.810960 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:54.810960 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:54.810960 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:54.810960 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:54.810960 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:14:54.812430 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:14:54.812430 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:54.812430 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:54.812430 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 430/839] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:14:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:54.817090 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79d114-876c-4a9f-b4f5-d3eacddb544e None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:54.844833 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:54.932846 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79d114-876c-4a9f-b4f5-d3eacddb544e None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:54.933492 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22946d37-e47a-45df-ad67-7be291eb2299 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:54.966462 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:54.968789 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a102a8d0-e089-44ad-b894-3cedc478c2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:54.969431 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102a8d0-e089-44ad-b894-3cedc478c2e2 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:54.969728 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102a8d0-e089-44ad-b894-3cedc478c2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:54.970004 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102a8d0-e089-44ad-b894-3cedc478c2e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:54.970693 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a102a8d0-e089-44ad-b894-3cedc478c2e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:54.971000 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a102a8d0-e089-44ad-b894-3cedc478c2e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:54.972527 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a102a8d0-e089-44ad-b894-3cedc478c2e2 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:54.986770 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 410/840] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:14:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:54.992257 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a102a8d0-e089-44ad-b894-3cedc478c2e2 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:55.048515 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22946d37-e47a-45df-ad67-7be291eb2299 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:55.076171 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:55.088751 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82abb78b-ea7d-4067-b229-5f7ae2cf5974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:55.089723 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82abb78b-ea7d-4067-b229-5f7ae2cf5974 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:55.090223 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82abb78b-ea7d-4067-b229-5f7ae2cf5974 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:55.090682 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82abb78b-ea7d-4067-b229-5f7ae2cf5974 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:55.091506 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82abb78b-ea7d-4067-b229-5f7ae2cf5974 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:55.093159 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82abb78b-ea7d-4067-b229-5f7ae2cf5974 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:55.100665 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a102a8d0-e089-44ad-b894-3cedc478c2e2 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:55.103686 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-82abb78b-ea7d-4067-b229-5f7ae2cf5974 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 22:14:55.103686 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:55.103686 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:14:55.103686 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:14:55.103686 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:14:55.103686 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:14:55.103686 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:14:55.103686 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:14:55.103686 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 22:14:55.103686 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:55.103686 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:14:55.103686 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:55.103686 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:55.103686 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:55.103686 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:55.103686 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:55.103686 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:55.104811 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:55.104811 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:55.104811 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:55.104811 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:55.104811 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:55.104811 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:55.104811 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:14:55.104811 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:14:55.104811 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:14:55.104811 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:14:55.104811 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:55.104811 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:55.104811 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:55.104811 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:55.104811 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:55.104811 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:55.105723 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:55.105723 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:55.105723 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:55.105723 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:55.105723 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:55.105723 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:55.105723 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:55.105723 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:55.105723 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:55.105723 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:55.105723 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:14:55.105723 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:14:55.105723 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 22:14:55.105723 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:55.113209 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 431/841] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Aug 29 22:14:54 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:14:55.114761 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82abb78b-ea7d-4067-b229-5f7ae2cf5974 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:55.136824 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9094627-c267-49eb-ba9a-a72a52a0865e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:55.137469 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9094627-c267-49eb-ba9a-a72a52a0865e None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:55.137751 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9094627-c267-49eb-ba9a-a72a52a0865e None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:55.138025 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9094627-c267-49eb-ba9a-a72a52a0865e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:55.146747 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9094627-c267-49eb-ba9a-a72a52a0865e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:55.148206 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9094627-c267-49eb-ba9a-a72a52a0865e None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:55.160219 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-e9094627-c267-49eb-ba9a-a72a52a0865e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 22:14:55.160219 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:55.160219 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:55.160219 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:55.160219 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:55.160219 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:55.160219 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:55.160219 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:55.160219 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:55.160219 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:55.160219 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:55.160219 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:55.160219 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:14:55.160219 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:14:55.160219 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:14:55.160219 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:14:55.161260 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:55.161260 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:55.161260 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:14:55.161260 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:14:55.161260 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:14:55.161260 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:14:55.161260 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:55.161260 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:55.161260 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:55.161260 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:55.161260 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:55.161260 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:55.161260 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:55.161260 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:55.161260 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:55.161260 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:55.161260 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:55.161260 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:55.162812 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:55.162812 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:55.162812 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:14:55.162812 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:14:55.162812 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:14:55.162812 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:14:55.162812 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:14:55.162812 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:14:55.162812 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 22:14:55.162812 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:55.166680 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 411/842] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Aug 29 22:14:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:14:55.167643 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9094627-c267-49eb-ba9a-a72a52a0865e None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:55.202565 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:55.228861 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82abb78b-ea7d-4067-b229-5f7ae2cf5974 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:55.265729 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6436f3e3-78d3-4c0b-88d3-61e94c79a052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:55.266346 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436f3e3-78d3-4c0b-88d3-61e94c79a052 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:55.266625 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436f3e3-78d3-4c0b-88d3-61e94c79a052 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:55.266918 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436f3e3-78d3-4c0b-88d3-61e94c79a052 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:55.267622 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6436f3e3-78d3-4c0b-88d3-61e94c79a052 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:55.268087 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6436f3e3-78d3-4c0b-88d3-61e94c79a052 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:55.269558 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6436f3e3-78d3-4c0b-88d3-61e94c79a052 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:55.271324 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9094627-c267-49eb-ba9a-a72a52a0865e None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:55.275060 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 432/843] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Aug 29 22:14:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:14:55.276408 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641a5d4-a2df-437c-8e41-f895a33be4fb None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:55.276775 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641a5d4-a2df-437c-8e41-f895a33be4fb None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:55.277113 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641a5d4-a2df-437c-8e41-f895a33be4fb None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:55.278412 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 433/844] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:14:55.281513 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e641a5d4-a2df-437c-8e41-f895a33be4fb None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:55.310878 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ebe00-c8ef-46d2-863e-7505d166bce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:55.311420 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ebe00-c8ef-46d2-863e-7505d166bce4 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:55.311703 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ebe00-c8ef-46d2-863e-7505d166bce4 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:55.311967 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ebe00-c8ef-46d2-863e-7505d166bce4 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:55.312738 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21ebe00-c8ef-46d2-863e-7505d166bce4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:55.313042 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21ebe00-c8ef-46d2-863e-7505d166bce4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:55.314479 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21ebe00-c8ef-46d2-863e-7505d166bce4 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:55.317971 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:55.340432 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 412/845] 10.222.0.36 () {56 vars in 1135 bytes} [Mon Aug 29 22:14:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:55.340432 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6117d86-8c28-49ed-b699-89044776251c None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:55.340432 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6117d86-8c28-49ed-b699-89044776251c None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:55.340432 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6117d86-8c28-49ed-b699-89044776251c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:55.357690 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-e6117d86-8c28-49ed-b699-89044776251c None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:14:55.358884 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e6117d86-8c28-49ed-b699-89044776251c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:14:55.399471 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e641a5d4-a2df-437c-8e41-f895a33be4fb None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:55.435939 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c543a8-0b39-4aa3-87c8-230aeea567dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:55.436756 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c543a8-0b39-4aa3-87c8-230aeea567dd None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:55.437146 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c543a8-0b39-4aa3-87c8-230aeea567dd None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:55.437543 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c543a8-0b39-4aa3-87c8-230aeea567dd None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:55.438261 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c543a8-0b39-4aa3-87c8-230aeea567dd None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:55.438666 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c543a8-0b39-4aa3-87c8-230aeea567dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:55.440124 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c543a8-0b39-4aa3-87c8-230aeea567dd None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:55.440786 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 413/846] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:14:55 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:14:55.441856 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6117d86-8c28-49ed-b699-89044776251c None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:55.446804 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 434/847] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Aug 29 22:14:55 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:55.568576 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6117d86-8c28-49ed-b699-89044776251c None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:55.592652 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:55.608887 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c69707b-c0d1-4466-9f74-aaab14b13903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:55.609759 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c69707b-c0d1-4466-9f74-aaab14b13903 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:55.610193 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c69707b-c0d1-4466-9f74-aaab14b13903 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:55.610615 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c69707b-c0d1-4466-9f74-aaab14b13903 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:55.678868 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c69707b-c0d1-4466-9f74-aaab14b13903 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:55.680760 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c69707b-c0d1-4466-9f74-aaab14b13903 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:55.701171 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c543a8-0b39-4aa3-87c8-230aeea567dd None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:55.709354 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:55.789807 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 414/848] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:14:55 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:14:55.796138 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c69707b-c0d1-4466-9f74-aaab14b13903 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:55.828974 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:55.839806 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c543a8-0b39-4aa3-87c8-230aeea567dd None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:55.881951 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be303f55-7d6c-4bd9-8f4c-d1fd3b6d464d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:55.883406 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be303f55-7d6c-4bd9-8f4c-d1fd3b6d464d None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:55.883842 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be303f55-7d6c-4bd9-8f4c-d1fd3b6d464d None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:55.884354 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be303f55-7d6c-4bd9-8f4c-d1fd3b6d464d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:55.900077 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be303f55-7d6c-4bd9-8f4c-d1fd3b6d464d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:14:55.906889 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-be303f55-7d6c-4bd9-8f4c-d1fd3b6d464d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:14:55.906889 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:55.906889 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:55.906889 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:55.906889 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:55.906889 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:55.906889 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:55.906889 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:55.906889 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:55.906889 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:55.906889 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:55.906889 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:55.906889 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:14:55.906889 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:14:55.906889 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:14:55.906889 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:14:55.908084 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:14:55.908084 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:14:55.908084 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:14:55.908084 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:14:55.908084 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:55.908084 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:55.908084 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:55.908084 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:55.908084 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:55.908084 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:55.908084 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:55.908084 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:55.908084 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:55.908084 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:55.908084 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:55.908084 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:55.909109 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:55.909109 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:55.909109 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:55.909109 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:55.909109 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:14:55.909109 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:14:55.909109 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:14:55.909109 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:14:55.909109 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:14:55.909109 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:14:55.909109 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:14:55.909109 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:55.916030 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 435/849] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Aug 29 22:14:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:14:55.917147 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be303f55-7d6c-4bd9-8f4c-d1fd3b6d464d None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:55.918242 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c69707b-c0d1-4466-9f74-aaab14b13903 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:55.956011 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9bff20-3b1c-4613-b3b5-efb70f0d5142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:55.956011 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9bff20-3b1c-4613-b3b5-efb70f0d5142 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:55.956365 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9bff20-3b1c-4613-b3b5-efb70f0d5142 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:55.956642 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9bff20-3b1c-4613-b3b5-efb70f0d5142 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:55.967887 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9bff20-3b1c-4613-b3b5-efb70f0d5142 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:55.969656 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9bff20-3b1c-4613-b3b5-efb70f0d5142 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:55.985510 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-2b9bff20-3b1c-4613-b3b5-efb70f0d5142 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:55.985510 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:55.985510 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:55.985510 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:55.985510 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:55.985510 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:55.985510 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:55.985510 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:55.985510 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:55.985510 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:55.985510 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:55.985510 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:55.985510 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:14:55.985510 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:14:55.985510 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:14:55.985510 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:14:55.986761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:55.986761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:55.986761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:55.986761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:55.986761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:55.986761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:55.986761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:55.986761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:55.986761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:55.986761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:55.986761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:55.986761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:55.986761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:55.986761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:55.986761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:55.986761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:55.986761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:14:55.987878 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:14:55.987878 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:55.987878 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:55.987878 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 415/850] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:14:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:14:55.989126 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:55.994591 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9bff20-3b1c-4613-b3b5-efb70f0d5142 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:56.032712 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be303f55-7d6c-4bd9-8f4c-d1fd3b6d464d None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:56.069161 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b370d30-c202-4a1d-94f3-58fc01764b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:56.070141 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b370d30-c202-4a1d-94f3-58fc01764b2a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:56.070680 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b370d30-c202-4a1d-94f3-58fc01764b2a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:56.071154 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b370d30-c202-4a1d-94f3-58fc01764b2a None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:56.072087 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b370d30-c202-4a1d-94f3-58fc01764b2a None admin] RBAC: Adding query filter params (name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:56.072634 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b370d30-c202-4a1d-94f3-58fc01764b2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:56.074289 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b370d30-c202-4a1d-94f3-58fc01764b2a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:56.078307 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:56.091502 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 436/851] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Aug 29 22:14:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:56.092787 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b370d30-c202-4a1d-94f3-58fc01764b2a None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:56.103534 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9bff20-3b1c-4613-b3b5-efb70f0d5142 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:56.140016 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d1aae-e572-4e7c-b51f-394956e7d9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:56.140691 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d1aae-e572-4e7c-b51f-394956e7d9ee None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:56.140974 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d1aae-e572-4e7c-b51f-394956e7d9ee None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:56.141248 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d1aae-e572-4e7c-b51f-394956e7d9ee None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:56.141900 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99d1aae-e572-4e7c-b51f-394956e7d9ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:56.142259 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99d1aae-e572-4e7c-b51f-394956e7d9ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:56.143695 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99d1aae-e572-4e7c-b51f-394956e7d9ee None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:56.160646 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 416/852] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:14:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:56.162622 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d1aae-e572-4e7c-b51f-394956e7d9ee None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:56.202711 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b370d30-c202-4a1d-94f3-58fc01764b2a None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:56.230552 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:56.241478 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee4c79-37c2-4adf-b025-4bc7af6ac0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:56.242534 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee4c79-37c2-4adf-b025-4bc7af6ac0e6 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:56.243209 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee4c79-37c2-4adf-b025-4bc7af6ac0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:56.243677 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee4c79-37c2-4adf-b025-4bc7af6ac0e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:56.255315 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bee4c79-37c2-4adf-b025-4bc7af6ac0e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:56.257213 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bee4c79-37c2-4adf-b025-4bc7af6ac0e6 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:56.267438 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d1aae-e572-4e7c-b51f-394956e7d9ee None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:56.275217 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-0bee4c79-37c2-4adf-b025-4bc7af6ac0e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:56.275217 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:56.275217 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:56.275217 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:56.275217 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:56.275217 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:56.275217 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:56.275217 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:56.275217 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:56.275217 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:56.275217 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:56.275217 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:56.275217 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:14:56.275217 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:14:56.275217 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:14:56.275217 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:14:56.276230 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:56.276230 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:56.276230 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:56.276230 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:56.276230 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:56.276230 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:56.276230 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:56.276230 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:56.276230 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:56.276230 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:56.276230 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:56.276230 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:56.276230 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:56.276230 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:56.276230 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:56.276230 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:56.276230 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:14:56.277174 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:14:56.277174 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:56.277174 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:56.283916 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 437/853] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:14:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:56.285216 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee4c79-37c2-4adf-b025-4bc7af6ac0e6 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:56.304137 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8c4d0-c06e-4058-b590-17cb7003ceee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:56.304866 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8c4d0-c06e-4058-b590-17cb7003ceee None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:56.305237 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8c4d0-c06e-4058-b590-17cb7003ceee None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:56.305686 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8c4d0-c06e-4058-b590-17cb7003ceee None admin] PATH_INFO: `/v3/projects/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:56.308645 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:56.313663 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b8c4d0-c06e-4058-b590-17cb7003ceee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:56.315812 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b8c4d0-c06e-4058-b590-17cb7003ceee None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:56.327981 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-d6b8c4d0-c06e-4058-b590-17cb7003ceee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:14:56.327981 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:56.327981 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:56.327981 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:56.327981 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:56.327981 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:56.327981 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:56.327981 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:56.327981 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:56.327981 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:56.327981 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:56.327981 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:56.327981 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:14:56.327981 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:14:56.327981 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:14:56.329069 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:14:56.329069 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:56.329069 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:56.329069 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:56.329069 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:56.329069 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:56.329069 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:56.329069 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:56.329069 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:56.329069 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:56.329069 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:56.329069 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:56.329069 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:56.329069 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:56.329069 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:56.329069 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:56.329069 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:56.329975 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:14:56.329975 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:14:56.329975 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:14:56.329975 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:14:56.329975 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:14:56.329975 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:14:56.329975 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:14:56.329975 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:56.333375 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 417/854] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Aug 29 22:14:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:56.334511 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92915d8-88ba-420e-bdb1-bdc4aa724245 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:56.334798 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92915d8-88ba-420e-bdb1-bdc4aa724245 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:56.335268 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92915d8-88ba-420e-bdb1-bdc4aa724245 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:56.336494 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 418/855] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:14:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:14:56.337383 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92915d8-88ba-420e-bdb1-bdc4aa724245 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:56.398797 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee4c79-37c2-4adf-b025-4bc7af6ac0e6 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:56.432505 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd89fbb-0131-4f0e-a18a-231a134a1046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:56.433357 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd89fbb-0131-4f0e-a18a-231a134a1046 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:56.433797 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd89fbb-0131-4f0e-a18a-231a134a1046 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:56.434073 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd89fbb-0131-4f0e-a18a-231a134a1046 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:56.434740 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd89fbb-0131-4f0e-a18a-231a134a1046 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:56.435040 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd89fbb-0131-4f0e-a18a-231a134a1046 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:56.436414 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd89fbb-0131-4f0e-a18a-231a134a1046 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:56.444105 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92915d8-88ba-420e-bdb1-bdc4aa724245 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:56.448229 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 438/856] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:14:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:56.449285 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07072f0-2382-480c-9758-330796d2c1e4 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:56.449568 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07072f0-2382-480c-9758-330796d2c1e4 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:56.449842 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07072f0-2382-480c-9758-330796d2c1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:56.467177 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-b07072f0-2382-480c-9758-330796d2c1e4 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:14:56.468364 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b07072f0-2382-480c-9758-330796d2c1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:14:56.487761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd12535-2a7a-428b-9a04-07d15d93457a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:56.488373 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd12535-2a7a-428b-9a04-07d15d93457a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:56.488675 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd12535-2a7a-428b-9a04-07d15d93457a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:56.488941 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd12535-2a7a-428b-9a04-07d15d93457a None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:56.489628 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd12535-2a7a-428b-9a04-07d15d93457a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:56.489927 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd12535-2a7a-428b-9a04-07d15d93457a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:56.491347 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd12535-2a7a-428b-9a04-07d15d93457a None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:56.499245 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:56.504703 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 419/857] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Aug 29 22:14:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:56.505524 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd12535-2a7a-428b-9a04-07d15d93457a None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:56.552735 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 439/858] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:14:56 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:14:56.554385 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07072f0-2382-480c-9758-330796d2c1e4 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:56.573614 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:56.625229 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd12535-2a7a-428b-9a04-07d15d93457a None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:56.662616 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d62919-9ce5-4ef0-b75e-f9ecf12bab8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:56.663173 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d62919-9ce5-4ef0-b75e-f9ecf12bab8e None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:56.663497 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d62919-9ce5-4ef0-b75e-f9ecf12bab8e None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:56.663766 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d62919-9ce5-4ef0-b75e-f9ecf12bab8e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:56.672330 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d62919-9ce5-4ef0-b75e-f9ecf12bab8e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:56.674142 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d62919-9ce5-4ef0-b75e-f9ecf12bab8e None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:56.686760 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-d5d62919-9ce5-4ef0-b75e-f9ecf12bab8e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 22:14:56.686760 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:56.686760 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:56.686760 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:56.686760 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:56.686760 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:56.686760 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:56.686760 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:56.686760 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:56.686760 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:56.686760 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:56.686760 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:56.686760 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:14:56.686760 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:14:56.686760 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:14:56.686760 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:14:56.687809 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:56.687809 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:56.687809 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:14:56.687809 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:14:56.687809 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:14:56.687809 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:14:56.687809 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:56.687809 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:56.687809 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:56.687809 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:56.687809 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:56.687809 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:56.687809 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:56.687809 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:56.687809 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:56.687809 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:56.687809 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:56.687809 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:56.688809 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:56.688809 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:56.688809 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:14:56.688809 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:14:56.688809 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:14:56.688809 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:14:56.688809 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:14:56.688809 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:14:56.688809 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 22:14:56.688809 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:56.692884 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 420/859] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Aug 29 22:14:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:56.693709 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d62919-9ce5-4ef0-b75e-f9ecf12bab8e None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:56.693971 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07072f0-2382-480c-9758-330796d2c1e4 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:56.739665 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b0d83b-ce8a-4189-8006-4d549d069ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:56.740705 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0d83b-ce8a-4189-8006-4d549d069ffa None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:56.741431 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0d83b-ce8a-4189-8006-4d549d069ffa None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:56.742424 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0d83b-ce8a-4189-8006-4d549d069ffa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:56.743627 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b0d83b-ce8a-4189-8006-4d549d069ffa None admin] RBAC: Adding query filter params (role.id=ff59a239a50b4bd899a83bf3c3fd1f63, scope.project.id=696ed25cc0cb43fab4bfaf762a90da54, user.id=5f3472d8ffa748d8828c6a2d89ee7ac7) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:56.744151 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b0d83b-ce8a-4189-8006-4d549d069ffa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:56.746009 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b0d83b-ce8a-4189-8006-4d549d069ffa None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:56.756634 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 440/860] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Aug 29 22:14:56 2022] GET /identity/v3/role_assignments?user.id=5f3472d8ffa748d8828c6a2d89ee7ac7&scope.project.id=696ed25cc0cb43fab4bfaf762a90da54&role.id=ff59a239a50b4bd899a83bf3c3fd1f63 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:56.810611 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d62919-9ce5-4ef0-b75e-f9ecf12bab8e None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:56.824628 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b0d83b-ce8a-4189-8006-4d549d069ffa None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:56.830290 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:56.851408 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d37390-796b-4bb7-b204-f0c88d353bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:56.852088 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d37390-796b-4bb7-b204-f0c88d353bd5 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:56.852373 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d37390-796b-4bb7-b204-f0c88d353bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:56.858624 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d37390-796b-4bb7-b204-f0c88d353bd5 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:56.859468 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d37390-796b-4bb7-b204-f0c88d353bd5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:56.859790 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d37390-796b-4bb7-b204-f0c88d353bd5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:56.861367 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d37390-796b-4bb7-b204-f0c88d353bd5 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:56.869149 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:56.881880 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 421/861] 10.222.0.36 () {56 vars in 1149 bytes} [Mon Aug 29 22:14:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:56.888818 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d37390-796b-4bb7-b204-f0c88d353bd5 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:56.973879 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b0d83b-ce8a-4189-8006-4d549d069ffa None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:57.011632 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876c976-6b22-49da-acd9-9df08e237d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:57.012397 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876c976-6b22-49da-acd9-9df08e237d58 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:57.013040 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876c976-6b22-49da-acd9-9df08e237d58 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:57.013157 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876c976-6b22-49da-acd9-9df08e237d58 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:57.013687 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2876c976-6b22-49da-acd9-9df08e237d58 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:57.015477 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2876c976-6b22-49da-acd9-9df08e237d58 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:57.021708 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d37390-796b-4bb7-b204-f0c88d353bd5 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:57.025651 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-2876c976-6b22-49da-acd9-9df08e237d58 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 22:14:57.025651 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:57.025651 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:14:57.025651 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:14:57.025651 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:14:57.025651 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:14:57.025651 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:14:57.025651 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:14:57.025651 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 22:14:57.025651 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:57.025651 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:14:57.025651 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:57.025651 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:57.025651 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:57.025651 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:57.025651 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:57.026847 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:57.026847 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:57.026847 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:57.026847 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:57.026847 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:57.026847 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:57.026847 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:57.026847 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:14:57.026847 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:14:57.026847 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:14:57.026847 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:14:57.026847 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:57.026847 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:57.026847 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:57.026847 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:57.026847 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:57.026847 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:57.027951 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:57.027951 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:57.027951 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:57.027951 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:57.027951 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:57.027951 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:57.027951 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:57.027951 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:57.027951 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:57.027951 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:57.027951 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:14:57.027951 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:14:57.027951 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 22:14:57.027951 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:14:57.027951 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 441/862] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Aug 29 22:14:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:14:57.034989 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876c976-6b22-49da-acd9-9df08e237d58 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:57.060008 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87596151-b2f9-4b6c-b82d-b1fa0e9cb520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:57.060655 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87596151-b2f9-4b6c-b82d-b1fa0e9cb520 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:57.060933 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87596151-b2f9-4b6c-b82d-b1fa0e9cb520 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:57.061202 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87596151-b2f9-4b6c-b82d-b1fa0e9cb520 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:57.105381 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:57.131547 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87596151-b2f9-4b6c-b82d-b1fa0e9cb520 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:57.133268 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87596151-b2f9-4b6c-b82d-b1fa0e9cb520 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:57.142595 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:57.151073 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876c976-6b22-49da-acd9-9df08e237d58 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:57.188821 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b7317-a400-48f5-93c5-318f2132f4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:57.189767 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b7317-a400-48f5-93c5-318f2132f4d6 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:57.190322 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b7317-a400-48f5-93c5-318f2132f4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:57.190906 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b7317-a400-48f5-93c5-318f2132f4d6 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:57.191738 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58b7317-a400-48f5-93c5-318f2132f4d6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:57.192223 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58b7317-a400-48f5-93c5-318f2132f4d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:57.194029 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58b7317-a400-48f5-93c5-318f2132f4d6 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:57.200282 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 442/863] 10.222.0.36 () {56 vars in 1126 bytes} [Mon Aug 29 22:14:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:57.205750 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b7317-a400-48f5-93c5-318f2132f4d6 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:57.244813 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 422/864] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:14:56 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 22:14:57.245634 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87596151-b2f9-4b6c-b82d-b1fa0e9cb520 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:57.320599 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b7317-a400-48f5-93c5-318f2132f4d6 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:57.325251 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:57.351009 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87596151-b2f9-4b6c-b82d-b1fa0e9cb520 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:57.362208 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf40e208-0f79-42d6-a00e-1f8ce533c7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:57.363261 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40e208-0f79-42d6-a00e-1f8ce533c7b1 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:57.363735 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40e208-0f79-42d6-a00e-1f8ce533c7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:57.364196 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40e208-0f79-42d6-a00e-1f8ce533c7b1 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:57.365054 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf40e208-0f79-42d6-a00e-1f8ce533c7b1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:57.365628 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf40e208-0f79-42d6-a00e-1f8ce533c7b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:57.367431 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf40e208-0f79-42d6-a00e-1f8ce533c7b1 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:57.373233 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 443/865] 10.222.0.36 () {56 vars in 1126 bytes} [Mon Aug 29 22:14:57 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:14:57.387342 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa6fd31-2196-4bda-b7a9-f35ddf75265f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:57.388010 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6fd31-2196-4bda-b7a9-f35ddf75265f None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:57.388347 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6fd31-2196-4bda-b7a9-f35ddf75265f None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:57.388651 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6fd31-2196-4bda-b7a9-f35ddf75265f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:57.401452 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa6fd31-2196-4bda-b7a9-f35ddf75265f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:57.402933 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa6fd31-2196-4bda-b7a9-f35ddf75265f None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:57.419909 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-baa6fd31-2196-4bda-b7a9-f35ddf75265f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:57.419909 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:57.419909 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:57.419909 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:57.419909 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:57.419909 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:57.419909 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:57.419909 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:57.419909 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:57.419909 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:57.419909 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:57.419909 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:57.419909 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:14:57.419909 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:14:57.419909 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:14:57.419909 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:14:57.420998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:57.420998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:57.420998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:57.420998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:57.420998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:57.420998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:57.420998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:57.420998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:57.420998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:57.420998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:57.420998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:57.420998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:57.420998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:57.420998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:57.420998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:57.420998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:57.420998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:14:57.421913 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:14:57.421913 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:14:57.421913 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:57.421913 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 423/866] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:14:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:14:57.427438 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf40e208-0f79-42d6-a00e-1f8ce533c7b1 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:57.456364 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:57.485383 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28d34a-80b5-42cc-8df6-4bc8a7c54e72 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:57.485716 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28d34a-80b5-42cc-8df6-4bc8a7c54e72 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:57.485994 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28d34a-80b5-42cc-8df6-4bc8a7c54e72 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:57.487792 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 424/867] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:14:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:14:57.493870 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5381f93e-1fe3-4511-a31d-29bce4a56f04 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:57.494290 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5381f93e-1fe3-4511-a31d-29bce4a56f04 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:57.494663 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5381f93e-1fe3-4511-a31d-29bce4a56f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:57.513764 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-5381f93e-1fe3-4511-a31d-29bce4a56f04 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:14:57.515318 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-5381f93e-1fe3-4511-a31d-29bce4a56f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:14:57.549811 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf40e208-0f79-42d6-a00e-1f8ce533c7b1 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:57.592120 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe68b1-ed81-4c2f-8ce8-1b43ce2d42d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:57.592784 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe68b1-ed81-4c2f-8ce8-1b43ce2d42d4 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:57.593058 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe68b1-ed81-4c2f-8ce8-1b43ce2d42d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:57.593578 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe68b1-ed81-4c2f-8ce8-1b43ce2d42d4 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:57.594241 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fe68b1-ed81-4c2f-8ce8-1b43ce2d42d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:57.594554 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fe68b1-ed81-4c2f-8ce8-1b43ce2d42d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:57.596432 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fe68b1-ed81-4c2f-8ce8-1b43ce2d42d4 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:57.601793 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 425/868] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:14:57 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:14:57.612497 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 444/869] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:14:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:57.616664 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5381f93e-1fe3-4511-a31d-29bce4a56f04 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:57.675354 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:57.720346 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5381f93e-1fe3-4511-a31d-29bce4a56f04 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:57.754768 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8360b331-b006-49eb-addd-03954e5f8e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:57.755406 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360b331-b006-49eb-addd-03954e5f8e81 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:57.755680 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360b331-b006-49eb-addd-03954e5f8e81 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:57.755948 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360b331-b006-49eb-addd-03954e5f8e81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:57.762908 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8360b331-b006-49eb-addd-03954e5f8e81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:57.764799 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8360b331-b006-49eb-addd-03954e5f8e81 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:57.776335 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-8360b331-b006-49eb-addd-03954e5f8e81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:14:57.776335 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:57.776335 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:57.776335 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:57.776335 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:57.776335 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:57.776335 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:57.776335 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:57.776335 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:57.776335 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:57.776335 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:57.776335 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:57.776335 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:14:57.776335 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:14:57.776335 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:14:57.777294 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:14:57.777294 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:57.777294 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:57.777294 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:57.777294 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:57.777294 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:57.777294 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:57.777294 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:57.777294 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:57.777294 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:57.777294 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:57.777294 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:57.777294 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:57.777294 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:57.777294 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:57.777294 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:57.777294 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:57.778185 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:14:57.778185 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:14:57.778185 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:14:57.778185 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:14:57.778185 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:14:57.778185 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:14:57.778185 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:14:57.778185 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:57.778185 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 426/870] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Aug 29 22:14:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:57.783484 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe68b1-ed81-4c2f-8ce8-1b43ce2d42d4 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:57.871598 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8360b331-b006-49eb-addd-03954e5f8e81 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:57.871838 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:57.891510 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe68b1-ed81-4c2f-8ce8-1b43ce2d42d4 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:57.933898 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d48326-8ce0-488a-8a87-602395618fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:57.934783 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d48326-8ce0-488a-8a87-602395618fa3 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:57.935065 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d48326-8ce0-488a-8a87-602395618fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:57.935734 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d48326-8ce0-488a-8a87-602395618fa3 None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:57.936734 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d48326-8ce0-488a-8a87-602395618fa3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:57.937043 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d48326-8ce0-488a-8a87-602395618fa3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:57.939318 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d48326-8ce0-488a-8a87-602395618fa3 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:57.955146 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 445/871] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Aug 29 22:14:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:14:57.961285 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d48326-8ce0-488a-8a87-602395618fa3 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:57.979279 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8360b331-b006-49eb-addd-03954e5f8e81 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:57.996508 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:58.016731 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8600d697-1642-40c6-8104-dc1f7a6e5f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:58.017313 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600d697-1642-40c6-8104-dc1f7a6e5f89 None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:58.017593 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600d697-1642-40c6-8104-dc1f7a6e5f89 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:58.017903 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600d697-1642-40c6-8104-dc1f7a6e5f89 None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:58.018583 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8600d697-1642-40c6-8104-dc1f7a6e5f89 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:58.020075 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8600d697-1642-40c6-8104-dc1f7a6e5f89 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:58.044747 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 427/872] 10.222.0.36 () {60 vars in 1141 bytes} [Mon Aug 29 22:14:57 2022] POST /identity/v3/services => generated 251 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:14:58.087348 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d48326-8ce0-488a-8a87-602395618fa3 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:58.132281 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dc6e9b-7604-467a-88cb-e8f81dc823eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:58.133416 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc6e9b-7604-467a-88cb-e8f81dc823eb None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:58.133910 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc6e9b-7604-467a-88cb-e8f81dc823eb None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:58.134375 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc6e9b-7604-467a-88cb-e8f81dc823eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:58.135435 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dc6e9b-7604-467a-88cb-e8f81dc823eb None admin] RBAC: Adding query filter params (role.id=bc7b902c0870483ba03c139d941f78ac, scope.project.id=696ed25cc0cb43fab4bfaf762a90da54, user.id=b32922d090564162810dd8b28c3a322b) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:58.135946 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dc6e9b-7604-467a-88cb-e8f81dc823eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:58.137850 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dc6e9b-7604-467a-88cb-e8f81dc823eb None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:58.152932 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 446/873] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Aug 29 22:14:57 2022] GET /identity/v3/role_assignments?user.id=b32922d090564162810dd8b28c3a322b&scope.project.id=696ed25cc0cb43fab4bfaf762a90da54&role.id=bc7b902c0870483ba03c139d941f78ac => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:14:58.871618 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d22dbd-c00d-4193-ae2c-7faa3fecf8b3 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:58.872025 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d22dbd-c00d-4193-ae2c-7faa3fecf8b3 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:58.872211 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d22dbd-c00d-4193-ae2c-7faa3fecf8b3 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:58.873831 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 428/874] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:14:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:14:58.879093 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746ef56-72e1-4a02-811d-f4f88684fd19 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:58.879568 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746ef56-72e1-4a02-811d-f4f88684fd19 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:58.879663 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746ef56-72e1-4a02-811d-f4f88684fd19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:58.887326 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:58.903964 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-d746ef56-72e1-4a02-811d-f4f88684fd19 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:14:58.905394 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d746ef56-72e1-4a02-811d-f4f88684fd19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:14:58.976108 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 447/875] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:14:58 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:14:59.246712 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d22dbd-c00d-4193-ae2c-7faa3fecf8b3 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:59.363736 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d22dbd-c00d-4193-ae2c-7faa3fecf8b3 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:59.371370 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0093a-cc98-475e-a130-85563de95b5b None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:59.371731 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0093a-cc98-475e-a130-85563de95b5b None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:59.371922 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0093a-cc98-475e-a130-85563de95b5b None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:59.373983 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 448/876] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:14:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:14:59.378937 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df17ce-ab29-4761-8b97-a50c47652579 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:59.379198 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df17ce-ab29-4761-8b97-a50c47652579 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:59.379473 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df17ce-ab29-4761-8b97-a50c47652579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:59.399791 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-02df17ce-ab29-4761-8b97-a50c47652579 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:14:59.401275 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-02df17ce-ab29-4761-8b97-a50c47652579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:14:59.404774 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058918ef-80d3-4abf-b1ab-2ce31203b2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:59.405633 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058918ef-80d3-4abf-b1ab-2ce31203b2c2 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:59.406116 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058918ef-80d3-4abf-b1ab-2ce31203b2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:59.406581 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058918ef-80d3-4abf-b1ab-2ce31203b2c2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:59.407368 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058918ef-80d3-4abf-b1ab-2ce31203b2c2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:59.409066 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058918ef-80d3-4abf-b1ab-2ce31203b2c2 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:59.419761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-058918ef-80d3-4abf-b1ab-2ce31203b2c2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 22:14:59.419761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:59.419761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:14:59.419761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:14:59.419761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:14:59.419761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:14:59.419761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:14:59.419761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:14:59.419761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 22:14:59.419761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:59.419761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:14:59.419761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:59.419761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:14:59.419761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:14:59.419761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:14:59.419761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:14:59.419761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:14:59.420868 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:14:59.420868 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:14:59.420868 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:14:59.420868 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:14:59.420868 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:14:59.420868 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:14:59.420868 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:14:59.420868 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:14:59.420868 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:14:59.420868 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:14:59.420868 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:14:59.420868 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:14:59.420868 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:14:59.420868 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:14:59.420868 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:14:59.420868 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:14:59.421717 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:14:59.421717 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:14:59.421717 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:14:59.421717 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:14:59.421717 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:14:59.421717 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:14:59.421717 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:14:59.421717 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:14:59.421717 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:14:59.421717 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:14:59.421717 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:14:59.421717 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:14:59.421717 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 22:14:59.421717 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:14:59.424551 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 429/877] 10.222.0.36 () {56 vars in 1126 bytes} [Mon Aug 29 22:14:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:14:59.429962 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058918ef-80d3-4abf-b1ab-2ce31203b2c2 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:59.473786 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:59.487589 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 449/878] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:14:59 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:14:59.542083 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058918ef-80d3-4abf-b1ab-2ce31203b2c2 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:59.578108 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54f445-7d02-4f40-a8b7-d0005f9ac91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:59.579103 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54f445-7d02-4f40-a8b7-d0005f9ac91b None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:59.579615 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54f445-7d02-4f40-a8b7-d0005f9ac91b None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:59.580088 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54f445-7d02-4f40-a8b7-d0005f9ac91b None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:59.580957 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea54f445-7d02-4f40-a8b7-d0005f9ac91b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:59.581502 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea54f445-7d02-4f40-a8b7-d0005f9ac91b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:59.583160 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea54f445-7d02-4f40-a8b7-d0005f9ac91b None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:59.588936 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 430/879] 10.222.0.36 () {56 vars in 1122 bytes} [Mon Aug 29 22:14:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:14:59.594830 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df17ce-ab29-4761-8b97-a50c47652579 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:59.659657 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:59.699007 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df17ce-ab29-4761-8b97-a50c47652579 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:59.734160 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d566922-59d7-484d-be95-54babe730421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:59.735155 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d566922-59d7-484d-be95-54babe730421 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:59.735637 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d566922-59d7-484d-be95-54babe730421 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:59.736128 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d566922-59d7-484d-be95-54babe730421 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:59.737367 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d566922-59d7-484d-be95-54babe730421 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:14:59.737924 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d566922-59d7-484d-be95-54babe730421 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:59.739504 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d566922-59d7-484d-be95-54babe730421 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:59.745215 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 450/880] 10.222.0.36 () {56 vars in 1122 bytes} [Mon Aug 29 22:14:59 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:14:59.752504 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54f445-7d02-4f40-a8b7-d0005f9ac91b None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:14:59.871284 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54f445-7d02-4f40-a8b7-d0005f9ac91b None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:14:59.874503 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:14:59.921133 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c0c5f8-9dc1-402e-9f4c-ce14c65ed695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:14:59.922201 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0c5f8-9dc1-402e-9f4c-ce14c65ed695 None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:14:59.922684 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0c5f8-9dc1-402e-9f4c-ce14c65ed695 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:14:59.923173 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0c5f8-9dc1-402e-9f4c-ce14c65ed695 None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:14:59.924049 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c0c5f8-9dc1-402e-9f4c-ce14c65ed695 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:14:59.925684 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c0c5f8-9dc1-402e-9f4c-ce14c65ed695 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:14:59.944181 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 431/881] 10.222.0.36 () {60 vars in 1141 bytes} [Mon Aug 29 22:14:59 2022] POST /identity/v3/services => generated 269 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:15:00.068047 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717e22a-b5a6-4dcc-9f56-2a29ac138780 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:00.068657 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717e22a-b5a6-4dcc-9f56-2a29ac138780 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:00.068657 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717e22a-b5a6-4dcc-9f56-2a29ac138780 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:00.070358 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 451/882] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:15:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:15:00.079696 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f4952-4be3-4465-8c74-89a0cde8edc9 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:00.079696 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f4952-4be3-4465-8c74-89a0cde8edc9 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:00.079696 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f4952-4be3-4465-8c74-89a0cde8edc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:00.098264 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-122f4952-4be3-4465-8c74-89a0cde8edc9 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:15:00.099783 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-122f4952-4be3-4465-8c74-89a0cde8edc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:15:00.183027 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 432/883] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:15:00 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:15:00.235954 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfbb95d-0a6a-48be-a456-e6d66039fc3e None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:00.236295 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfbb95d-0a6a-48be-a456-e6d66039fc3e None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:00.236560 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfbb95d-0a6a-48be-a456-e6d66039fc3e None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:00.238158 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 452/884] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:15:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:15:00.243754 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1daaf-1e41-4e50-bc0f-c9c5e74b16a7 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:00.244048 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1daaf-1e41-4e50-bc0f-c9c5e74b16a7 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:00.244327 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1daaf-1e41-4e50-bc0f-c9c5e74b16a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:00.263196 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-a2d1daaf-1e41-4e50-bc0f-c9c5e74b16a7 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:15:00.264779 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a2d1daaf-1e41-4e50-bc0f-c9c5e74b16a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:15:00.336425 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 433/885] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:15:00 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:15:00.453625 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfbb95d-0a6a-48be-a456-e6d66039fc3e None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:00.559297 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfbb95d-0a6a-48be-a456-e6d66039fc3e None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:00.589026 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:00.595270 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb64798a-c319-404f-91c9-fdeed5ee9faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:00.596666 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64798a-c319-404f-91c9-fdeed5ee9faf None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:00.597312 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64798a-c319-404f-91c9-fdeed5ee9faf None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:00.597971 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64798a-c319-404f-91c9-fdeed5ee9faf None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:00.598624 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb64798a-c319-404f-91c9-fdeed5ee9faf None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:00.600002 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb64798a-c319-404f-91c9-fdeed5ee9faf None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:00.607314 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d1daaf-1e41-4e50-bc0f-c9c5e74b16a7 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:00.609335 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-fb64798a-c319-404f-91c9-fdeed5ee9faf None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 22:15:00.609335 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:00.609335 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:15:00.609335 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:15:00.609335 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:15:00.609335 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:15:00.609335 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:15:00.609335 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:15:00.609335 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 22:15:00.609335 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:15:00.609335 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:15:00.609335 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:15:00.609335 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:00.609335 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:15:00.609335 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:15:00.609335 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:15:00.609335 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:15:00.610338 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:15:00.610338 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:15:00.610338 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:15:00.610338 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:15:00.610338 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:15:00.610338 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:15:00.610338 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:15:00.610338 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:15:00.610338 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:15:00.610338 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:15:00.610338 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:15:00.610338 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:15:00.610338 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:15:00.610338 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:15:00.610338 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:15:00.610338 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:15:00.611329 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:15:00.611329 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:15:00.611329 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:15:00.611329 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:15:00.611329 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:15:00.611329 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:15:00.611329 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:15:00.611329 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:15:00.611329 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:15:00.611329 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:15:00.611329 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:15:00.611329 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:15:00.611329 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 22:15:00.611329 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:15:00.611329 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 453/886] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Aug 29 22:15:00 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:15:00.616246 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb64798a-c319-404f-91c9-fdeed5ee9faf None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:00.635291 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:00.728936 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb64798a-c319-404f-91c9-fdeed5ee9faf None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:00.743243 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d1daaf-1e41-4e50-bc0f-c9c5e74b16a7 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:00.769402 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988b602-c490-46f2-9f99-cb4a95d9a2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:00.770026 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988b602-c490-46f2-9f99-cb4a95d9a2cf None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:00.770306 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988b602-c490-46f2-9f99-cb4a95d9a2cf None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:00.770590 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988b602-c490-46f2-9f99-cb4a95d9a2cf None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:00.771232 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2988b602-c490-46f2-9f99-cb4a95d9a2cf None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:00.771788 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2988b602-c490-46f2-9f99-cb4a95d9a2cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:00.774011 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2988b602-c490-46f2-9f99-cb4a95d9a2cf None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:00.784483 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 454/887] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Aug 29 22:15:00 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:15:00.786179 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988b602-c490-46f2-9f99-cb4a95d9a2cf None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:00.788928 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168466c-ced1-4b5b-99f3-7d5078a17665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:00.789626 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168466c-ced1-4b5b-99f3-7d5078a17665 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:00.789902 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168466c-ced1-4b5b-99f3-7d5078a17665 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:00.790230 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168466c-ced1-4b5b-99f3-7d5078a17665 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:00.801874 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3168466c-ced1-4b5b-99f3-7d5078a17665 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:15:00.806950 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-3168466c-ced1-4b5b-99f3-7d5078a17665 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 22:15:00.806950 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:00.806950 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:15:00.806950 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:15:00.806950 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:15:00.806950 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:15:00.806950 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:15:00.806950 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:15:00.806950 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:15:00.806950 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:15:00.806950 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:15:00.806950 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:15:00.806950 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:15:00.806950 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:15:00.806950 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:15:00.806950 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:15:00.807901 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:15:00.807901 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:15:00.807901 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:15:00.807901 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:15:00.807901 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:15:00.807901 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:15:00.807901 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:15:00.807901 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:15:00.807901 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:15:00.807901 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:15:00.807901 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:15:00.807901 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:15:00.807901 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:15:00.807901 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:15:00.807901 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:15:00.807901 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:15:00.808823 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:15:00.808823 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:15:00.808823 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:15:00.808823 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:15:00.808823 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:15:00.808823 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:15:00.808823 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:15:00.808823 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:15:00.808823 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:15:00.808823 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:15:00.808823 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 22:15:00.808823 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:15:00.811685 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 434/888] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Aug 29 22:15:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:15:00.813783 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168466c-ced1-4b5b-99f3-7d5078a17665 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:00.855276 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:00.903722 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988b602-c490-46f2-9f99-cb4a95d9a2cf None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:00.928175 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:00.947473 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e07ad1-f9a9-4472-9dc8-c222be1d6a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:00.948847 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e07ad1-f9a9-4472-9dc8-c222be1d6a86 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:00.949348 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e07ad1-f9a9-4472-9dc8-c222be1d6a86 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:00.949849 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e07ad1-f9a9-4472-9dc8-c222be1d6a86 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:00.951486 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e07ad1-f9a9-4472-9dc8-c222be1d6a86 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:00.952162 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e07ad1-f9a9-4472-9dc8-c222be1d6a86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:00.954128 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e07ad1-f9a9-4472-9dc8-c222be1d6a86 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:00.957516 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168466c-ced1-4b5b-99f3-7d5078a17665 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:00.962031 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 455/889] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Aug 29 22:15:00 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:00.969852 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e07ad1-f9a9-4472-9dc8-c222be1d6a86 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:01.004269 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5297a5ee-cb4a-45cf-808d-9a5e67a18cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:01.004269 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297a5ee-cb4a-45cf-808d-9a5e67a18cc5 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:01.004269 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297a5ee-cb4a-45cf-808d-9a5e67a18cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:01.004269 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297a5ee-cb4a-45cf-808d-9a5e67a18cc5 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:01.004682 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5297a5ee-cb4a-45cf-808d-9a5e67a18cc5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:01.004682 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5297a5ee-cb4a-45cf-808d-9a5e67a18cc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:01.004682 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5297a5ee-cb4a-45cf-808d-9a5e67a18cc5 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:01.018519 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 435/890] 10.222.0.36 () {56 vars in 1115 bytes} [Mon Aug 29 22:15:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:15:01.019618 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5297a5ee-cb4a-45cf-808d-9a5e67a18cc5 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:01.099420 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e07ad1-f9a9-4472-9dc8-c222be1d6a86 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:01.119568 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5297a5ee-cb4a-45cf-808d-9a5e67a18cc5 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:01.126159 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:01.145660 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4919bbd0-7254-4cd6-8e44-5f61e61c48c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:01.146715 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919bbd0-7254-4cd6-8e44-5f61e61c48c7 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:01.147448 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919bbd0-7254-4cd6-8e44-5f61e61c48c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:01.147876 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919bbd0-7254-4cd6-8e44-5f61e61c48c7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:01.149049 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4919bbd0-7254-4cd6-8e44-5f61e61c48c7 None admin] RBAC: Adding query filter params (interface=public, service_id=7fd489029cb244de8aebb038bdf29062, region_id=RegionOne) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:01.149500 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4919bbd0-7254-4cd6-8e44-5f61e61c48c7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:01.151741 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4919bbd0-7254-4cd6-8e44-5f61e61c48c7 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:01.158304 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 456/891] 10.222.0.36 () {56 vars in 1251 bytes} [Mon Aug 29 22:15:00 2022] GET /identity/v3/endpoints?service_id=7fd489029cb244de8aebb038bdf29062&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:15:01.159115 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce49d4-1ddf-4474-a98b-8c2ca82fd38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:01.159461 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce49d4-1ddf-4474-a98b-8c2ca82fd38e None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:01.159803 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce49d4-1ddf-4474-a98b-8c2ca82fd38e None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:01.160140 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce49d4-1ddf-4474-a98b-8c2ca82fd38e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:01.164482 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4919bbd0-7254-4cd6-8e44-5f61e61c48c7 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:01.174668 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce49d4-1ddf-4474-a98b-8c2ca82fd38e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:01.176568 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce49d4-1ddf-4474-a98b-8c2ca82fd38e None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:01.178832 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:01.195495 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-dcce49d4-1ddf-4474-a98b-8c2ca82fd38e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:15:01.195495 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:01.195495 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:15:01.195495 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:15:01.195495 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:15:01.195495 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:15:01.195495 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:15:01.195495 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:15:01.195495 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:15:01.195495 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:15:01.195495 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:15:01.195495 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:15:01.195495 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:15:01.195495 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:15:01.195495 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:15:01.195495 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:15:01.196664 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:15:01.196664 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:15:01.196664 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:15:01.196664 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:15:01.196664 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:15:01.196664 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:15:01.196664 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:15:01.196664 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:15:01.196664 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:15:01.196664 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:15:01.196664 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:15:01.196664 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:15:01.196664 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:15:01.196664 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:15:01.196664 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:15:01.196664 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:15:01.196664 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:15:01.197748 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:15:01.197748 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:15:01.197748 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:15:01.204302 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 436/892] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:15:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:15:01.205533 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce49d4-1ddf-4474-a98b-8c2ca82fd38e None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:01.277874 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4919bbd0-7254-4cd6-8e44-5f61e61c48c7 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:01.314094 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce49d4-1ddf-4474-a98b-8c2ca82fd38e None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:01.315936 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9367afa3-6b31-40cd-b41f-b64d04c1760c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:01.316816 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9367afa3-6b31-40cd-b41f-b64d04c1760c None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:01.317237 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9367afa3-6b31-40cd-b41f-b64d04c1760c None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:01.318161 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9367afa3-6b31-40cd-b41f-b64d04c1760c None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:01.318451 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9367afa3-6b31-40cd-b41f-b64d04c1760c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:01.319924 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9367afa3-6b31-40cd-b41f-b64d04c1760c None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:01.332619 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 457/893] 10.222.0.36 () {56 vars in 1087 bytes} [Mon Aug 29 22:15:01 2022] GET /identity/v3/services => generated 1268 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:15:01.355205 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc8464-4d4c-4210-843e-37fc84dd9d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:01.356135 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc8464-4d4c-4210-843e-37fc84dd9d46 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:01.356587 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc8464-4d4c-4210-843e-37fc84dd9d46 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:01.356996 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc8464-4d4c-4210-843e-37fc84dd9d46 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:01.357820 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc8464-4d4c-4210-843e-37fc84dd9d46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:01.358263 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc8464-4d4c-4210-843e-37fc84dd9d46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:01.359993 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc8464-4d4c-4210-843e-37fc84dd9d46 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:01.374587 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 437/894] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:15:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:01.380584 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9367afa3-6b31-40cd-b41f-b64d04c1760c None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:01.439290 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:01.497166 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9367afa3-6b31-40cd-b41f-b64d04c1760c None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:01.535271 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c7b4d3-30e3-4860-9b6c-bfb4ed716431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:01.535859 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7b4d3-30e3-4860-9b6c-bfb4ed716431 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:01.536147 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7b4d3-30e3-4860-9b6c-bfb4ed716431 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:01.536439 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7b4d3-30e3-4860-9b6c-bfb4ed716431 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:01.545659 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c7b4d3-30e3-4860-9b6c-bfb4ed716431 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:01.547142 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c7b4d3-30e3-4860-9b6c-bfb4ed716431 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:01.559368 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-c7c7b4d3-30e3-4860-9b6c-bfb4ed716431 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 22:15:01.559368 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:01.559368 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:15:01.559368 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:15:01.559368 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:15:01.559368 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:15:01.559368 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:15:01.559368 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:15:01.559368 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:15:01.559368 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:15:01.559368 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:15:01.559368 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:15:01.559368 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:15:01.559368 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:15:01.559368 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:15:01.559368 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:15:01.560350 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:15:01.560350 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:15:01.560350 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:15:01.560350 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:15:01.560350 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:15:01.560350 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:15:01.560350 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:15:01.560350 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:15:01.560350 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:15:01.560350 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:15:01.560350 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:15:01.560350 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:15:01.560350 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:15:01.560350 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:15:01.560350 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:15:01.560350 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:15:01.560350 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:15:01.560350 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:15:01.561377 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:15:01.561377 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:15:01.561377 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:15:01.561377 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:15:01.561377 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:15:01.561377 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:15:01.561377 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:15:01.561377 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:15:01.561377 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 22:15:01.561377 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:15:01.561377 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 458/895] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Aug 29 22:15:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:15:01.567877 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc8464-4d4c-4210-843e-37fc84dd9d46 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:01.626686 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:01.674093 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc8464-4d4c-4210-843e-37fc84dd9d46 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:01.710222 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b8f4b1-85d6-41f6-9079-76d2ed95c697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:01.710941 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8f4b1-85d6-41f6-9079-76d2ed95c697 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:01.711171 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8f4b1-85d6-41f6-9079-76d2ed95c697 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:01.711439 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8f4b1-85d6-41f6-9079-76d2ed95c697 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:01.712433 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b8f4b1-85d6-41f6-9079-76d2ed95c697 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:01.712877 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b8f4b1-85d6-41f6-9079-76d2ed95c697 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:01.714312 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b8f4b1-85d6-41f6-9079-76d2ed95c697 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:01.733129 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 438/896] 10.222.0.36 () {56 vars in 1149 bytes} [Mon Aug 29 22:15:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:01.739411 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c7b4d3-30e3-4860-9b6c-bfb4ed716431 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:01.801195 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd055d62-5c5d-4220-861f-b5cdfa2eb0c0 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:01.801526 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd055d62-5c5d-4220-861f-b5cdfa2eb0c0 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:01.801740 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd055d62-5c5d-4220-861f-b5cdfa2eb0c0 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:01.803426 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 439/897] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:15:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:15:01.810168 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11afa77-a485-4df1-82b0-a1126cf84f2b None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:01.810598 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11afa77-a485-4df1-82b0-a1126cf84f2b None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:01.810973 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11afa77-a485-4df1-82b0-a1126cf84f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:01.831541 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-e11afa77-a485-4df1-82b0-a1126cf84f2b None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:15:01.832948 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e11afa77-a485-4df1-82b0-a1126cf84f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:15:01.849224 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c7b4d3-30e3-4860-9b6c-bfb4ed716431 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:01.859729 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:01.889138 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9d4cd-031c-4435-a60e-b3f0db95eb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:01.890082 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9d4cd-031c-4435-a60e-b3f0db95eb17 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:01.890361 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9d4cd-031c-4435-a60e-b3f0db95eb17 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:01.890637 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9d4cd-031c-4435-a60e-b3f0db95eb17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:01.917167 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 440/898] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:15:01 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:15:01.967115 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f9d4cd-031c-4435-a60e-b3f0db95eb17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:01.969552 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f9d4cd-031c-4435-a60e-b3f0db95eb17 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:01.983170 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dca0cb-e9ec-4042-9845-6f02486d6c01 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:01.983457 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dca0cb-e9ec-4042-9845-6f02486d6c01 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:01.983733 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dca0cb-e9ec-4042-9845-6f02486d6c01 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:01.985370 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 441/899] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:15:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:15:01.990565 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b615d1b-02da-4731-9f03-33589a4640ae None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:01.990848 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b615d1b-02da-4731-9f03-33589a4640ae None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:01.991120 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b615d1b-02da-4731-9f03-33589a4640ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:02.010546 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-8b615d1b-02da-4731-9f03-33589a4640ae None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:15:02.011735 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-8b615d1b-02da-4731-9f03-33589a4640ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:15:02.051754 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:02.090605 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 459/900] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:15:01 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:15:02.104479 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9d4cd-031c-4435-a60e-b3f0db95eb17 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:02.108603 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 442/901] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:15:01 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:15:02.116824 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:02.185876 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b615d1b-02da-4731-9f03-33589a4640ae None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:02.204119 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9d4cd-031c-4435-a60e-b3f0db95eb17 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:02.258649 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e79ec6-b8b4-4170-8c6c-96a111e56e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:02.259294 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e79ec6-b8b4-4170-8c6c-96a111e56e67 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:02.259580 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e79ec6-b8b4-4170-8c6c-96a111e56e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:02.259850 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e79ec6-b8b4-4170-8c6c-96a111e56e67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:02.273509 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e79ec6-b8b4-4170-8c6c-96a111e56e67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:02.275204 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e79ec6-b8b4-4170-8c6c-96a111e56e67 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:02.290859 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-91e79ec6-b8b4-4170-8c6c-96a111e56e67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:15:02.290859 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:02.290859 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:15:02.290859 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:15:02.290859 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:15:02.290859 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:15:02.290859 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:15:02.290859 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:15:02.290859 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:15:02.290859 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:15:02.290859 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:15:02.290859 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:15:02.290859 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:15:02.290859 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:15:02.290859 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:15:02.290859 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:15:02.291856 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:15:02.291856 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:15:02.291856 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:15:02.291856 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:15:02.291856 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:15:02.291856 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:15:02.291856 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:15:02.291856 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:15:02.291856 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:15:02.291856 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:15:02.291856 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:15:02.291856 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:15:02.291856 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:15:02.291856 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:15:02.291856 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:15:02.291856 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:15:02.291856 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:15:02.292773 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:15:02.292773 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:15:02.292773 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:15:02.296860 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 460/902] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:15:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:15:02.297701 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e79ec6-b8b4-4170-8c6c-96a111e56e67 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:02.305409 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b615d1b-02da-4731-9f03-33589a4640ae None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:02.351644 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9105f8-b758-4ee1-89c4-5323e1d37b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:02.354127 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9105f8-b758-4ee1-89c4-5323e1d37b37 None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:02.354418 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9105f8-b758-4ee1-89c4-5323e1d37b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:02.354697 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9105f8-b758-4ee1-89c4-5323e1d37b37 None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:02.355373 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9105f8-b758-4ee1-89c4-5323e1d37b37 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:02.357043 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9105f8-b758-4ee1-89c4-5323e1d37b37 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:02.362505 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:02.385031 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 443/903] 10.222.0.36 () {60 vars in 1141 bytes} [Mon Aug 29 22:15:02 2022] POST /identity/v3/services => generated 241 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:15:02.398398 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9105f8-b758-4ee1-89c4-5323e1d37b37 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:02.418267 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e79ec6-b8b4-4170-8c6c-96a111e56e67 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:02.440533 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:02.472242 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900209c-a1c5-4c6f-8d99-1823d0f3db10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:02.472902 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900209c-a1c5-4c6f-8d99-1823d0f3db10 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:02.473180 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900209c-a1c5-4c6f-8d99-1823d0f3db10 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:02.473448 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900209c-a1c5-4c6f-8d99-1823d0f3db10 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:02.474111 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6900209c-a1c5-4c6f-8d99-1823d0f3db10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:02.474411 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6900209c-a1c5-4c6f-8d99-1823d0f3db10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:02.475815 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6900209c-a1c5-4c6f-8d99-1823d0f3db10 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:02.498032 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 461/904] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:15:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:02.505580 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900209c-a1c5-4c6f-8d99-1823d0f3db10 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:02.537700 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9105f8-b758-4ee1-89c4-5323e1d37b37 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:02.582307 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41605547-8f0d-490a-86ac-d76b07f099a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:02.582865 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41605547-8f0d-490a-86ac-d76b07f099a0 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:02.583143 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41605547-8f0d-490a-86ac-d76b07f099a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:02.583413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41605547-8f0d-490a-86ac-d76b07f099a0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:02.583996 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41605547-8f0d-490a-86ac-d76b07f099a0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:02.585383 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41605547-8f0d-490a-86ac-d76b07f099a0 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:02.595466 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-41605547-8f0d-490a-86ac-d76b07f099a0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 22:15:02.595466 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:02.595466 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:15:02.595466 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:15:02.595466 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:15:02.595466 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:15:02.595466 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:15:02.595466 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:15:02.595466 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 22:15:02.595466 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:15:02.595466 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:15:02.595466 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:15:02.595466 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:02.595466 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:15:02.595466 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:15:02.595466 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:15:02.596424 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:15:02.596424 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:15:02.596424 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:15:02.596424 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:15:02.596424 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:15:02.596424 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:15:02.596424 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:15:02.596424 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:15:02.596424 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:15:02.596424 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:15:02.596424 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:15:02.596424 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:15:02.596424 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:15:02.596424 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:15:02.596424 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:15:02.596424 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:15:02.596424 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:15:02.601519 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:15:02.601519 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:15:02.601519 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:15:02.601519 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:15:02.601519 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:15:02.601519 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:15:02.601519 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:15:02.601519 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:15:02.601519 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:15:02.601519 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:15:02.601519 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:15:02.601519 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:15:02.601519 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 22:15:02.601519 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:15:02.601519 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 444/905] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Aug 29 22:15:02 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:15:02.605321 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41605547-8f0d-490a-86ac-d76b07f099a0 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:02.649791 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900209c-a1c5-4c6f-8d99-1823d0f3db10 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:02.669168 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:02.690570 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1692219-631d-4634-945a-b4975c18b49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:02.691275 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1692219-631d-4634-945a-b4975c18b49c None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:02.691554 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1692219-631d-4634-945a-b4975c18b49c None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:02.691826 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1692219-631d-4634-945a-b4975c18b49c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:02.699325 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1692219-631d-4634-945a-b4975c18b49c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:02.700779 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1692219-631d-4634-945a-b4975c18b49c None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:02.714042 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-b1692219-631d-4634-945a-b4975c18b49c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:15:02.714042 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:02.714042 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:15:02.714042 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:15:02.714042 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:15:02.714042 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:15:02.714042 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:15:02.714042 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:15:02.714042 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:15:02.714042 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:15:02.714042 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:15:02.714042 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:15:02.714042 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:15:02.714042 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:15:02.714042 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:15:02.715008 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:15:02.715008 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:15:02.715008 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:15:02.715008 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:15:02.715008 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:15:02.715008 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:15:02.715008 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:15:02.715008 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:15:02.715008 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:15:02.715008 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:15:02.715008 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:15:02.715008 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:15:02.715008 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:15:02.715008 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:15:02.715008 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:15:02.715008 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:15:02.715008 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:15:02.716308 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:15:02.716308 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:15:02.716308 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:15:02.716308 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:15:02.716308 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:15:02.716308 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:15:02.716308 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:15:02.716308 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:15:02.716308 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 462/906] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Aug 29 22:15:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:15:02.721253 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1692219-631d-4634-945a-b4975c18b49c None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:02.738137 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:02.747346 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41605547-8f0d-490a-86ac-d76b07f099a0 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:02.805696 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d613d4-72e7-4ac4-9f6a-b77719fb53f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:02.806948 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d613d4-72e7-4ac4-9f6a-b77719fb53f6 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:02.808337 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d613d4-72e7-4ac4-9f6a-b77719fb53f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:02.808871 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d613d4-72e7-4ac4-9f6a-b77719fb53f6 None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:02.809842 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d613d4-72e7-4ac4-9f6a-b77719fb53f6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:02.810348 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d613d4-72e7-4ac4-9f6a-b77719fb53f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:02.812039 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d613d4-72e7-4ac4-9f6a-b77719fb53f6 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:02.824918 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 445/907] 10.222.0.36 () {56 vars in 1126 bytes} [Mon Aug 29 22:15:02 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:02.826993 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d613d4-72e7-4ac4-9f6a-b77719fb53f6 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:02.849639 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1692219-631d-4634-945a-b4975c18b49c None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:02.895549 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c9f42-3179-4389-9d81-20ded7c7ea4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:02.896867 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c9f42-3179-4389-9d81-20ded7c7ea4d None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:02.897755 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c9f42-3179-4389-9d81-20ded7c7ea4d None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:02.899308 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c9f42-3179-4389-9d81-20ded7c7ea4d None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:02.900179 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c9f42-3179-4389-9d81-20ded7c7ea4d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:02.900900 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c9f42-3179-4389-9d81-20ded7c7ea4d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:02.903265 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c9f42-3179-4389-9d81-20ded7c7ea4d None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:02.919792 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 463/908] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Aug 29 22:15:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:15:02.926603 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c9f42-3179-4389-9d81-20ded7c7ea4d None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:02.951501 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d613d4-72e7-4ac4-9f6a-b77719fb53f6 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:02.970733 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:02.994709 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c87f671-0c0f-41e8-a0fa-ff7f09683a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:02.995759 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87f671-0c0f-41e8-a0fa-ff7f09683a47 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:02.996295 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87f671-0c0f-41e8-a0fa-ff7f09683a47 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:02.996811 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87f671-0c0f-41e8-a0fa-ff7f09683a47 None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:02.997712 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c87f671-0c0f-41e8-a0fa-ff7f09683a47 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:02.998216 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c87f671-0c0f-41e8-a0fa-ff7f09683a47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:02.999930 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c87f671-0c0f-41e8-a0fa-ff7f09683a47 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:03.005743 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 446/909] 10.222.0.36 () {56 vars in 1126 bytes} [Mon Aug 29 22:15:02 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:15:03.013982 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c87f671-0c0f-41e8-a0fa-ff7f09683a47 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:03.052822 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c9f42-3179-4389-9d81-20ded7c7ea4d None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:03.053053 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:03.089005 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359da45c-e140-4c99-bde3-74e460d1f1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:03.089657 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359da45c-e140-4c99-bde3-74e460d1f1a1 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:03.089939 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359da45c-e140-4c99-bde3-74e460d1f1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:03.090211 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359da45c-e140-4c99-bde3-74e460d1f1a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:03.091348 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359da45c-e140-4c99-bde3-74e460d1f1a1 None admin] RBAC: Adding query filter params (role.id=1689c28a8f8945838ea7fd3cb4cfc598, scope.project.id=696ed25cc0cb43fab4bfaf762a90da54, user.id=b32922d090564162810dd8b28c3a322b) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:03.091348 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359da45c-e140-4c99-bde3-74e460d1f1a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:03.092742 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359da45c-e140-4c99-bde3-74e460d1f1a1 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:03.104340 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 464/910] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Aug 29 22:15:02 2022] GET /identity/v3/role_assignments?user.id=b32922d090564162810dd8b28c3a322b&scope.project.id=696ed25cc0cb43fab4bfaf762a90da54&role.id=1689c28a8f8945838ea7fd3cb4cfc598 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:03.132274 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c87f671-0c0f-41e8-a0fa-ff7f09683a47 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:03.171151 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc78791-4127-43be-8a62-3c9dbcbf1045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:03.171833 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc78791-4127-43be-8a62-3c9dbcbf1045 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:03.172117 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc78791-4127-43be-8a62-3c9dbcbf1045 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:03.172390 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc78791-4127-43be-8a62-3c9dbcbf1045 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:03.173147 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc78791-4127-43be-8a62-3c9dbcbf1045 None admin] RBAC: Adding query filter params (interface=public, service_id=5e0b79054be14ae58e603e61d81b4446, region_id=RegionOne) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:03.173457 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc78791-4127-43be-8a62-3c9dbcbf1045 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:03.174849 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc78791-4127-43be-8a62-3c9dbcbf1045 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:03.181585 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 447/911] 10.222.0.36 () {56 vars in 1251 bytes} [Mon Aug 29 22:15:03 2022] GET /identity/v3/endpoints?service_id=5e0b79054be14ae58e603e61d81b4446&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:15:03.192177 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359da45c-e140-4c99-bde3-74e460d1f1a1 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:03.299791 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:03.303582 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359da45c-e140-4c99-bde3-74e460d1f1a1 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:03.341071 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eff7d2-e866-4014-afbf-2192534d7200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:03.341725 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eff7d2-e866-4014-afbf-2192534d7200 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:03.342006 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eff7d2-e866-4014-afbf-2192534d7200 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:03.342284 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eff7d2-e866-4014-afbf-2192534d7200 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:03.342932 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eff7d2-e866-4014-afbf-2192534d7200 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:03.344343 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eff7d2-e866-4014-afbf-2192534d7200 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:03.352363 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 465/912] 10.222.0.36 () {56 vars in 1087 bytes} [Mon Aug 29 22:15:03 2022] GET /identity/v3/services => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:15:03.415431 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b79f1-f8e9-4b6e-a6f9-ab6aa79b8b39 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:03.415954 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b79f1-f8e9-4b6e-a6f9-ab6aa79b8b39 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:03.415954 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b79f1-f8e9-4b6e-a6f9-ab6aa79b8b39 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:03.417578 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 448/913] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:15:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:15:03.423283 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21764c49-c289-465a-abc3-fa76091cc659 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:03.423602 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21764c49-c289-465a-abc3-fa76091cc659 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:03.423849 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21764c49-c289-465a-abc3-fa76091cc659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:03.447283 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-21764c49-c289-465a-abc3-fa76091cc659 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:15:03.448924 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-21764c49-c289-465a-abc3-fa76091cc659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:15:03.525262 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 466/914] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:15:03 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:15:03.794834 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18b79f1-f8e9-4b6e-a6f9-ab6aa79b8b39 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:03.893386 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:03.908415 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18b79f1-f8e9-4b6e-a6f9-ab6aa79b8b39 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:03.944169 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba60554-3f11-4c33-814b-c16d71c268a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:03.945271 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba60554-3f11-4c33-814b-c16d71c268a2 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:03.945825 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba60554-3f11-4c33-814b-c16d71c268a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:03.946462 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba60554-3f11-4c33-814b-c16d71c268a2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:03.947250 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba60554-3f11-4c33-814b-c16d71c268a2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:03.949050 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba60554-3f11-4c33-814b-c16d71c268a2 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:03.958761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-fba60554-3f11-4c33-814b-c16d71c268a2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 22:15:03.958761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:03.958761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:15:03.958761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:15:03.958761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:15:03.958761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:15:03.958761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:15:03.958761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:15:03.958761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 22:15:03.958761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:15:03.958761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:15:03.958761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:15:03.958761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:03.958761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:15:03.958761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:15:03.958761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:15:03.958761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:15:03.959847 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:15:03.959847 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:15:03.959847 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:15:03.959847 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:15:03.959847 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:15:03.959847 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:15:03.959847 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:15:03.959847 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:15:03.959847 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:15:03.959847 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:15:03.959847 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:15:03.959847 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:15:03.959847 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:15:03.959847 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:15:03.959847 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:15:03.959847 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:15:03.960874 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:15:03.960874 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:15:03.960874 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:15:03.960874 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:15:03.960874 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:15:03.960874 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:15:03.960874 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:15:03.960874 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:15:03.960874 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:15:03.960874 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:15:03.960874 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:15:03.960874 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:15:03.960874 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 22:15:03.960874 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:15:03.968558 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 449/915] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Aug 29 22:15:03 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:15:03.970150 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21764c49-c289-465a-abc3-fa76091cc659 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:04.073121 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:04.098549 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21764c49-c289-465a-abc3-fa76091cc659 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:04.150230 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c34e750-0b4f-46a5-ab97-00ebb296f687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:04.151226 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c34e750-0b4f-46a5-ab97-00ebb296f687 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:04.151733 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c34e750-0b4f-46a5-ab97-00ebb296f687 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:04.152214 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c34e750-0b4f-46a5-ab97-00ebb296f687 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:04.153115 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c34e750-0b4f-46a5-ab97-00ebb296f687 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:04.153637 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c34e750-0b4f-46a5-ab97-00ebb296f687 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:04.155326 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c34e750-0b4f-46a5-ab97-00ebb296f687 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:04.160891 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 467/916] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Aug 29 22:15:03 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:15:04.166558 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba60554-3f11-4c33-814b-c16d71c268a2 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:04.306320 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba60554-3f11-4c33-814b-c16d71c268a2 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:04.341790 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77d111b-adf2-43ea-857c-81221bf1378f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:04.342325 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d111b-adf2-43ea-857c-81221bf1378f None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:04.342606 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d111b-adf2-43ea-857c-81221bf1378f None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:04.342906 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d111b-adf2-43ea-857c-81221bf1378f None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:04.343540 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77d111b-adf2-43ea-857c-81221bf1378f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:04.343841 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77d111b-adf2-43ea-857c-81221bf1378f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:04.345250 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77d111b-adf2-43ea-857c-81221bf1378f None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:04.355578 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 450/917] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Aug 29 22:15:04 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:04.357093 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c34e750-0b4f-46a5-ab97-00ebb296f687 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:04.484876 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b45094-6233-44c7-88c1-bd80207aea9d None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:04.484876 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b45094-6233-44c7-88c1-bd80207aea9d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:04.484876 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b45094-6233-44c7-88c1-bd80207aea9d None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:04.486183 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 451/918] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:15:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:15:04.502168 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7c2c8-5c59-434b-87c1-3e6cdf1edb44 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:04.502495 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7c2c8-5c59-434b-87c1-3e6cdf1edb44 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:04.502728 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7c2c8-5c59-434b-87c1-3e6cdf1edb44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:04.519953 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c34e750-0b4f-46a5-ab97-00ebb296f687 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:04.539779 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-ffe7c2c8-5c59-434b-87c1-3e6cdf1edb44 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:15:04.542826 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-ffe7c2c8-5c59-434b-87c1-3e6cdf1edb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:15:04.557925 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:04.577299 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8471242-89be-4043-9417-261300096529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:04.577951 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8471242-89be-4043-9417-261300096529 None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:04.578444 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8471242-89be-4043-9417-261300096529 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:04.578571 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8471242-89be-4043-9417-261300096529 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:04.579262 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8471242-89be-4043-9417-261300096529 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:04.580660 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8471242-89be-4043-9417-261300096529 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:04.612578 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 468/919] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:15:04 2022] POST /identity/v3/endpoints => generated 346 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:15:04.641630 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 452/920] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:15:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:15:04.925262 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8471242-89be-4043-9417-261300096529 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:04.943102 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:05.039601 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8471242-89be-4043-9417-261300096529 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:05.074710 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dcca9e-436b-4050-9980-031be55dc504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:05.075358 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dcca9e-436b-4050-9980-031be55dc504 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:05.075637 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dcca9e-436b-4050-9980-031be55dc504 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:05.075909 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dcca9e-436b-4050-9980-031be55dc504 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:05.076529 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dcca9e-436b-4050-9980-031be55dc504 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:05.077901 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dcca9e-436b-4050-9980-031be55dc504 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:05.087692 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-b3dcca9e-436b-4050-9980-031be55dc504 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 22:15:05.087692 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:05.087692 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:15:05.087692 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:15:05.087692 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:15:05.087692 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:15:05.087692 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:15:05.087692 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:15:05.087692 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 22:15:05.087692 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:15:05.087692 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:15:05.087692 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:15:05.087692 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:05.087692 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:15:05.087692 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:15:05.087692 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:15:05.087692 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:15:05.088772 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:15:05.088772 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:15:05.088772 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:15:05.088772 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:15:05.088772 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:15:05.088772 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:15:05.088772 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:15:05.088772 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:15:05.088772 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:15:05.088772 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:15:05.088772 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:15:05.088772 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:15:05.088772 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:15:05.088772 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:15:05.088772 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:15:05.088772 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:15:05.090169 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:15:05.090169 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:15:05.090169 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:15:05.090169 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:15:05.090169 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:15:05.090169 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:15:05.090169 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:15:05.090169 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:15:05.090169 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:15:05.090169 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:15:05.090169 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:15:05.090169 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:15:05.090169 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 22:15:05.090169 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:15:05.090169 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 469/921] 10.222.0.36 () {56 vars in 1126 bytes} [Mon Aug 29 22:15:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:15:05.094921 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7c2c8-5c59-434b-87c1-3e6cdf1edb44 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:05.201777 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7c2c8-5c59-434b-87c1-3e6cdf1edb44 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:05.238261 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87cce0c-9216-4faf-a241-74e924d0305b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:05.239344 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87cce0c-9216-4faf-a241-74e924d0305b None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:05.239846 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87cce0c-9216-4faf-a241-74e924d0305b None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:05.240325 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87cce0c-9216-4faf-a241-74e924d0305b None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:05.241204 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87cce0c-9216-4faf-a241-74e924d0305b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:05.241717 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87cce0c-9216-4faf-a241-74e924d0305b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:05.243498 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87cce0c-9216-4faf-a241-74e924d0305b None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:05.249344 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 453/922] 10.222.0.36 () {56 vars in 1122 bytes} [Mon Aug 29 22:15:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:05.260474 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dcca9e-436b-4050-9980-031be55dc504 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:05.337874 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff392510-9c55-4471-8a0e-dfe34b8dd1d5 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:05.338188 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff392510-9c55-4471-8a0e-dfe34b8dd1d5 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:05.338440 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff392510-9c55-4471-8a0e-dfe34b8dd1d5 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:05.339984 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 454/923] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:15:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:15:05.344351 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:05.347799 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64435ce-f5a1-4252-a936-d06f3032594c None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:05.348092 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64435ce-f5a1-4252-a936-d06f3032594c None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:05.348372 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64435ce-f5a1-4252-a936-d06f3032594c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:05.363784 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:05.370213 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-c64435ce-f5a1-4252-a936-d06f3032594c None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:15:05.371713 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c64435ce-f5a1-4252-a936-d06f3032594c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:15:05.374993 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dcca9e-436b-4050-9980-031be55dc504 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:05.417145 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac75700-68b5-4e30-a0cd-96026b695700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:05.417796 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac75700-68b5-4e30-a0cd-96026b695700 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:05.418074 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac75700-68b5-4e30-a0cd-96026b695700 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:05.418347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac75700-68b5-4e30-a0cd-96026b695700 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:05.418978 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac75700-68b5-4e30-a0cd-96026b695700 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:05.419278 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac75700-68b5-4e30-a0cd-96026b695700 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:05.421082 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac75700-68b5-4e30-a0cd-96026b695700 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:05.432548 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 470/924] 10.222.0.36 () {56 vars in 1122 bytes} [Mon Aug 29 22:15:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:05.433863 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a576c-4e31-4a0c-85a2-f6e9e2c80552 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:05.434163 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a576c-4e31-4a0c-85a2-f6e9e2c80552 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:05.434468 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a576c-4e31-4a0c-85a2-f6e9e2c80552 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:05.436613 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 471/925] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:15:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:15:05.436741 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87a576c-4e31-4a0c-85a2-f6e9e2c80552 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:05.449032 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 455/926] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:15:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:15:05.450523 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d00988-c1b0-4907-9b15-dd9593692400 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:05.450807 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d00988-c1b0-4907-9b15-dd9593692400 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:05.451076 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d00988-c1b0-4907-9b15-dd9593692400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:05.470108 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-25d00988-c1b0-4907-9b15-dd9593692400 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:15:05.471286 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-25d00988-c1b0-4907-9b15-dd9593692400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:15:05.552540 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 456/927] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:15:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:15:05.576371 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87a576c-4e31-4a0c-85a2-f6e9e2c80552 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:05.610512 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a2ed99-5e37-4d58-8fa0-4a06f2657ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:05.611216 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2ed99-5e37-4d58-8fa0-4a06f2657ff7 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:05.611548 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2ed99-5e37-4d58-8fa0-4a06f2657ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:05.611823 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2ed99-5e37-4d58-8fa0-4a06f2657ff7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:05.612672 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a2ed99-5e37-4d58-8fa0-4a06f2657ff7 None admin] RBAC: Adding query filter params (interface=public, service_id=8636d8aa11094ac7bcfe8ff9fedec612, region_id=RegionOne) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:05.612990 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a2ed99-5e37-4d58-8fa0-4a06f2657ff7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:05.614421 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a2ed99-5e37-4d58-8fa0-4a06f2657ff7 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:05.620316 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 472/928] 10.222.0.36 () {56 vars in 1251 bytes} [Mon Aug 29 22:15:05 2022] GET /identity/v3/endpoints?service_id=8636d8aa11094ac7bcfe8ff9fedec612&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:05.625759 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d00988-c1b0-4907-9b15-dd9593692400 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:05.698904 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:05.731284 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a2ed99-5e37-4d58-8fa0-4a06f2657ff7 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:05.738082 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d00988-c1b0-4907-9b15-dd9593692400 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:05.744256 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:05.783355 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8db03c-5667-403e-a4cb-5bbe997c454a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:05.784400 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8db03c-5667-403e-a4cb-5bbe997c454a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:05.784864 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8db03c-5667-403e-a4cb-5bbe997c454a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:05.785379 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8db03c-5667-403e-a4cb-5bbe997c454a None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:05.786416 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8db03c-5667-403e-a4cb-5bbe997c454a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:05.787986 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8db03c-5667-403e-a4cb-5bbe997c454a None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:05.800876 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 457/929] 10.222.0.36 () {56 vars in 1087 bytes} [Mon Aug 29 22:15:05 2022] GET /identity/v3/services => generated 1497 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:15:05.835857 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8db03c-5667-403e-a4cb-5bbe997c454a None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:05.852146 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a2ed99-5e37-4d58-8fa0-4a06f2657ff7 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:05.900801 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da8c4b-52c4-4511-843f-e586c5db8eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:05.901939 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da8c4b-52c4-4511-843f-e586c5db8eeb None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:05.902421 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da8c4b-52c4-4511-843f-e586c5db8eeb None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:05.902918 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da8c4b-52c4-4511-843f-e586c5db8eeb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:05.916932 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7da8c4b-52c4-4511-843f-e586c5db8eeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:15:05.923233 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-c7da8c4b-52c4-4511-843f-e586c5db8eeb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 22:15:05.923233 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:05.923233 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:15:05.923233 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:15:05.923233 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:15:05.923233 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:15:05.923233 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:15:05.923233 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:15:05.923233 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:15:05.923233 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:15:05.923233 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:15:05.923233 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:15:05.923233 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:15:05.923233 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:15:05.923233 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:15:05.923233 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:15:05.924495 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:15:05.924495 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:15:05.924495 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:15:05.924495 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:15:05.924495 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:15:05.924495 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:15:05.924495 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:15:05.924495 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:15:05.924495 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:15:05.924495 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:15:05.924495 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:15:05.924495 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:15:05.924495 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:15:05.924495 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:15:05.924495 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:15:05.924495 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:15:05.926059 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:15:05.926059 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:15:05.926059 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:15:05.926059 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:15:05.926059 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:15:05.926059 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:15:05.926059 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:15:05.926059 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:15:05.926059 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:15:05.926059 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:15:05.926059 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 22:15:05.926059 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:15:05.929772 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 473/930] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Aug 29 22:15:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:15:05.938266 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da8c4b-52c4-4511-843f-e586c5db8eeb None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:05.994675 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8db03c-5667-403e-a4cb-5bbe997c454a None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:06.021172 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:06.035307 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:06.043026 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ec8fe-bd2b-4367-bc3b-03efb8f9ae43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:06.043673 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ec8fe-bd2b-4367-bc3b-03efb8f9ae43 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:06.044056 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ec8fe-bd2b-4367-bc3b-03efb8f9ae43 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:06.044330 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ec8fe-bd2b-4367-bc3b-03efb8f9ae43 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:06.045060 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ec8fe-bd2b-4367-bc3b-03efb8f9ae43 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:06.046432 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ec8fe-bd2b-4367-bc3b-03efb8f9ae43 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:06.056291 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-113ec8fe-bd2b-4367-bc3b-03efb8f9ae43 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 22:15:06.056291 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:06.056291 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:15:06.056291 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:15:06.056291 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:15:06.056291 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:15:06.056291 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:15:06.056291 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:15:06.056291 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 22:15:06.056291 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:15:06.056291 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:15:06.056291 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:15:06.056291 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:06.056291 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:15:06.056291 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:15:06.056291 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:15:06.057310 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:15:06.057310 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:15:06.057310 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:15:06.057310 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:15:06.057310 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:15:06.057310 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:15:06.057310 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:15:06.057310 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:15:06.057310 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:15:06.057310 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:15:06.057310 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:15:06.057310 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:15:06.057310 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:15:06.057310 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:15:06.057310 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:15:06.057310 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:15:06.057310 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:15:06.058225 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:15:06.058225 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:15:06.058225 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:15:06.058225 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:15:06.058225 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:15:06.058225 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:15:06.058225 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:15:06.058225 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:15:06.058225 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:15:06.058225 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:15:06.058225 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:15:06.058225 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:15:06.058225 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 22:15:06.058225 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:15:06.058225 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 458/931] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Aug 29 22:15:05 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:15:06.063423 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ec8fe-bd2b-4367-bc3b-03efb8f9ae43 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:06.067246 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da8c4b-52c4-4511-843f-e586c5db8eeb None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:06.113946 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a4e32-edef-4146-9e85-c0efc17b0b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:06.114732 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a4e32-edef-4146-9e85-c0efc17b0b67 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:06.115324 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a4e32-edef-4146-9e85-c0efc17b0b67 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:06.115691 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a4e32-edef-4146-9e85-c0efc17b0b67 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:06.116905 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06a4e32-edef-4146-9e85-c0efc17b0b67 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:06.117436 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06a4e32-edef-4146-9e85-c0efc17b0b67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:06.119455 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06a4e32-edef-4146-9e85-c0efc17b0b67 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:06.131420 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 474/932] 10.222.0.36 () {56 vars in 1115 bytes} [Mon Aug 29 22:15:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:15:06.137530 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a4e32-edef-4146-9e85-c0efc17b0b67 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:06.173120 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ec8fe-bd2b-4367-bc3b-03efb8f9ae43 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:06.209811 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac7d36-119f-4614-8cc5-e3b195fcc5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:06.210540 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac7d36-119f-4614-8cc5-e3b195fcc5f4 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:06.211052 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac7d36-119f-4614-8cc5-e3b195fcc5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:06.211806 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac7d36-119f-4614-8cc5-e3b195fcc5f4 None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:06.212318 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfac7d36-119f-4614-8cc5-e3b195fcc5f4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:06.212732 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfac7d36-119f-4614-8cc5-e3b195fcc5f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:06.214229 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfac7d36-119f-4614-8cc5-e3b195fcc5f4 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:06.219780 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 459/933] 10.222.0.36 () {56 vars in 1126 bytes} [Mon Aug 29 22:15:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:15:06.225942 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac7d36-119f-4614-8cc5-e3b195fcc5f4 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:06.245661 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a4e32-edef-4146-9e85-c0efc17b0b67 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:06.276156 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:06.285675 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c2607e-f9d7-4321-8fc8-3bee10efdbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:06.286673 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c2607e-f9d7-4321-8fc8-3bee10efdbc3 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:06.287154 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c2607e-f9d7-4321-8fc8-3bee10efdbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:06.287603 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c2607e-f9d7-4321-8fc8-3bee10efdbc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:06.299647 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c2607e-f9d7-4321-8fc8-3bee10efdbc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:06.301474 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c2607e-f9d7-4321-8fc8-3bee10efdbc3 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:06.309037 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:06.318888 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-50c2607e-f9d7-4321-8fc8-3bee10efdbc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:15:06.318888 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:06.318888 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:15:06.318888 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:15:06.318888 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:15:06.318888 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:15:06.318888 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:15:06.318888 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:15:06.318888 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:15:06.318888 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:15:06.318888 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:15:06.318888 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:15:06.318888 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:15:06.318888 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:15:06.318888 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:15:06.318888 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:15:06.319883 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:15:06.319883 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:15:06.319883 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:15:06.319883 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:15:06.319883 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:15:06.319883 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:15:06.319883 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:15:06.319883 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:15:06.319883 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:15:06.319883 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:15:06.319883 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:15:06.319883 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:15:06.319883 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:15:06.319883 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:15:06.319883 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:15:06.319883 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:15:06.319883 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:15:06.321924 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:15:06.321924 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:15:06.321924 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:15:06.324144 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 475/934] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:15:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:15:06.330095 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c2607e-f9d7-4321-8fc8-3bee10efdbc3 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:06.364281 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac7d36-119f-4614-8cc5-e3b195fcc5f4 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:06.409234 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1cc41-e33d-4334-826b-07e9aaeecb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:06.409994 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1cc41-e33d-4334-826b-07e9aaeecb6c None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:06.410316 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1cc41-e33d-4334-826b-07e9aaeecb6c None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:06.410591 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1cc41-e33d-4334-826b-07e9aaeecb6c None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:06.411288 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b1cc41-e33d-4334-826b-07e9aaeecb6c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:06.411592 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b1cc41-e33d-4334-826b-07e9aaeecb6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:06.414177 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b1cc41-e33d-4334-826b-07e9aaeecb6c None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:06.420077 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 460/935] 10.222.0.36 () {56 vars in 1126 bytes} [Mon Aug 29 22:15:06 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:06.425967 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1cc41-e33d-4334-826b-07e9aaeecb6c None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:06.450344 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c2607e-f9d7-4321-8fc8-3bee10efdbc3 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:06.494522 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db487bc-059a-48fa-acd5-7320cf97bb94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:06.495254 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db487bc-059a-48fa-acd5-7320cf97bb94 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:06.495597 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db487bc-059a-48fa-acd5-7320cf97bb94 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:06.496145 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db487bc-059a-48fa-acd5-7320cf97bb94 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:06.496985 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db487bc-059a-48fa-acd5-7320cf97bb94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:06.497719 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db487bc-059a-48fa-acd5-7320cf97bb94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:06.499456 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db487bc-059a-48fa-acd5-7320cf97bb94 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:06.516487 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 476/936] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:15:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:15:06.522010 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db487bc-059a-48fa-acd5-7320cf97bb94 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:06.558721 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1cc41-e33d-4334-826b-07e9aaeecb6c None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:06.568733 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:06.595072 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:06.608776 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e2e361-ff7c-4eaa-9928-82b11d78d112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:06.609700 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2e361-ff7c-4eaa-9928-82b11d78d112 None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:06.609983 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2e361-ff7c-4eaa-9928-82b11d78d112 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:06.610254 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2e361-ff7c-4eaa-9928-82b11d78d112 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:06.610918 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e2e361-ff7c-4eaa-9928-82b11d78d112 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:06.612640 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e2e361-ff7c-4eaa-9928-82b11d78d112 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:06.636766 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 461/937] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:15:06 2022] POST /identity/v3/endpoints => generated 347 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:15:06.637613 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db487bc-059a-48fa-acd5-7320cf97bb94 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:06.638114 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5449c8-75b9-4db4-86b2-590bd757e94d None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:06.638407 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5449c8-75b9-4db4-86b2-590bd757e94d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:06.638682 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5449c8-75b9-4db4-86b2-590bd757e94d None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:06.640496 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 462/938] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:15:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:15:06.646548 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b9907-9aff-4ac3-9880-af7941f95daa None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:06.647177 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b9907-9aff-4ac3-9880-af7941f95daa None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:06.647652 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b9907-9aff-4ac3-9880-af7941f95daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:06.671809 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-853b9907-9aff-4ac3-9880-af7941f95daa None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:15:06.673571 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-853b9907-9aff-4ac3-9880-af7941f95daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:15:06.692967 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14bc764-d57c-480b-a45a-abb0a5dee0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:06.694317 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14bc764-d57c-480b-a45a-abb0a5dee0da None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:06.695150 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14bc764-d57c-480b-a45a-abb0a5dee0da None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:06.696218 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14bc764-d57c-480b-a45a-abb0a5dee0da None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:06.708185 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14bc764-d57c-480b-a45a-abb0a5dee0da None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:06.710706 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14bc764-d57c-480b-a45a-abb0a5dee0da None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:06.727025 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-c14bc764-d57c-480b-a45a-abb0a5dee0da None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 22:15:06.727025 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:06.727025 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:15:06.727025 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:15:06.727025 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:15:06.727025 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:15:06.727025 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:15:06.727025 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:15:06.727025 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:15:06.727025 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:15:06.727025 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:15:06.727025 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:15:06.727025 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:15:06.727025 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:15:06.727025 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:15:06.727025 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:15:06.728347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:15:06.728347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:15:06.728347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:15:06.728347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:15:06.728347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:15:06.728347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:15:06.728347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:15:06.728347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:15:06.728347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:15:06.728347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:15:06.728347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:15:06.728347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:15:06.728347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:15:06.728347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:15:06.728347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:15:06.728347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:15:06.728347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:15:06.728347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:15:06.729577 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:15:06.729577 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:15:06.729577 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:15:06.729577 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:15:06.729577 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:15:06.729577 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:15:06.729577 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:15:06.729577 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:15:06.729577 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 22:15:06.729577 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:15:06.732653 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 477/939] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Aug 29 22:15:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:15:06.738644 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14bc764-d57c-480b-a45a-abb0a5dee0da None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:06.780591 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 463/940] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:15:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:15:06.849804 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:06.860315 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14bc764-d57c-480b-a45a-abb0a5dee0da None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:06.899032 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd1a4e-a8c2-4baa-8aa1-dd1c2b4f665a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:06.899845 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd1a4e-a8c2-4baa-8aa1-dd1c2b4f665a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:06.900227 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd1a4e-a8c2-4baa-8aa1-dd1c2b4f665a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:06.900638 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd1a4e-a8c2-4baa-8aa1-dd1c2b4f665a None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:06.901485 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cd1a4e-a8c2-4baa-8aa1-dd1c2b4f665a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:06.901894 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cd1a4e-a8c2-4baa-8aa1-dd1c2b4f665a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:06.903435 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cd1a4e-a8c2-4baa-8aa1-dd1c2b4f665a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:06.923566 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 478/941] 10.222.0.36 () {56 vars in 1149 bytes} [Mon Aug 29 22:15:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:15:06.929412 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b9907-9aff-4ac3-9880-af7941f95daa None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:07.042230 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b9907-9aff-4ac3-9880-af7941f95daa None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:07.049268 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd1a4e-a8c2-4baa-8aa1-dd1c2b4f665a None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:07.052920 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:07.090350 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcaab4d-2fa4-4fc6-8dab-d4ccd86e23e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:07.092048 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcaab4d-2fa4-4fc6-8dab-d4ccd86e23e3 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:07.092429 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcaab4d-2fa4-4fc6-8dab-d4ccd86e23e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:07.092819 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcaab4d-2fa4-4fc6-8dab-d4ccd86e23e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:07.106764 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcaab4d-2fa4-4fc6-8dab-d4ccd86e23e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:07.108985 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcaab4d-2fa4-4fc6-8dab-d4ccd86e23e3 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:07.129573 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-6bcaab4d-2fa4-4fc6-8dab-d4ccd86e23e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:15:07.129573 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:07.129573 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:15:07.129573 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:15:07.129573 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:15:07.129573 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:15:07.129573 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:15:07.129573 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:15:07.129573 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:15:07.129573 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:15:07.129573 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:15:07.129573 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:15:07.129573 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:15:07.129573 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:15:07.129573 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:15:07.129573 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:15:07.130806 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:15:07.130806 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:15:07.130806 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:15:07.130806 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:15:07.130806 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:15:07.130806 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:15:07.130806 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:15:07.130806 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:15:07.130806 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:15:07.130806 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:15:07.130806 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:15:07.130806 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:15:07.130806 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:15:07.130806 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:15:07.130806 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:15:07.130806 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:15:07.130806 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:15:07.131922 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:15:07.131922 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:15:07.131922 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:15:07.134465 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 464/942] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:15:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:15:07.140870 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcaab4d-2fa4-4fc6-8dab-d4ccd86e23e3 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:07.167125 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd1a4e-a8c2-4baa-8aa1-dd1c2b4f665a None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:07.204876 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfee73-d1f2-46a5-aebf-584028e08f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:07.205870 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfee73-d1f2-46a5-aebf-584028e08f67 None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:07.206298 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfee73-d1f2-46a5-aebf-584028e08f67 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:07.206713 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfee73-d1f2-46a5-aebf-584028e08f67 None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:07.207663 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cfee73-d1f2-46a5-aebf-584028e08f67 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:07.209488 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cfee73-d1f2-46a5-aebf-584028e08f67 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:07.212622 dv-cinder-854268-3-smb devstack@keystone.service[81515]: WARNING keystone.server.flask.common [None req-e5cfee73-d1f2-46a5-aebf-584028e08f67 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 29 22:15:07.233498 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.sql.core [None req-e5cfee73-d1f2-46a5-aebf-584028e08f67 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 29 22:15:07.233498 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 29 22:15:07.233498 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [parameters: {'id': 'c58e057dd71f4cbc8621a80dc57f46c1', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 29 22:15:07.233498 dv-cinder-854268-3-smb devstack@keystone.service[81515]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81515) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 22:15:07.250363 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-e5cfee73-d1f2-46a5-aebf-584028e08f67 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c58e057dd71f4cbc8621a80dc57f46c1.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c58e057dd71f4cbc8621a80dc57f46c1. Aug 29 22:15:07.250363 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:07.250363 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 22:15:07.250363 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 22:15:07.250363 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 22:15:07.250363 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 22:15:07.250363 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 22:15:07.250363 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 22:15:07.250363 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 22:15:07.250363 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application conn.query(q) Aug 29 22:15:07.250363 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 22:15:07.250363 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 22:15:07.250363 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 22:15:07.251321 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application result.read() Aug 29 22:15:07.251321 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 22:15:07.251321 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 22:15:07.251321 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 22:15:07.251321 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 22:15:07.251321 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 22:15:07.251321 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 22:15:07.251321 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 22:15:07.251321 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 22:15:07.251321 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 29 22:15:07.251321 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:15:07.251321 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 29 22:15:07.251321 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:15:07.251321 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:07.251321 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 29 22:15:07.251321 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 29 22:15:07.251321 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 29 22:15:07.251321 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 29 22:15:07.252347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 22:15:07.252347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application next(self.gen) Aug 29 22:15:07.252347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 29 22:15:07.252347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application yield resource Aug 29 22:15:07.252347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 22:15:07.252347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application next(self.gen) Aug 29 22:15:07.252347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 29 22:15:07.252347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self.session.rollback() Aug 29 22:15:07.252347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 22:15:07.252347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self.force_reraise() Aug 29 22:15:07.252347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 22:15:07.252347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise self.value Aug 29 22:15:07.252347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 29 22:15:07.252347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 29 22:15:07.252347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 29 22:15:07.252347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application session.commit() Aug 29 22:15:07.252347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 29 22:15:07.253798 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 29 22:15:07.253798 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 29 22:15:07.253798 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._prepare_impl() Aug 29 22:15:07.253798 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 29 22:15:07.253798 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self.session.flush() Aug 29 22:15:07.253798 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 22:15:07.253798 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._flush(objects) Aug 29 22:15:07.253798 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 22:15:07.253798 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 29 22:15:07.253798 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 22:15:07.253798 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application compat.raise_( Aug 29 22:15:07.253798 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 22:15:07.253798 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception Aug 29 22:15:07.253798 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 22:15:07.253798 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application flush_context.execute() Aug 29 22:15:07.253798 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 22:15:07.253798 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rec.execute(self) Aug 29 22:15:07.254716 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 22:15:07.254716 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 29 22:15:07.254716 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 22:15:07.254716 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 29 22:15:07.254716 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 29 22:15:07.254716 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 29 22:15:07.254716 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 22:15:07.254716 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 22:15:07.254716 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 22:15:07.254716 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 29 22:15:07.254716 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 22:15:07.254716 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 29 22:15:07.254716 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 22:15:07.254716 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 29 22:15:07.254716 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 22:15:07.255544 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 22:15:07.255544 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 22:15:07.255544 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception Aug 29 22:15:07.255544 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 22:15:07.255544 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 22:15:07.255544 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 22:15:07.255544 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 22:15:07.255544 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 22:15:07.255544 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 22:15:07.255544 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 22:15:07.255544 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application conn.query(q) Aug 29 22:15:07.255544 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 22:15:07.255544 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 22:15:07.255544 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 22:15:07.255544 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application result.read() Aug 29 22:15:07.255544 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 22:15:07.255544 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 22:15:07.257688 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 22:15:07.257688 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 22:15:07.257688 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 22:15:07.257688 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 22:15:07.257688 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 22:15:07.257688 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 22:15:07.257688 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 29 22:15:07.257688 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 29 22:15:07.257688 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [parameters: {'id': 'c58e057dd71f4cbc8621a80dc57f46c1', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 29 22:15:07.257688 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 22:15:07.257688 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:15:07.257688 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:15:07.257688 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:15:07.257688 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:07.257688 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 29 22:15:07.260337 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 29 22:15:07.260337 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 29 22:15:07.260337 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 29 22:15:07.260337 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 29 22:15:07.260337 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:15:07.260337 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:15:07.260337 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:15:07.260337 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:07.260337 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:15:07.260337 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:15:07.260337 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:15:07.260337 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:15:07.260337 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:15:07.260337 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:15:07.260337 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:15:07.260337 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:15:07.260337 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:15:07.264681 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:15:07.264681 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 29 22:15:07.264681 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 29 22:15:07.264681 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:15:07.264681 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:15:07.264681 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 29 22:15:07.264681 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 29 22:15:07.264681 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c58e057dd71f4cbc8621a80dc57f46c1. Aug 29 22:15:07.264681 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:15:07.264681 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 479/943] 10.222.0.36 () {60 vars in 1140 bytes} [Mon Aug 29 22:15:07 2022] POST /identity/v3/projects => generated 262 bytes in 208 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:15:07.264681 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfee73-d1f2-46a5-aebf-584028e08f67 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:07.272309 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:07.301710 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcaab4d-2fa4-4fc6-8dab-d4ccd86e23e3 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:07.349167 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245fc7a-e6e4-4c45-9de9-5716bb22cc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:07.350420 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245fc7a-e6e4-4c45-9de9-5716bb22cc3b None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:07.351422 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245fc7a-e6e4-4c45-9de9-5716bb22cc3b None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:07.352054 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245fc7a-e6e4-4c45-9de9-5716bb22cc3b None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:07.353321 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b245fc7a-e6e4-4c45-9de9-5716bb22cc3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:07.353811 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b245fc7a-e6e4-4c45-9de9-5716bb22cc3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:07.356011 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b245fc7a-e6e4-4c45-9de9-5716bb22cc3b None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:07.372741 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfee73-d1f2-46a5-aebf-584028e08f67 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:07.380339 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 465/944] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:15:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:07.381122 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245fc7a-e6e4-4c45-9de9-5716bb22cc3b None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:07.416248 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:07.417911 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f7f01-cb75-40d9-83a1-c4ca348b4f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:07.418647 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f7f01-cb75-40d9-83a1-c4ca348b4f8c None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:07.418930 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f7f01-cb75-40d9-83a1-c4ca348b4f8c None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:07.419205 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f7f01-cb75-40d9-83a1-c4ca348b4f8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:07.427760 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f7f01-cb75-40d9-83a1-c4ca348b4f8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:07.429673 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f7f01-cb75-40d9-83a1-c4ca348b4f8c None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:07.442655 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-063f7f01-cb75-40d9-83a1-c4ca348b4f8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:15:07.442655 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:07.442655 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:15:07.442655 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:15:07.442655 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:15:07.442655 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:15:07.442655 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:15:07.442655 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:15:07.442655 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:15:07.442655 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:15:07.442655 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:15:07.442655 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:15:07.442655 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:15:07.442655 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:15:07.442655 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:15:07.443666 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:15:07.443666 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:15:07.443666 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:15:07.443666 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:15:07.443666 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:15:07.443666 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:15:07.443666 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:15:07.443666 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:15:07.443666 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:15:07.443666 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:15:07.443666 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:15:07.443666 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:15:07.443666 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:15:07.443666 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:15:07.443666 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:15:07.443666 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:15:07.443666 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:15:07.444878 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:15:07.444878 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:15:07.444878 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:15:07.444878 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:15:07.444878 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:15:07.444878 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:15:07.444878 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:15:07.444878 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:15:07.448892 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 480/945] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Aug 29 22:15:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:15:07.450236 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f7f01-cb75-40d9-83a1-c4ca348b4f8c None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:07.517982 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245fc7a-e6e4-4c45-9de9-5716bb22cc3b None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:07.537861 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:07.554116 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc5c3b-a44e-4cb9-9f63-9f35f3eed411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:07.554758 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc5c3b-a44e-4cb9-9f63-9f35f3eed411 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:07.555046 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc5c3b-a44e-4cb9-9f63-9f35f3eed411 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:07.555322 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc5c3b-a44e-4cb9-9f63-9f35f3eed411 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:07.562475 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bc5c3b-a44e-4cb9-9f63-9f35f3eed411 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:07.563936 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bc5c3b-a44e-4cb9-9f63-9f35f3eed411 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:07.576564 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-03bc5c3b-a44e-4cb9-9f63-9f35f3eed411 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:15:07.576564 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:07.576564 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:15:07.576564 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:15:07.576564 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:15:07.576564 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:15:07.576564 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:15:07.576564 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:15:07.576564 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:15:07.576564 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:15:07.576564 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:15:07.576564 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:15:07.576564 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:15:07.576564 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:15:07.576564 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:15:07.577528 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:15:07.577528 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:15:07.577528 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:15:07.577528 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:15:07.577528 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:15:07.577528 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:15:07.577528 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:15:07.577528 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:15:07.577528 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:15:07.577528 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:15:07.577528 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:15:07.577528 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:15:07.577528 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:15:07.577528 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:15:07.577528 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:15:07.577528 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:15:07.577528 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:15:07.578518 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:15:07.578518 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:15:07.578518 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:15:07.578518 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:15:07.578518 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:15:07.578518 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:15:07.578518 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:15:07.578518 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:15:07.582538 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 466/946] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Aug 29 22:15:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:15:07.583380 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc5c3b-a44e-4cb9-9f63-9f35f3eed411 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:07.584551 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f7f01-cb75-40d9-83a1-c4ca348b4f8c None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:07.627560 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26968122-b00b-434a-9bb4-e284fc4212bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:07.628600 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26968122-b00b-434a-9bb4-e284fc4212bd None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:07.629083 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26968122-b00b-434a-9bb4-e284fc4212bd None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:07.630006 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26968122-b00b-434a-9bb4-e284fc4212bd None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:07.630907 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26968122-b00b-434a-9bb4-e284fc4212bd None admin] RBAC: Adding query filter params (name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:07.631414 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26968122-b00b-434a-9bb4-e284fc4212bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:07.634097 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26968122-b00b-434a-9bb4-e284fc4212bd None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:07.664952 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 481/947] 10.222.0.36 () {56 vars in 1112 bytes} [Mon Aug 29 22:15:07 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:07.683019 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:07.706358 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc5c3b-a44e-4cb9-9f63-9f35f3eed411 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:07.746714 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79fda2f-386d-44ff-9d9d-b4cb2133779a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:07.747399 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fda2f-386d-44ff-9d9d-b4cb2133779a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:07.747685 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fda2f-386d-44ff-9d9d-b4cb2133779a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:07.747960 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fda2f-386d-44ff-9d9d-b4cb2133779a None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:07.748741 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79fda2f-386d-44ff-9d9d-b4cb2133779a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:07.749055 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79fda2f-386d-44ff-9d9d-b4cb2133779a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:07.750542 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79fda2f-386d-44ff-9d9d-b4cb2133779a None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:07.765724 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 467/948] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Aug 29 22:15:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:07.771776 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26968122-b00b-434a-9bb4-e284fc4212bd None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:07.799820 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ea578-e0d0-4ec8-ba5e-a70d4cb6e54f None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:07.800197 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ea578-e0d0-4ec8-ba5e-a70d4cb6e54f None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:07.800432 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ea578-e0d0-4ec8-ba5e-a70d4cb6e54f None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:07.802144 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 468/949] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:15:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:15:07.809004 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c14205-ddf4-4616-a961-32ba14f9f6bf None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:07.809616 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c14205-ddf4-4616-a961-32ba14f9f6bf None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:07.810097 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c14205-ddf4-4616-a961-32ba14f9f6bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:07.832189 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-54c14205-ddf4-4616-a961-32ba14f9f6bf None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:15:07.834228 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-54c14205-ddf4-4616-a961-32ba14f9f6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:15:07.909377 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26968122-b00b-434a-9bb4-e284fc4212bd None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:07.929229 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 469/950] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:15:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:15:07.954652 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:07.959336 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad904f-4b0b-4991-9bd5-f806c4e1faf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:07.960537 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad904f-4b0b-4991-9bd5-f806c4e1faf3 None admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:07.961082 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad904f-4b0b-4991-9bd5-f806c4e1faf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:07.961577 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad904f-4b0b-4991-9bd5-f806c4e1faf3 None admin] PATH_INFO: `/v3/projects/696ed25cc0cb43fab4bfaf762a90da54/users/b32922d090564162810dd8b28c3a322b/roles/1689c28a8f8945838ea7fd3cb4cfc598` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:07.964038 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ad904f-4b0b-4991-9bd5-f806c4e1faf3 None admin] RBAC: Authorizing `identity:create_grant(project_id=696ed25cc0cb43fab4bfaf762a90da54, user_id=b32922d090564162810dd8b28c3a322b, role_id=1689c28a8f8945838ea7fd3cb4cfc598)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:07.965690 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ad904f-4b0b-4991-9bd5-f806c4e1faf3 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:07.980596 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 482/951] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Aug 29 22:15:07 2022] PUT /identity/v3/projects/696ed25cc0cb43fab4bfaf762a90da54/users/b32922d090564162810dd8b28c3a322b/roles/1689c28a8f8945838ea7fd3cb4cfc598 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:15:08.205237 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c14205-ddf4-4616-a961-32ba14f9f6bf None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:08.278792 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:08.310977 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c14205-ddf4-4616-a961-32ba14f9f6bf None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:08.346630 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3de8ab-126c-4e8c-a112-07abac2cf7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:08.347265 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3de8ab-126c-4e8c-a112-07abac2cf7ed None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:08.347540 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3de8ab-126c-4e8c-a112-07abac2cf7ed None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:08.347808 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3de8ab-126c-4e8c-a112-07abac2cf7ed None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:08.348390 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3de8ab-126c-4e8c-a112-07abac2cf7ed None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:08.349847 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3de8ab-126c-4e8c-a112-07abac2cf7ed None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:08.358984 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-bf3de8ab-126c-4e8c-a112-07abac2cf7ed None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 22:15:08.358984 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:08.358984 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:15:08.358984 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:15:08.358984 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:15:08.358984 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:15:08.358984 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:15:08.358984 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:15:08.358984 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 22:15:08.358984 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:15:08.358984 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:15:08.358984 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:15:08.358984 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:08.358984 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:15:08.358984 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:15:08.358984 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:15:08.358984 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:15:08.360073 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:15:08.360073 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:15:08.360073 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:15:08.360073 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:15:08.360073 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:15:08.360073 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:15:08.360073 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:15:08.360073 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:15:08.360073 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:15:08.360073 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:15:08.360073 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:15:08.360073 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:15:08.360073 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:15:08.360073 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:15:08.360073 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:15:08.360073 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:15:08.360998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:15:08.360998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:15:08.360998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:15:08.360998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:15:08.360998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:15:08.360998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:15:08.360998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:15:08.360998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:15:08.360998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:15:08.360998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:15:08.360998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:15:08.360998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:15:08.360998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 22:15:08.360998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:15:08.360998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 470/952] 10.222.0.36 () {56 vars in 1126 bytes} [Mon Aug 29 22:15:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:15:08.368693 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad904f-4b0b-4991-9bd5-f806c4e1faf3 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:08.482154 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad904f-4b0b-4991-9bd5-f806c4e1faf3 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:08.517447 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8cf3b8-3c3d-4d05-a220-6d59db0280a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:08.518103 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8cf3b8-3c3d-4d05-a220-6d59db0280a0 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:08.518381 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8cf3b8-3c3d-4d05-a220-6d59db0280a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:08.518695 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8cf3b8-3c3d-4d05-a220-6d59db0280a0 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:08.519333 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8cf3b8-3c3d-4d05-a220-6d59db0280a0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:08.519630 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8cf3b8-3c3d-4d05-a220-6d59db0280a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:08.521029 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8cf3b8-3c3d-4d05-a220-6d59db0280a0 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:08.526506 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 483/953] 10.222.0.36 () {56 vars in 1122 bytes} [Mon Aug 29 22:15:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:08.532288 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3de8ab-126c-4e8c-a112-07abac2cf7ed None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:08.634039 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3de8ab-126c-4e8c-a112-07abac2cf7ed None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:08.650159 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eed86c-6691-4189-9497-7dcd11f32cc4 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:08.650685 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eed86c-6691-4189-9497-7dcd11f32cc4 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:08.650685 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eed86c-6691-4189-9497-7dcd11f32cc4 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:08.652757 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 484/954] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:15:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:15:08.661052 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb2d4d-0d24-43d5-90cc-26d8c25d48b9 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:08.661441 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb2d4d-0d24-43d5-90cc-26d8c25d48b9 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:08.662118 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb2d4d-0d24-43d5-90cc-26d8c25d48b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:08.671978 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a2f7f5-ffe4-4ee9-82ba-f816da44dbe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:08.672622 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2f7f5-ffe4-4ee9-82ba-f816da44dbe0 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:08.672904 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2f7f5-ffe4-4ee9-82ba-f816da44dbe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:08.673178 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2f7f5-ffe4-4ee9-82ba-f816da44dbe0 None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:08.673959 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a2f7f5-ffe4-4ee9-82ba-f816da44dbe0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:08.674434 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a2f7f5-ffe4-4ee9-82ba-f816da44dbe0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:08.675963 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a2f7f5-ffe4-4ee9-82ba-f816da44dbe0 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:08.677437 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:08.682938 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 471/955] 10.222.0.36 () {56 vars in 1122 bytes} [Mon Aug 29 22:15:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:08.684829 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-eecb2d4d-0d24-43d5-90cc-26d8c25d48b9 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:15:08.686353 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-eecb2d4d-0d24-43d5-90cc-26d8c25d48b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:15:08.689413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a2f7f5-ffe4-4ee9-82ba-f816da44dbe0 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:08.750664 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:08.784828 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 485/956] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:15:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:15:08.828291 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a2f7f5-ffe4-4ee9-82ba-f816da44dbe0 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:08.866827 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97386e77-28f7-4b58-b372-a78ee7a2f310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:08.867862 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97386e77-28f7-4b58-b372-a78ee7a2f310 None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:08.867862 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97386e77-28f7-4b58-b372-a78ee7a2f310 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:08.868146 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97386e77-28f7-4b58-b372-a78ee7a2f310 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:08.868848 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97386e77-28f7-4b58-b372-a78ee7a2f310 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:08.870278 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97386e77-28f7-4b58-b372-a78ee7a2f310 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:08.897934 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 472/957] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:15:08 2022] POST /identity/v3/endpoints => generated 349 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:15:09.081313 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb2d4d-0d24-43d5-90cc-26d8c25d48b9 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:09.192461 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb2d4d-0d24-43d5-90cc-26d8c25d48b9 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:09.235019 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec71f520-1174-45eb-883b-ecf5b026d855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:09.235660 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec71f520-1174-45eb-883b-ecf5b026d855 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:09.235925 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec71f520-1174-45eb-883b-ecf5b026d855 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:09.236194 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec71f520-1174-45eb-883b-ecf5b026d855 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:09.236987 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec71f520-1174-45eb-883b-ecf5b026d855 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:09.238607 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec71f520-1174-45eb-883b-ecf5b026d855 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:09.247805 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-ec71f520-1174-45eb-883b-ecf5b026d855 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 22:15:09.247805 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:09.247805 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:15:09.247805 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:15:09.247805 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:15:09.247805 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:15:09.247805 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:15:09.247805 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:15:09.247805 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 22:15:09.247805 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:15:09.247805 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:15:09.247805 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:15:09.247805 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:09.247805 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:15:09.247805 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:15:09.247805 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:15:09.247805 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:15:09.248892 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:15:09.248892 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:15:09.248892 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:15:09.248892 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:15:09.248892 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:15:09.248892 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:15:09.248892 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:15:09.248892 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:15:09.248892 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:15:09.248892 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:15:09.248892 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:15:09.248892 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:15:09.248892 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:15:09.248892 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:15:09.248892 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:15:09.248892 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:15:09.249767 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:15:09.249767 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:15:09.249767 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:15:09.249767 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:15:09.249767 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:15:09.249767 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:15:09.249767 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:15:09.249767 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:15:09.249767 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:15:09.249767 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:15:09.249767 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:15:09.249767 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:15:09.249767 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 22:15:09.249767 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:15:09.249767 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 486/958] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Aug 29 22:15:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:15:09.255174 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97386e77-28f7-4b58-b372-a78ee7a2f310 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:09.313478 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:09.361542 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97386e77-28f7-4b58-b372-a78ee7a2f310 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:09.398324 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85c71e-cd43-40d6-943a-730978299d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:09.399335 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85c71e-cd43-40d6-943a-730978299d50 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:09.399520 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85c71e-cd43-40d6-943a-730978299d50 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:09.399674 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85c71e-cd43-40d6-943a-730978299d50 None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:09.400348 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff85c71e-cd43-40d6-943a-730978299d50 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:09.400707 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff85c71e-cd43-40d6-943a-730978299d50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:09.402110 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff85c71e-cd43-40d6-943a-730978299d50 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:09.407770 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 473/959] 10.222.0.36 () {56 vars in 1112 bytes} [Mon Aug 29 22:15:09 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:09.413731 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec71f520-1174-45eb-883b-ecf5b026d855 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:09.463421 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:09.546763 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec71f520-1174-45eb-883b-ecf5b026d855 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:09.587817 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e60f0-3e7f-4841-af8d-f31a6faebaf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:09.588436 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e60f0-3e7f-4841-af8d-f31a6faebaf0 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:09.588745 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e60f0-3e7f-4841-af8d-f31a6faebaf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:09.589018 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e60f0-3e7f-4841-af8d-f31a6faebaf0 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:09.589657 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286e60f0-3e7f-4841-af8d-f31a6faebaf0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:09.589961 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286e60f0-3e7f-4841-af8d-f31a6faebaf0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:09.591399 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286e60f0-3e7f-4841-af8d-f31a6faebaf0 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:09.596615 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 487/960] 10.222.0.36 () {56 vars in 1112 bytes} [Mon Aug 29 22:15:09 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:15:09.809510 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d35e3-0760-4d7b-a165-465a5655ebe2 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:09.810207 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d35e3-0760-4d7b-a165-465a5655ebe2 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:09.810207 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d35e3-0760-4d7b-a165-465a5655ebe2 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:09.811705 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 474/961] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:15:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:15:09.817289 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb821d-d8c1-467c-966f-2bdd84edff0a None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:09.817848 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb821d-d8c1-467c-966f-2bdd84edff0a None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:09.817848 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb821d-d8c1-467c-966f-2bdd84edff0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:09.841744 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-00eb821d-d8c1-467c-966f-2bdd84edff0a None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:15:09.843674 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-00eb821d-d8c1-467c-966f-2bdd84edff0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:15:09.928177 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 488/962] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:15:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:15:09.960222 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffbcf1-a2e8-4c08-9329-e1d7dea0ca4a None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:09.960585 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffbcf1-a2e8-4c08-9329-e1d7dea0ca4a None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:09.960875 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffbcf1-a2e8-4c08-9329-e1d7dea0ca4a None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:09.962735 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 475/963] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:15:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:15:09.968476 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9953a-1ff4-4f42-955a-93bb90308c3b None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:09.968931 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9953a-1ff4-4f42-955a-93bb90308c3b None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:09.969212 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9953a-1ff4-4f42-955a-93bb90308c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:09.988184 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-7fd9953a-1ff4-4f42-955a-93bb90308c3b None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:15:09.989466 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7fd9953a-1ff4-4f42-955a-93bb90308c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:15:10.020666 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:10.059012 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 489/964] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:15:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:15:10.203683 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ffbcf1-a2e8-4c08-9329-e1d7dea0ca4a None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:10.314415 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ffbcf1-a2e8-4c08-9329-e1d7dea0ca4a None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:10.335183 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9953a-1ff4-4f42-955a-93bb90308c3b None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:10.336827 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:10.353272 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21949c3b-6162-42bc-a4bc-c84ecd59f1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:10.354197 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21949c3b-6162-42bc-a4bc-c84ecd59f1f8 None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:10.354478 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21949c3b-6162-42bc-a4bc-c84ecd59f1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:10.354788 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21949c3b-6162-42bc-a4bc-c84ecd59f1f8 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:10.355446 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21949c3b-6162-42bc-a4bc-c84ecd59f1f8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:10.357325 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21949c3b-6162-42bc-a4bc-c84ecd59f1f8 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:10.360370 dv-cinder-854268-3-smb devstack@keystone.service[81514]: WARNING keystone.server.flask.common [None req-21949c3b-6162-42bc-a4bc-c84ecd59f1f8 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 29 22:15:10.377908 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.sql.core [None req-21949c3b-6162-42bc-a4bc-c84ecd59f1f8 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 29 22:15:10.377908 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 29 22:15:10.377908 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [parameters: {'user_id': '63b17788f0a344edab899e173bc82629', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 29 22:15:10.377908 dv-cinder-854268-3-smb devstack@keystone.service[81514]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81514) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 22:15:10.387379 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-21949c3b-6162-42bc-a4bc-c84ecd59f1f8 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 29 22:15:10.387379 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:10.387379 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 22:15:10.387379 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 22:15:10.387379 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 22:15:10.387379 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 22:15:10.387379 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 22:15:10.387379 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 22:15:10.387379 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 22:15:10.387379 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application conn.query(q) Aug 29 22:15:10.387379 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 22:15:10.387379 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 22:15:10.387379 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 22:15:10.387379 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application result.read() Aug 29 22:15:10.387379 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 22:15:10.388497 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 22:15:10.388497 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 22:15:10.388497 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 22:15:10.388497 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 22:15:10.388497 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 22:15:10.388497 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 22:15:10.388497 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 22:15:10.388497 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 29 22:15:10.388497 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:15:10.388497 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 29 22:15:10.388497 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:15:10.388497 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:10.388497 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 29 22:15:10.388497 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 29 22:15:10.388497 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 29 22:15:10.388497 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 29 22:15:10.388497 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 22:15:10.388497 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application next(self.gen) Aug 29 22:15:10.389929 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 29 22:15:10.389929 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application yield resource Aug 29 22:15:10.389929 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 22:15:10.389929 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application next(self.gen) Aug 29 22:15:10.389929 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 29 22:15:10.389929 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self.session.rollback() Aug 29 22:15:10.389929 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 22:15:10.389929 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self.force_reraise() Aug 29 22:15:10.389929 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 22:15:10.389929 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise self.value Aug 29 22:15:10.389929 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 29 22:15:10.389929 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 29 22:15:10.389929 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 29 22:15:10.389929 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application session.commit() Aug 29 22:15:10.389929 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 29 22:15:10.389929 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 29 22:15:10.389929 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 29 22:15:10.390930 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._prepare_impl() Aug 29 22:15:10.390930 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 29 22:15:10.390930 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self.session.flush() Aug 29 22:15:10.390930 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 22:15:10.390930 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._flush(objects) Aug 29 22:15:10.390930 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 22:15:10.390930 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 29 22:15:10.390930 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 22:15:10.390930 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application compat.raise_( Aug 29 22:15:10.390930 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 22:15:10.390930 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception Aug 29 22:15:10.390930 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 22:15:10.390930 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application flush_context.execute() Aug 29 22:15:10.390930 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 22:15:10.390930 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rec.execute(self) Aug 29 22:15:10.390930 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 22:15:10.390930 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 29 22:15:10.392199 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 22:15:10.392199 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 29 22:15:10.392199 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 29 22:15:10.392199 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 29 22:15:10.392199 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 22:15:10.392199 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 22:15:10.392199 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 22:15:10.392199 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 29 22:15:10.392199 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 22:15:10.392199 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 29 22:15:10.392199 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 22:15:10.392199 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 29 22:15:10.392199 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 22:15:10.392199 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 22:15:10.392199 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 22:15:10.392199 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception Aug 29 22:15:10.393675 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 22:15:10.393675 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 22:15:10.393675 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 22:15:10.393675 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 22:15:10.393675 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 22:15:10.393675 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 22:15:10.393675 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 22:15:10.393675 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application conn.query(q) Aug 29 22:15:10.393675 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 22:15:10.393675 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 22:15:10.393675 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 22:15:10.393675 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application result.read() Aug 29 22:15:10.393675 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 22:15:10.393675 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 22:15:10.393675 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 22:15:10.393675 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 22:15:10.394616 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 22:15:10.394616 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 22:15:10.394616 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 22:15:10.394616 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 22:15:10.394616 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 29 22:15:10.394616 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 29 22:15:10.394616 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [parameters: {'user_id': '63b17788f0a344edab899e173bc82629', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 29 22:15:10.394616 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 22:15:10.394616 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:15:10.394616 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:15:10.394616 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:15:10.394616 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:10.394616 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:15:10.394616 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:15:10.394616 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:15:10.395453 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:15:10.395453 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:15:10.395453 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:15:10.395453 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:15:10.395453 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:15:10.395453 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:15:10.395453 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:15:10.395453 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 29 22:15:10.395453 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 29 22:15:10.395453 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:15:10.395453 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:15:10.395453 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:15:10.395453 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:15:10.395453 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:15:10.395453 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:15:10.395453 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 29 22:15:10.395453 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 29 22:15:10.404672 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 29 22:15:10.404672 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 29 22:15:10.404672 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 29 22:15:10.404672 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 29 22:15:10.404672 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 29 22:15:10.404672 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:15:10.404672 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 476/965] 10.222.0.36 () {60 vars in 1131 bytes} [Mon Aug 29 22:15:10 2022] POST /identity/v3/users => generated 160 bytes in 186 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:15:10.404672 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21949c3b-6162-42bc-a4bc-c84ecd59f1f8 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:10.454535 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9953a-1ff4-4f42-955a-93bb90308c3b None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:10.490515 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4453210-0dae-4fbb-b1f4-85e130006bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:10.491356 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4453210-0dae-4fbb-b1f4-85e130006bd5 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:10.491735 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4453210-0dae-4fbb-b1f4-85e130006bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:10.492245 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4453210-0dae-4fbb-b1f4-85e130006bd5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:10.503568 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4453210-0dae-4fbb-b1f4-85e130006bd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:15:10.509296 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-e4453210-0dae-4fbb-b1f4-85e130006bd5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 22:15:10.509296 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:10.509296 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:15:10.509296 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:15:10.509296 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:15:10.509296 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:15:10.509296 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:15:10.509296 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:15:10.509296 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:15:10.509296 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:15:10.509296 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:15:10.509296 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:15:10.509296 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:15:10.509296 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:15:10.509296 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:15:10.509296 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:15:10.510448 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:15:10.510448 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:15:10.510448 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:15:10.510448 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:15:10.510448 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:15:10.510448 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:15:10.510448 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:15:10.510448 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:15:10.510448 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:15:10.510448 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:15:10.510448 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:15:10.510448 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:15:10.510448 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:15:10.510448 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:15:10.510448 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:15:10.510448 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:15:10.511528 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:15:10.511528 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:15:10.511528 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:15:10.511528 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:15:10.511528 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:15:10.511528 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:15:10.511528 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:15:10.511528 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:15:10.511528 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:15:10.511528 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:15:10.511528 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 22:15:10.511528 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:15:10.519014 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 490/966] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Aug 29 22:15:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:15:10.519667 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21949c3b-6162-42bc-a4bc-c84ecd59f1f8 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:10.520606 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4453210-0dae-4fbb-b1f4-85e130006bd5 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:10.555278 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:10.568177 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98481630-ae46-487a-97db-80d65936fc78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:10.569168 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98481630-ae46-487a-97db-80d65936fc78 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:10.569653 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98481630-ae46-487a-97db-80d65936fc78 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:10.570177 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98481630-ae46-487a-97db-80d65936fc78 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:10.580927 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98481630-ae46-487a-97db-80d65936fc78 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:10.583561 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98481630-ae46-487a-97db-80d65936fc78 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:10.599688 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-98481630-ae46-487a-97db-80d65936fc78 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 22:15:10.599688 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:10.599688 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:15:10.599688 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:15:10.599688 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:15:10.599688 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:15:10.599688 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:15:10.599688 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:15:10.599688 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:15:10.599688 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:15:10.599688 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:15:10.599688 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:15:10.599688 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:15:10.599688 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:15:10.599688 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:15:10.599688 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:15:10.600735 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:15:10.600735 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:15:10.600735 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:15:10.600735 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:15:10.600735 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:15:10.600735 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:15:10.600735 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:15:10.600735 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:15:10.600735 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:15:10.600735 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:15:10.600735 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:15:10.600735 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:15:10.600735 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:15:10.600735 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:15:10.600735 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:15:10.600735 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:15:10.600735 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:15:10.600735 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:15:10.601779 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:15:10.601779 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:15:10.601779 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:15:10.601779 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:15:10.601779 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:15:10.601779 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:15:10.601779 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:15:10.601779 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:15:10.601779 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 22:15:10.601779 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:15:10.602426 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 477/967] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:15:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:15:10.609202 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98481630-ae46-487a-97db-80d65936fc78 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:10.645960 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4453210-0dae-4fbb-b1f4-85e130006bd5 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:10.666238 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:10.696309 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a399b9-aea4-49b4-b9e7-87da0e858040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:10.696985 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a399b9-aea4-49b4-b9e7-87da0e858040 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:10.697282 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a399b9-aea4-49b4-b9e7-87da0e858040 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:10.697541 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a399b9-aea4-49b4-b9e7-87da0e858040 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:10.698229 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a399b9-aea4-49b4-b9e7-87da0e858040 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:10.698674 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a399b9-aea4-49b4-b9e7-87da0e858040 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:10.700488 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a399b9-aea4-49b4-b9e7-87da0e858040 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:10.711263 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 491/968] 10.222.0.36 () {56 vars in 1115 bytes} [Mon Aug 29 22:15:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:15:10.716761 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a399b9-aea4-49b4-b9e7-87da0e858040 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:10.740102 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98481630-ae46-487a-97db-80d65936fc78 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:10.778935 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e897c-4f58-4844-9e12-47ee27aa2bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:10.779968 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e897c-4f58-4844-9e12-47ee27aa2bec None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:10.780510 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e897c-4f58-4844-9e12-47ee27aa2bec None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:10.780953 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e897c-4f58-4844-9e12-47ee27aa2bec None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:10.781824 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e897c-4f58-4844-9e12-47ee27aa2bec None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:10.782296 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e897c-4f58-4844-9e12-47ee27aa2bec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:10.784051 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e897c-4f58-4844-9e12-47ee27aa2bec None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:10.817469 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:10.836489 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a399b9-aea4-49b4-b9e7-87da0e858040 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:10.837328 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 478/969] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Aug 29 22:15:10 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:10.870937 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa9eef9-5db9-4b30-ac13-5e29eb4a32b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:10.871596 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9eef9-5db9-4b30-ac13-5e29eb4a32b5 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:10.871874 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9eef9-5db9-4b30-ac13-5e29eb4a32b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:10.872145 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9eef9-5db9-4b30-ac13-5e29eb4a32b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:10.884613 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa9eef9-5db9-4b30-ac13-5e29eb4a32b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:10.886101 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa9eef9-5db9-4b30-ac13-5e29eb4a32b5 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:10.903163 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-1aa9eef9-5db9-4b30-ac13-5e29eb4a32b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:15:10.903163 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:10.903163 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:15:10.903163 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:15:10.903163 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:15:10.903163 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:15:10.903163 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:15:10.903163 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:15:10.903163 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:15:10.903163 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:15:10.903163 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:15:10.903163 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:15:10.903163 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:15:10.903163 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:15:10.903163 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:15:10.903163 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:15:10.904183 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:15:10.904183 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:15:10.904183 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:15:10.904183 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:15:10.904183 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:15:10.904183 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:15:10.904183 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:15:10.904183 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:15:10.904183 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:15:10.904183 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:15:10.904183 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:15:10.904183 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:15:10.904183 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:15:10.904183 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:15:10.904183 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:15:10.904183 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:15:10.904183 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:15:10.905111 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:15:10.905111 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:15:10.905111 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:15:10.908685 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 492/970] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:15:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:15:10.911115 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e897c-4f58-4844-9e12-47ee27aa2bec None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:10.954337 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72ed31-f006-4226-a431-828aae785a48 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:10.954624 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72ed31-f006-4226-a431-828aae785a48 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:10.954907 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72ed31-f006-4226-a431-828aae785a48 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:10.956554 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 493/971] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:15:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:15:10.962506 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96f59f-f4b1-40bd-912d-58e0fa459387 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:10.962720 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96f59f-f4b1-40bd-912d-58e0fa459387 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:10.963001 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96f59f-f4b1-40bd-912d-58e0fa459387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:10.984248 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-7c96f59f-f4b1-40bd-912d-58e0fa459387 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:15:10.985527 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7c96f59f-f4b1-40bd-912d-58e0fa459387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:15:11.031787 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:11.035840 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e897c-4f58-4844-9e12-47ee27aa2bec None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:11.077031 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 494/972] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:15:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:15:11.078250 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb63150-45ca-4a30-bdc2-8f03b566607e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:11.078878 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb63150-45ca-4a30-bdc2-8f03b566607e None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:11.079156 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb63150-45ca-4a30-bdc2-8f03b566607e None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:11.079422 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb63150-45ca-4a30-bdc2-8f03b566607e None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:11.080054 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb63150-45ca-4a30-bdc2-8f03b566607e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:11.080349 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb63150-45ca-4a30-bdc2-8f03b566607e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:11.081749 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb63150-45ca-4a30-bdc2-8f03b566607e None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:11.096549 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 479/973] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:15:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:11.100590 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c96f59f-f4b1-40bd-912d-58e0fa459387 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:11.174915 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:11.204381 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c96f59f-f4b1-40bd-912d-58e0fa459387 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:11.239252 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87466f02-557b-4459-a7bd-ee7b314cca2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:11.239792 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87466f02-557b-4459-a7bd-ee7b314cca2d None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:11.240068 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87466f02-557b-4459-a7bd-ee7b314cca2d None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:11.240333 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87466f02-557b-4459-a7bd-ee7b314cca2d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:11.247835 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87466f02-557b-4459-a7bd-ee7b314cca2d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:11.249288 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87466f02-557b-4459-a7bd-ee7b314cca2d None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:11.263183 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-87466f02-557b-4459-a7bd-ee7b314cca2d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 22:15:11.263183 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:11.263183 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:15:11.263183 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:15:11.263183 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:15:11.263183 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:15:11.263183 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:15:11.263183 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:15:11.263183 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:15:11.263183 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:15:11.263183 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:15:11.263183 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:15:11.263183 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:15:11.263183 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:15:11.263183 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:15:11.263183 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:15:11.264683 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:15:11.264683 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:15:11.264683 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:15:11.264683 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:15:11.264683 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:15:11.264683 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:15:11.264683 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:15:11.264683 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:15:11.264683 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:15:11.264683 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:15:11.264683 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:15:11.264683 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:15:11.264683 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:15:11.264683 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:15:11.264683 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:15:11.264683 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:15:11.264683 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:15:11.264683 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:15:11.266204 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:15:11.266204 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:15:11.266204 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:15:11.266204 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:15:11.266204 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:15:11.266204 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:15:11.266204 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:15:11.266204 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:15:11.266204 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 22:15:11.266204 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:15:11.268745 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 495/974] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Aug 29 22:15:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:15:11.270081 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb63150-45ca-4a30-bdc2-8f03b566607e None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:11.355058 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87466f02-557b-4459-a7bd-ee7b314cca2d None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:11.374304 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb63150-45ca-4a30-bdc2-8f03b566607e None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:11.411135 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5914a-0ef7-4173-a545-99bf95c0ce91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:11.411881 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5914a-0ef7-4173-a545-99bf95c0ce91 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:11.412162 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5914a-0ef7-4173-a545-99bf95c0ce91 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:11.412434 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5914a-0ef7-4173-a545-99bf95c0ce91 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:11.413198 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb5914a-0ef7-4173-a545-99bf95c0ce91 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:11.413486 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb5914a-0ef7-4173-a545-99bf95c0ce91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:11.415998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb5914a-0ef7-4173-a545-99bf95c0ce91 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:11.435914 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 480/975] 10.222.0.36 () {56 vars in 1149 bytes} [Mon Aug 29 22:15:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:11.441781 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5914a-0ef7-4173-a545-99bf95c0ce91 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:11.460054 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:11.470478 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87466f02-557b-4459-a7bd-ee7b314cca2d None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:11.505070 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:11.510789 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1325b4-4c99-4863-8c3b-a83ebe6140ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:11.511499 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1325b4-4c99-4863-8c3b-a83ebe6140ac None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:11.511836 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1325b4-4c99-4863-8c3b-a83ebe6140ac None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:11.512166 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1325b4-4c99-4863-8c3b-a83ebe6140ac None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:11.512849 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1325b4-4c99-4863-8c3b-a83ebe6140ac None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:11.514570 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1325b4-4c99-4863-8c3b-a83ebe6140ac None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:11.523593 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-4e1325b4-4c99-4863-8c3b-a83ebe6140ac None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 22:15:11.523593 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:11.523593 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:15:11.523593 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:15:11.523593 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:15:11.523593 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:15:11.523593 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:15:11.523593 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:15:11.523593 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 22:15:11.523593 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:15:11.523593 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:15:11.523593 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:15:11.523593 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:11.523593 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:15:11.523593 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:15:11.523593 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:15:11.523593 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:15:11.528527 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:15:11.528527 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:15:11.528527 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:15:11.528527 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:15:11.528527 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:15:11.528527 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:15:11.528527 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:15:11.528527 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:15:11.528527 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:15:11.528527 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:15:11.528527 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:15:11.528527 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:15:11.528527 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:15:11.528527 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:15:11.528527 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:15:11.528527 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:15:11.529527 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:15:11.529527 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:15:11.529527 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:15:11.529527 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:15:11.529527 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:15:11.529527 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:15:11.529527 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:15:11.529527 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:15:11.529527 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:15:11.529527 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:15:11.529527 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:15:11.529527 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:15:11.529527 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 22:15:11.529527 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:15:11.529527 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 496/976] 10.222.0.36 () {56 vars in 1126 bytes} [Mon Aug 29 22:15:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:15:11.531054 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1325b4-4c99-4863-8c3b-a83ebe6140ac None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:11.555300 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5914a-0ef7-4173-a545-99bf95c0ce91 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:11.590957 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201d20b-2809-4e56-bcf4-53d7cb369b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:11.591569 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201d20b-2809-4e56-bcf4-53d7cb369b36 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:11.591844 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201d20b-2809-4e56-bcf4-53d7cb369b36 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:11.592115 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201d20b-2809-4e56-bcf4-53d7cb369b36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:11.635909 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1325b4-4c99-4863-8c3b-a83ebe6140ac None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:11.661839 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0201d20b-2809-4e56-bcf4-53d7cb369b36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:11.663296 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0201d20b-2809-4e56-bcf4-53d7cb369b36 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:11.669920 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c27cf-8652-4d29-8ae3-f621fe24b768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:11.670530 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c27cf-8652-4d29-8ae3-f621fe24b768 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:11.670814 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c27cf-8652-4d29-8ae3-f621fe24b768 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:11.671085 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c27cf-8652-4d29-8ae3-f621fe24b768 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:11.671719 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c27cf-8652-4d29-8ae3-f621fe24b768 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:11.672019 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c27cf-8652-4d29-8ae3-f621fe24b768 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:11.673400 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c27cf-8652-4d29-8ae3-f621fe24b768 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:11.677987 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 497/977] 10.222.0.36 () {56 vars in 1122 bytes} [Mon Aug 29 22:15:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:11.679107 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a6e97-9f85-4045-8eec-7d0489410801 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:11.679386 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a6e97-9f85-4045-8eec-7d0489410801 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:11.679715 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a6e97-9f85-4045-8eec-7d0489410801 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:11.681337 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 498/978] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:15:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:15:11.682364 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:11.683742 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37a6e97-9f85-4045-8eec-7d0489410801 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:11.743661 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:11.769724 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 481/979] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:15:11 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 22:15:11.771063 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd1ed0-551d-4bf0-bee9-e38dee81aa3a None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:11.771354 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd1ed0-551d-4bf0-bee9-e38dee81aa3a None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:11.771626 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd1ed0-551d-4bf0-bee9-e38dee81aa3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:11.786942 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37a6e97-9f85-4045-8eec-7d0489410801 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:11.790062 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-c9bd1ed0-551d-4bf0-bee9-e38dee81aa3a None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:15:11.791674 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c9bd1ed0-551d-4bf0-bee9-e38dee81aa3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:15:11.820804 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab1f33-cd15-4beb-8538-5f500c34422a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:11.821461 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab1f33-cd15-4beb-8538-5f500c34422a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:11.821817 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab1f33-cd15-4beb-8538-5f500c34422a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:11.822093 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab1f33-cd15-4beb-8538-5f500c34422a None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:11.822721 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ab1f33-cd15-4beb-8538-5f500c34422a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:11.823021 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ab1f33-cd15-4beb-8538-5f500c34422a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:11.824378 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ab1f33-cd15-4beb-8538-5f500c34422a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:11.829133 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 499/980] 10.222.0.36 () {56 vars in 1122 bytes} [Mon Aug 29 22:15:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:15:11.829898 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab1f33-cd15-4beb-8538-5f500c34422a None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:11.859242 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 482/981] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:15:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:15:11.860182 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd1ed0-551d-4bf0-bee9-e38dee81aa3a None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:11.913920 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:11.936314 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab1f33-cd15-4beb-8538-5f500c34422a None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:11.960678 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:11.970690 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd1ed0-551d-4bf0-bee9-e38dee81aa3a None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:11.973498 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401cfbd0-cf2e-4d2b-9338-1ecfbed0bec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:11.974160 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cfbd0-cf2e-4d2b-9338-1ecfbed0bec1 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:11.974444 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cfbd0-cf2e-4d2b-9338-1ecfbed0bec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:11.974727 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cfbd0-cf2e-4d2b-9338-1ecfbed0bec1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:11.986349 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401cfbd0-cf2e-4d2b-9338-1ecfbed0bec1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:11.987813 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401cfbd0-cf2e-4d2b-9338-1ecfbed0bec1 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:12.002848 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-401cfbd0-cf2e-4d2b-9338-1ecfbed0bec1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:15:12.002848 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:12.002848 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:15:12.002848 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:15:12.002848 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:15:12.002848 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:15:12.002848 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:15:12.002848 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:15:12.002848 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:15:12.002848 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:15:12.002848 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:15:12.002848 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:15:12.002848 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:15:12.002848 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:15:12.002848 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:15:12.002848 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:15:12.003827 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:15:12.003827 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:15:12.003827 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:15:12.003827 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:15:12.003827 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:15:12.003827 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:15:12.003827 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:15:12.003827 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:15:12.003827 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:15:12.003827 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:15:12.003827 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:15:12.003827 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:15:12.003827 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:15:12.003827 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:15:12.003827 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:15:12.003827 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:15:12.003827 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:15:12.004842 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:15:12.004842 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:15:12.004842 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:15:12.004842 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 500/982] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:15:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:15:12.010346 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401cfbd0-cf2e-4d2b-9338-1ecfbed0bec1 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:12.016004 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ddb213-071e-4e69-a751-e2d91916e9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:12.016788 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddb213-071e-4e69-a751-e2d91916e9c1 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:12.017174 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddb213-071e-4e69-a751-e2d91916e9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:12.017550 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddb213-071e-4e69-a751-e2d91916e9c1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:12.018373 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ddb213-071e-4e69-a751-e2d91916e9c1 None admin] RBAC: Adding query filter params (interface=admin, service_id=8636d8aa11094ac7bcfe8ff9fedec612, region_id=RegionOne) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:12.018782 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ddb213-071e-4e69-a751-e2d91916e9c1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:12.020338 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ddb213-071e-4e69-a751-e2d91916e9c1 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:12.031502 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 483/983] 10.222.0.36 () {56 vars in 1249 bytes} [Mon Aug 29 22:15:11 2022] GET /identity/v3/endpoints?service_id=8636d8aa11094ac7bcfe8ff9fedec612&interface=admin®ion_id=RegionOne => generated 193 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:12.032554 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ddb213-071e-4e69-a751-e2d91916e9c1 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:12.126098 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401cfbd0-cf2e-4d2b-9338-1ecfbed0bec1 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:12.137410 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ddb213-071e-4e69-a751-e2d91916e9c1 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:12.148734 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:12.160741 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e98b9-c277-4f3f-9d89-e34fe8817d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:12.161353 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e98b9-c277-4f3f-9d89-e34fe8817d0a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:12.161633 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e98b9-c277-4f3f-9d89-e34fe8817d0a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:12.161905 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e98b9-c277-4f3f-9d89-e34fe8817d0a None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:12.162551 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075e98b9-c277-4f3f-9d89-e34fe8817d0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:12.162852 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075e98b9-c277-4f3f-9d89-e34fe8817d0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:12.164293 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075e98b9-c277-4f3f-9d89-e34fe8817d0a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:12.173669 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7017a-a275-4fc0-bce1-c43daf983005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:12.174264 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7017a-a275-4fc0-bce1-c43daf983005 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:12.174552 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7017a-a275-4fc0-bce1-c43daf983005 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:12.174822 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7017a-a275-4fc0-bce1-c43daf983005 None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:12.175422 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c7017a-a275-4fc0-bce1-c43daf983005 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:12.176300 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 501/984] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:12.176787 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c7017a-a275-4fc0-bce1-c43daf983005 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:12.177117 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e98b9-c277-4f3f-9d89-e34fe8817d0a None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:12.182947 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 484/985] 10.222.0.36 () {56 vars in 1087 bytes} [Mon Aug 29 22:15:12 2022] GET /identity/v3/services => generated 1497 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:15:12.183717 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7017a-a275-4fc0-bce1-c43daf983005 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:12.228759 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:12.301063 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7017a-a275-4fc0-bce1-c43daf983005 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:12.309345 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e98b9-c277-4f3f-9d89-e34fe8817d0a None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:12.343590 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e03ee-b147-4ba3-9936-4ff7dabb86bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:12.344527 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e03ee-b147-4ba3-9936-4ff7dabb86bf None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:12.344811 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e03ee-b147-4ba3-9936-4ff7dabb86bf None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:12.345071 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e03ee-b147-4ba3-9936-4ff7dabb86bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:12.351009 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823bf3e-d0f9-4f5c-877f-b2564e46811d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:12.352619 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823bf3e-d0f9-4f5c-877f-b2564e46811d None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:12.352619 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823bf3e-d0f9-4f5c-877f-b2564e46811d None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:12.352821 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825e03ee-b147-4ba3-9936-4ff7dabb86bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:12.352931 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823bf3e-d0f9-4f5c-877f-b2564e46811d None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:12.353092 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7823bf3e-d0f9-4f5c-877f-b2564e46811d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:12.353863 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825e03ee-b147-4ba3-9936-4ff7dabb86bf None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:12.354588 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7823bf3e-d0f9-4f5c-877f-b2564e46811d None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:12.366231 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-825e03ee-b147-4ba3-9936-4ff7dabb86bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:15:12.366231 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:12.366231 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:15:12.366231 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:15:12.366231 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:15:12.366231 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:15:12.366231 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:15:12.366231 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:15:12.366231 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:15:12.366231 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:15:12.366231 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:15:12.366231 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:15:12.366231 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:15:12.366231 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:15:12.366231 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:15:12.368199 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:15:12.368199 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:15:12.368199 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:15:12.368199 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:15:12.368199 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:15:12.368199 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:15:12.368199 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:15:12.368199 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:15:12.368199 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:15:12.368199 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:15:12.368199 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:15:12.368199 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:15:12.368199 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:15:12.368199 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:15:12.368199 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:15:12.368199 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:15:12.368199 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:15:12.369835 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:15:12.369835 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:15:12.369835 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:15:12.369835 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:15:12.369835 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:15:12.369835 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:15:12.369835 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:15:12.369835 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:15:12.369835 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 485/986] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Aug 29 22:15:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:15:12.373230 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e03ee-b147-4ba3-9936-4ff7dabb86bf None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:12.376624 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 502/987] 10.222.0.36 () {60 vars in 1141 bytes} [Mon Aug 29 22:15:12 2022] POST /identity/v3/services => generated 242 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:15:12.414626 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:12.491552 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e03ee-b147-4ba3-9936-4ff7dabb86bf None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:12.539435 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69d94f-ebf7-4310-a69d-f02a6e56df95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:12.540090 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69d94f-ebf7-4310-a69d-f02a6e56df95 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:12.540285 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69d94f-ebf7-4310-a69d-f02a6e56df95 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:12.540633 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69d94f-ebf7-4310-a69d-f02a6e56df95 None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:12.541330 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d69d94f-ebf7-4310-a69d-f02a6e56df95 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:12.541635 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d69d94f-ebf7-4310-a69d-f02a6e56df95 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:12.543073 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d69d94f-ebf7-4310-a69d-f02a6e56df95 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:12.556744 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 486/988] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Aug 29 22:15:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:15:12.562898 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823bf3e-d0f9-4f5c-877f-b2564e46811d None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:12.669743 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:12.678149 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823bf3e-d0f9-4f5c-877f-b2564e46811d None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:12.715504 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a3b02-9cf2-4130-83f9-2dc5abb5eb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:12.716277 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a3b02-9cf2-4130-83f9-2dc5abb5eb7c None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:12.716682 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a3b02-9cf2-4130-83f9-2dc5abb5eb7c None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:12.717054 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a3b02-9cf2-4130-83f9-2dc5abb5eb7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:12.717911 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020a3b02-9cf2-4130-83f9-2dc5abb5eb7c None admin] RBAC: Adding query filter params (role.id=1689c28a8f8945838ea7fd3cb4cfc598, scope.project.id=696ed25cc0cb43fab4bfaf762a90da54, user.id=b32922d090564162810dd8b28c3a322b) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:12.718321 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020a3b02-9cf2-4130-83f9-2dc5abb5eb7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:12.719851 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020a3b02-9cf2-4130-83f9-2dc5abb5eb7c None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:12.726278 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 503/989] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Aug 29 22:15:12 2022] GET /identity/v3/role_assignments?user.id=b32922d090564162810dd8b28c3a322b&scope.project.id=696ed25cc0cb43fab4bfaf762a90da54&role.id=1689c28a8f8945838ea7fd3cb4cfc598 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:14.106641 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509e623-03fb-499e-bca8-1a430eca5170 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:14.107204 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509e623-03fb-499e-bca8-1a430eca5170 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:14.107204 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509e623-03fb-499e-bca8-1a430eca5170 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:14.108660 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 487/990] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:15:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:15:14.113953 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455c0e4-672e-4b20-94a7-cb9179994047 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:14.114372 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455c0e4-672e-4b20-94a7-cb9179994047 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:14.114469 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455c0e4-672e-4b20-94a7-cb9179994047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:14.135469 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-6455c0e4-672e-4b20-94a7-cb9179994047 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:15:14.136695 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-6455c0e4-672e-4b20-94a7-cb9179994047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:15:14.208618 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 504/991] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:15:14 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:15:14.317501 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4586d6-372c-4b44-893e-ef35ede09222 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:14.317848 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4586d6-372c-4b44-893e-ef35ede09222 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:14.318035 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4586d6-372c-4b44-893e-ef35ede09222 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:14.319530 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 488/992] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:15:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:15:14.324798 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea34d5-af2d-4ea1-a2ef-560091bdc965 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:14.325057 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea34d5-af2d-4ea1-a2ef-560091bdc965 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:14.325349 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea34d5-af2d-4ea1-a2ef-560091bdc965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:14.345114 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-adea34d5-af2d-4ea1-a2ef-560091bdc965 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:15:14.346288 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-adea34d5-af2d-4ea1-a2ef-560091bdc965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:15:14.416792 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 505/993] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:15:14 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:15:14.472159 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4586d6-372c-4b44-893e-ef35ede09222 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:14.565137 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:14.576385 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4586d6-372c-4b44-893e-ef35ede09222 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:14.610934 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2461f864-a8fd-4b63-86c9-71682b7f39ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:14.611574 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461f864-a8fd-4b63-86c9-71682b7f39ae None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:14.611860 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461f864-a8fd-4b63-86c9-71682b7f39ae None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:14.612136 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461f864-a8fd-4b63-86c9-71682b7f39ae None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:14.612750 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2461f864-a8fd-4b63-86c9-71682b7f39ae None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:14.614130 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2461f864-a8fd-4b63-86c9-71682b7f39ae None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:14.623241 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-2461f864-a8fd-4b63-86c9-71682b7f39ae None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 22:15:14.623241 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:14.623241 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:15:14.623241 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:15:14.623241 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:15:14.623241 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:15:14.623241 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:15:14.623241 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:15:14.623241 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 22:15:14.623241 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:15:14.623241 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:15:14.623241 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:15:14.623241 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:14.623241 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:15:14.623241 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:15:14.623241 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:15:14.623241 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:15:14.624268 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:15:14.624268 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:15:14.624268 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:15:14.624268 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:15:14.624268 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:15:14.624268 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:15:14.624268 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:15:14.624268 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:15:14.624268 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:15:14.624268 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:15:14.624268 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:15:14.624268 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:15:14.624268 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:15:14.624268 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:15:14.624268 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:15:14.624268 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:15:14.625160 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:15:14.625160 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:15:14.625160 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:15:14.625160 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:15:14.625160 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:15:14.625160 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:15:14.625160 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:15:14.625160 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:15:14.625160 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:15:14.625160 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:15:14.625160 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:15:14.625160 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:15:14.625160 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 22:15:14.625160 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:15:14.628812 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 489/994] 10.222.0.36 () {56 vars in 1126 bytes} [Mon Aug 29 22:15:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:15:14.630330 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea34d5-af2d-4ea1-a2ef-560091bdc965 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:14.653152 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:14.691330 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2461f864-a8fd-4b63-86c9-71682b7f39ae None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:14.742193 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea34d5-af2d-4ea1-a2ef-560091bdc965 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:14.781991 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b09d0-76a6-4721-ac68-7c8973b3fe68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:14.782609 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b09d0-76a6-4721-ac68-7c8973b3fe68 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:14.782886 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b09d0-76a6-4721-ac68-7c8973b3fe68 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:14.783153 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b09d0-76a6-4721-ac68-7c8973b3fe68 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:14.783782 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b09d0-76a6-4721-ac68-7c8973b3fe68 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:14.784081 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b09d0-76a6-4721-ac68-7c8973b3fe68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:14.785485 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b09d0-76a6-4721-ac68-7c8973b3fe68 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:14.790425 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 506/995] 10.222.0.36 () {56 vars in 1122 bytes} [Mon Aug 29 22:15:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:14.791429 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ea2f7-f06e-4d80-90d4-c4c286f2e64b None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:14.791711 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ea2f7-f06e-4d80-90d4-c4c286f2e64b None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:14.791985 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ea2f7-f06e-4d80-90d4-c4c286f2e64b None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:14.793307 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 507/996] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:15:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:15:14.796089 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1ea2f7-f06e-4d80-90d4-c4c286f2e64b None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:14.817685 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2461f864-a8fd-4b63-86c9-71682b7f39ae None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:14.853109 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a98a1-df0d-4f10-8093-fd55907ec866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:14.853756 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a98a1-df0d-4f10-8093-fd55907ec866 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:14.854044 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a98a1-df0d-4f10-8093-fd55907ec866 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:14.854323 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a98a1-df0d-4f10-8093-fd55907ec866 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:14.854911 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a98a1-df0d-4f10-8093-fd55907ec866 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:14.856299 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a98a1-df0d-4f10-8093-fd55907ec866 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:14.865533 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-2f4a98a1-df0d-4f10-8093-fd55907ec866 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 22:15:14.865533 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:14.865533 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:15:14.865533 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:15:14.865533 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:15:14.865533 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:15:14.865533 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:15:14.865533 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:15:14.865533 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 22:15:14.865533 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:15:14.865533 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:15:14.865533 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:15:14.865533 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:14.865533 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:15:14.865533 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:15:14.865533 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:15:14.865533 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:15:14.866524 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:15:14.866524 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:15:14.866524 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:15:14.866524 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:15:14.866524 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:15:14.866524 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:15:14.866524 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:15:14.866524 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:15:14.866524 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:15:14.866524 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:15:14.866524 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:15:14.866524 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:15:14.866524 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:15:14.866524 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:15:14.866524 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:15:14.866524 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:15:14.867555 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:15:14.867555 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:15:14.867555 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:15:14.867555 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:15:14.867555 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:15:14.867555 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:15:14.867555 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:15:14.867555 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:15:14.867555 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:15:14.867555 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:15:14.867555 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:15:14.867555 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:15:14.867555 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 22:15:14.867555 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:15:14.867555 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 490/997] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Aug 29 22:15:14 2022] GET /identity/v3/services/compute => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:15:14.868552 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e4284-5b00-4919-84f7-ea0b8c33b89b None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:14.868552 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e4284-5b00-4919-84f7-ea0b8c33b89b None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:14.868698 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e4284-5b00-4919-84f7-ea0b8c33b89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:14.886622 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-4d3e4284-5b00-4919-84f7-ea0b8c33b89b None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:15:14.887815 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-4d3e4284-5b00-4919-84f7-ea0b8c33b89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:15:14.888134 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:14.902977 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:14.908296 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1ea2f7-f06e-4d80-90d4-c4c286f2e64b None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:14.942848 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37931bd5-d995-4069-9816-00694c3a4735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:14.943456 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37931bd5-d995-4069-9816-00694c3a4735 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:14.943736 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37931bd5-d995-4069-9816-00694c3a4735 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:14.944010 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37931bd5-d995-4069-9816-00694c3a4735 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:14.944674 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37931bd5-d995-4069-9816-00694c3a4735 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:14.944977 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37931bd5-d995-4069-9816-00694c3a4735 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:14.946860 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37931bd5-d995-4069-9816-00694c3a4735 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:14.951555 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 508/998] 10.222.0.36 () {56 vars in 1122 bytes} [Mon Aug 29 22:15:14 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:15:14.952332 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37931bd5-d995-4069-9816-00694c3a4735 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:14.961803 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 491/999] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:15:14 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:15:14.962735 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e4284-5b00-4919-84f7-ea0b8c33b89b None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:15.064426 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37931bd5-d995-4069-9816-00694c3a4735 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:15.068257 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e4284-5b00-4919-84f7-ea0b8c33b89b None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:15.102225 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d23b042-2d52-4e23-b2a0-a86a8c526eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:15.102838 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23b042-2d52-4e23-b2a0-a86a8c526eb0 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:15.103125 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23b042-2d52-4e23-b2a0-a86a8c526eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:15.103401 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23b042-2d52-4e23-b2a0-a86a8c526eb0 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:15.104048 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d23b042-2d52-4e23-b2a0-a86a8c526eb0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:15.104567 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d23b042-2d52-4e23-b2a0-a86a8c526eb0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:15.105960 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d23b042-2d52-4e23-b2a0-a86a8c526eb0 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:15.109175 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baaccef-ee46-4fc3-84ac-8b6bbe1a2955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:15.109819 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baaccef-ee46-4fc3-84ac-8b6bbe1a2955 None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:15.110147 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baaccef-ee46-4fc3-84ac-8b6bbe1a2955 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:15.110365 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baaccef-ee46-4fc3-84ac-8b6bbe1a2955 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:15.110989 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baaccef-ee46-4fc3-84ac-8b6bbe1a2955 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:15.112367 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baaccef-ee46-4fc3-84ac-8b6bbe1a2955 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:15.118298 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 509/1000] 10.222.0.36 () {56 vars in 1112 bytes} [Mon Aug 29 22:15:14 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:15.120065 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d23b042-2d52-4e23-b2a0-a86a8c526eb0 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:15.133948 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 492/1001] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:15:14 2022] POST /identity/v3/endpoints => generated 325 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:15:15.137659 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:15.235572 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baaccef-ee46-4fc3-84ac-8b6bbe1a2955 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:15.240769 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d23b042-2d52-4e23-b2a0-a86a8c526eb0 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:15.247954 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:15.292583 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d40fa-c012-4188-a861-d73b7d9df9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:15.293622 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d40fa-c012-4188-a861-d73b7d9df9b8 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:15.294088 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d40fa-c012-4188-a861-d73b7d9df9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:15.294542 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d40fa-c012-4188-a861-d73b7d9df9b8 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:15.295365 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730d40fa-c012-4188-a861-d73b7d9df9b8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:15.295864 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730d40fa-c012-4188-a861-d73b7d9df9b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:15.297614 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730d40fa-c012-4188-a861-d73b7d9df9b8 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:15.304304 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 510/1002] 10.222.0.36 () {56 vars in 1112 bytes} [Mon Aug 29 22:15:15 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:15:15.311003 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d40fa-c012-4188-a861-d73b7d9df9b8 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:15.356294 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baaccef-ee46-4fc3-84ac-8b6bbe1a2955 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:15.390937 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:15.401403 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8fe3a3-3d19-4db8-be07-a3731f25d476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:15.402188 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fe3a3-3d19-4db8-be07-a3731f25d476 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:15.402480 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fe3a3-3d19-4db8-be07-a3731f25d476 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:15.402741 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fe3a3-3d19-4db8-be07-a3731f25d476 None admin] PATH_INFO: `/v3/services/image` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:15.403328 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8fe3a3-3d19-4db8-be07-a3731f25d476 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:15.404732 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8fe3a3-3d19-4db8-be07-a3731f25d476 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:15.413630 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-6b8fe3a3-3d19-4db8-be07-a3731f25d476 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 22:15:15.413630 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:15.413630 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:15:15.413630 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:15:15.413630 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:15:15.413630 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:15:15.413630 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:15:15.413630 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:15:15.413630 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 22:15:15.413630 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:15:15.413630 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:15:15.413630 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:15:15.413630 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:15.413630 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:15:15.413630 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:15:15.413630 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:15:15.413630 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:15:15.414718 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:15:15.414718 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:15:15.414718 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:15:15.414718 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:15:15.414718 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:15:15.414718 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:15:15.414718 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:15:15.414718 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:15:15.414718 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:15:15.414718 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:15:15.414718 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:15:15.414718 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:15:15.414718 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:15:15.414718 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:15:15.414718 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:15:15.414718 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:15:15.415633 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:15:15.415633 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:15:15.415633 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:15:15.415633 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:15:15.415633 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:15:15.415633 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:15:15.415633 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:15:15.415633 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:15:15.415633 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:15:15.415633 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:15:15.415633 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:15:15.415633 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:15:15.415633 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 22:15:15.415633 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:15:15.415633 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 493/1003] 10.222.0.36 () {56 vars in 1105 bytes} [Mon Aug 29 22:15:15 2022] GET /identity/v3/services/image => generated 86 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:15:15.420771 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8fe3a3-3d19-4db8-be07-a3731f25d476 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:15.427660 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d40fa-c012-4188-a861-d73b7d9df9b8 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:15.464203 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d87f5-b244-4a27-9a8f-62cb5ca23c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:15.464856 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d87f5-b244-4a27-9a8f-62cb5ca23c4b None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:15.465135 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d87f5-b244-4a27-9a8f-62cb5ca23c4b None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:15.465408 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d87f5-b244-4a27-9a8f-62cb5ca23c4b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:15.466119 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d87f5-b244-4a27-9a8f-62cb5ca23c4b None admin] RBAC: Adding query filter params (interface=public, service_id=bb2a4ddea3784976a5e92c248664998a, region_id=RegionOne) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:15.466427 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d87f5-b244-4a27-9a8f-62cb5ca23c4b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:15.467813 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d87f5-b244-4a27-9a8f-62cb5ca23c4b None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:15.472955 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 511/1004] 10.222.0.36 () {56 vars in 1251 bytes} [Mon Aug 29 22:15:15 2022] GET /identity/v3/endpoints?service_id=bb2a4ddea3784976a5e92c248664998a&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:15.479305 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d87f5-b244-4a27-9a8f-62cb5ca23c4b None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:15.501479 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:15.533386 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8fe3a3-3d19-4db8-be07-a3731f25d476 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:15.567697 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418259e-5640-4672-94b6-af26351c0c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:15.568340 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418259e-5640-4672-94b6-af26351c0c41 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:15.568661 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418259e-5640-4672-94b6-af26351c0c41 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:15.568931 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418259e-5640-4672-94b6-af26351c0c41 None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:15.569556 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5418259e-5640-4672-94b6-af26351c0c41 None admin] RBAC: Adding query filter params (name=image) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:15.569856 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5418259e-5640-4672-94b6-af26351c0c41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:15.571566 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5418259e-5640-4672-94b6-af26351c0c41 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:15.576422 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 494/1005] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:15:15 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:15.581688 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418259e-5640-4672-94b6-af26351c0c41 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:15.595304 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d87f5-b244-4a27-9a8f-62cb5ca23c4b None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:15.633700 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f4928-f8d1-432b-ac6d-fcc694c75c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:15.634228 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f4928-f8d1-432b-ac6d-fcc694c75c6a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:15.634514 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f4928-f8d1-432b-ac6d-fcc694c75c6a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:15.634772 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f4928-f8d1-432b-ac6d-fcc694c75c6a None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:15.635376 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8f4928-f8d1-432b-ac6d-fcc694c75c6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:15.637009 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8f4928-f8d1-432b-ac6d-fcc694c75c6a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:15.639043 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:15.645515 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 512/1006] 10.222.0.36 () {56 vars in 1087 bytes} [Mon Aug 29 22:15:15 2022] GET /identity/v3/services => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:15:15.695755 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418259e-5640-4672-94b6-af26351c0c41 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:15.733681 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49207a8c-5966-4309-9e4c-f3a12e6eae74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:15.734300 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49207a8c-5966-4309-9e4c-f3a12e6eae74 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:15.734576 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49207a8c-5966-4309-9e4c-f3a12e6eae74 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:15.734845 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49207a8c-5966-4309-9e4c-f3a12e6eae74 None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:15.735481 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49207a8c-5966-4309-9e4c-f3a12e6eae74 None admin] RBAC: Adding query filter params (type=image) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:15.735782 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49207a8c-5966-4309-9e4c-f3a12e6eae74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:15.737208 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49207a8c-5966-4309-9e4c-f3a12e6eae74 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:15.740130 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:15.748514 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 495/1007] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:15:15 2022] GET /identity/v3/services?type=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:15:17.065650 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30295b7f-568d-4f75-ba38-7b2a47ed9ee4 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:17.066185 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30295b7f-568d-4f75-ba38-7b2a47ed9ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:17.066185 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30295b7f-568d-4f75-ba38-7b2a47ed9ee4 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:17.067739 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 513/1008] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:15:17.073028 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af813fdc-da98-49fc-b232-ba7beda95edc None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:17.073498 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af813fdc-da98-49fc-b232-ba7beda95edc None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:17.073579 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af813fdc-da98-49fc-b232-ba7beda95edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:17.093007 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-af813fdc-da98-49fc-b232-ba7beda95edc None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:15:17.094221 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-af813fdc-da98-49fc-b232-ba7beda95edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:15:17.171090 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 496/1009] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:15:17 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:15:17.433529 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30295b7f-568d-4f75-ba38-7b2a47ed9ee4 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:17.544000 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30295b7f-568d-4f75-ba38-7b2a47ed9ee4 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:17.544966 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e9ab3-c8d7-4f0c-8e9c-b35f1abd77ed None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:17.545254 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e9ab3-c8d7-4f0c-8e9c-b35f1abd77ed None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:17.545518 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e9ab3-c8d7-4f0c-8e9c-b35f1abd77ed None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:17.547120 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 497/1010] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:15:17.552327 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03953bd7-5330-499b-80d2-98b5715e149d None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:17.552720 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03953bd7-5330-499b-80d2-98b5715e149d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:17.553005 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03953bd7-5330-499b-80d2-98b5715e149d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:17.571416 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-03953bd7-5330-499b-80d2-98b5715e149d None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:15:17.572625 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-03953bd7-5330-499b-80d2-98b5715e149d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:15:17.585084 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effbaf43-2be0-40eb-a736-8a6797df6fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:17.585999 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effbaf43-2be0-40eb-a736-8a6797df6fbb None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:17.586714 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effbaf43-2be0-40eb-a736-8a6797df6fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:17.587593 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effbaf43-2be0-40eb-a736-8a6797df6fbb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:17.589210 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effbaf43-2be0-40eb-a736-8a6797df6fbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:17.591473 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effbaf43-2be0-40eb-a736-8a6797df6fbb None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:17.593403 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 514/1011] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:15:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:17.599239 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effbaf43-2be0-40eb-a736-8a6797df6fbb None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:17.648803 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 498/1012] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:15:17 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:15:17.679401 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:17.694005 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1ed21-5299-4882-82eb-78a1d60ad680 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:17.694231 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1ed21-5299-4882-82eb-78a1d60ad680 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:17.694523 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1ed21-5299-4882-82eb-78a1d60ad680 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:17.696608 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 499/1013] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:15:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:15:17.701654 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f818a-f723-4c4a-b9bb-ce43bd4de615 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:17.702132 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f818a-f723-4c4a-b9bb-ce43bd4de615 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:17.702409 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f818a-f723-4c4a-b9bb-ce43bd4de615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:17.720880 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effbaf43-2be0-40eb-a736-8a6797df6fbb None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:17.721963 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-f06f818a-f723-4c4a-b9bb-ce43bd4de615 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:15:17.723180 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f06f818a-f723-4c4a-b9bb-ce43bd4de615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:15:17.758734 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a59e4b6-2506-45d7-b5e0-f7f71c468a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:17.759355 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a59e4b6-2506-45d7-b5e0-f7f71c468a65 None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:17.759638 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a59e4b6-2506-45d7-b5e0-f7f71c468a65 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:17.759904 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a59e4b6-2506-45d7-b5e0-f7f71c468a65 None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:17.760586 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a59e4b6-2506-45d7-b5e0-f7f71c468a65 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:17.762020 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a59e4b6-2506-45d7-b5e0-f7f71c468a65 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:17.786097 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:17.793111 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 515/1014] 10.222.0.36 () {60 vars in 1141 bytes} [Mon Aug 29 22:15:17 2022] POST /identity/v3/projects => generated 311 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:15:17.804241 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 500/1015] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:15:17 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:15:17.904442 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a59e4b6-2506-45d7-b5e0-f7f71c468a65 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:18.009769 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a59e4b6-2506-45d7-b5e0-f7f71c468a65 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:18.033804 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:18.052187 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5bc9a5-b747-4f75-81e0-46d690d452e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:18.052872 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5bc9a5-b747-4f75-81e0-46d690d452e1 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:18.053153 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5bc9a5-b747-4f75-81e0-46d690d452e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:18.053424 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5bc9a5-b747-4f75-81e0-46d690d452e1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:18.054016 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5bc9a5-b747-4f75-81e0-46d690d452e1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:18.055449 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5bc9a5-b747-4f75-81e0-46d690d452e1 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:18.064687 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-4e5bc9a5-b747-4f75-81e0-46d690d452e1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 22:15:18.064687 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:18.064687 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:15:18.064687 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:15:18.064687 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:15:18.064687 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:15:18.064687 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:15:18.064687 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:15:18.064687 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 22:15:18.064687 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:15:18.064687 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:15:18.064687 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:15:18.064687 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:18.064687 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:15:18.064687 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:15:18.064687 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:15:18.064687 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:15:18.066536 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:15:18.066536 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:15:18.066536 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:15:18.066536 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:15:18.066536 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:15:18.066536 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:15:18.066536 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:15:18.066536 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:15:18.066536 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:15:18.066536 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:15:18.066536 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:15:18.066536 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:15:18.066536 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:15:18.066536 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:15:18.066536 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:15:18.066536 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:15:18.067405 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:15:18.067405 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:15:18.067405 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:15:18.067405 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:15:18.067405 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:15:18.067405 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:15:18.067405 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:15:18.067405 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:15:18.067405 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:15:18.067405 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:15:18.067405 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:15:18.067405 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:15:18.067405 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 22:15:18.067405 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:15:18.067405 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 516/1016] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Aug 29 22:15:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:15:18.071037 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f818a-f723-4c4a-b9bb-ce43bd4de615 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:18.074813 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5bc9a5-b747-4f75-81e0-46d690d452e1 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:18.178067 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f818a-f723-4c4a-b9bb-ce43bd4de615 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:18.185788 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5bc9a5-b747-4f75-81e0-46d690d452e1 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:18.215576 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a249161-502e-4065-82ee-87262eb0406b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:18.216193 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a249161-502e-4065-82ee-87262eb0406b None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:18.216501 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a249161-502e-4065-82ee-87262eb0406b None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:18.216781 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a249161-502e-4065-82ee-87262eb0406b None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:18.217445 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a249161-502e-4065-82ee-87262eb0406b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:18.218816 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a249161-502e-4065-82ee-87262eb0406b None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:18.222106 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de42c798-7dd2-43bb-93c6-18c656883e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:18.222720 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42c798-7dd2-43bb-93c6-18c656883e22 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:18.223004 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42c798-7dd2-43bb-93c6-18c656883e22 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:18.223273 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42c798-7dd2-43bb-93c6-18c656883e22 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:18.223909 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de42c798-7dd2-43bb-93c6-18c656883e22 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:18.224214 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de42c798-7dd2-43bb-93c6-18c656883e22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:18.225630 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de42c798-7dd2-43bb-93c6-18c656883e22 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:18.230866 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 517/1017] 10.222.0.36 () {56 vars in 1112 bytes} [Mon Aug 29 22:15:18 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:15:18.236807 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de42c798-7dd2-43bb-93c6-18c656883e22 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:18.244562 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 501/1018] 10.222.0.36 () {60 vars in 1141 bytes} [Mon Aug 29 22:15:18 2022] POST /identity/v3/services => generated 242 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:15:18.298709 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:18.359653 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de42c798-7dd2-43bb-93c6-18c656883e22 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:18.405989 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef70217-7175-40f2-8557-fed8fb2bca04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:18.406637 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef70217-7175-40f2-8557-fed8fb2bca04 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:18.406917 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef70217-7175-40f2-8557-fed8fb2bca04 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:18.407214 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef70217-7175-40f2-8557-fed8fb2bca04 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:18.407854 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef70217-7175-40f2-8557-fed8fb2bca04 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:18.408219 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef70217-7175-40f2-8557-fed8fb2bca04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:18.409579 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef70217-7175-40f2-8557-fed8fb2bca04 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:18.415860 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 518/1019] 10.222.0.36 () {56 vars in 1112 bytes} [Mon Aug 29 22:15:18 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:15:18.421918 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a249161-502e-4065-82ee-87262eb0406b None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:18.475909 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:18.533187 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a249161-502e-4065-82ee-87262eb0406b None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:18.569795 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c25a493-0c88-4a50-86c3-c9f0cbfc2965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:18.570457 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25a493-0c88-4a50-86c3-c9f0cbfc2965 None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:18.570798 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25a493-0c88-4a50-86c3-c9f0cbfc2965 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:18.571087 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25a493-0c88-4a50-86c3-c9f0cbfc2965 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:18.571719 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c25a493-0c88-4a50-86c3-c9f0cbfc2965 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:18.573129 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c25a493-0c88-4a50-86c3-c9f0cbfc2965 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:18.604223 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 502/1020] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:15:18 2022] POST /identity/v3/endpoints => generated 334 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:15:19.775876 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a6f0d-9b0a-4ae6-9332-d3f7b596b44d None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:19.776479 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a6f0d-9b0a-4ae6-9332-d3f7b596b44d None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:19.776479 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a6f0d-9b0a-4ae6-9332-d3f7b596b44d None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:19.777973 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 519/1021] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:15:19.783220 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d966161-391d-436e-a1ac-3dabeb03baa9 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:19.783798 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d966161-391d-436e-a1ac-3dabeb03baa9 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:19.783798 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d966161-391d-436e-a1ac-3dabeb03baa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:19.802580 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-8d966161-391d-436e-a1ac-3dabeb03baa9 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:15:19.803762 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-8d966161-391d-436e-a1ac-3dabeb03baa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:15:19.884929 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 503/1022] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:15:19 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:15:20.152252 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a6f0d-9b0a-4ae6-9332-d3f7b596b44d None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:20.154085 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2621e-e6ae-4d73-85d0-9afc7df72fea None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:20.154378 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2621e-e6ae-4d73-85d0-9afc7df72fea None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:20.154651 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2621e-e6ae-4d73-85d0-9afc7df72fea None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:20.156257 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 504/1023] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:15:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:15:20.161092 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182713b-18d1-46aa-9d1f-f69c60b47515 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:20.161343 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182713b-18d1-46aa-9d1f-f69c60b47515 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:20.161637 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182713b-18d1-46aa-9d1f-f69c60b47515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:20.180261 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-0182713b-18d1-46aa-9d1f-f69c60b47515 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:15:20.181481 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-0182713b-18d1-46aa-9d1f-f69c60b47515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:15:20.208349 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:20.253146 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 505/1024] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:15:20 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:15:20.263228 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a6f0d-9b0a-4ae6-9332-d3f7b596b44d None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:20.275507 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:20.301463 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bc808c-c9b0-465a-b8f8-fbba655aafbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:20.302105 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc808c-c9b0-465a-b8f8-fbba655aafbf None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:20.302385 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc808c-c9b0-465a-b8f8-fbba655aafbf None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:20.302654 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc808c-c9b0-465a-b8f8-fbba655aafbf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:20.303770 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bc808c-c9b0-465a-b8f8-fbba655aafbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:20.305347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bc808c-c9b0-465a-b8f8-fbba655aafbf None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:20.311686 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 520/1025] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:15:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:20.312926 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182713b-18d1-46aa-9d1f-f69c60b47515 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:20.417347 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182713b-18d1-46aa-9d1f-f69c60b47515 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:20.452889 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7090569-d7b4-4f24-84af-099edf0901dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:20.453486 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7090569-d7b4-4f24-84af-099edf0901dc None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:20.453773 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7090569-d7b4-4f24-84af-099edf0901dc None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:20.454038 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7090569-d7b4-4f24-84af-099edf0901dc None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:20.454699 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7090569-d7b4-4f24-84af-099edf0901dc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:20.456119 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7090569-d7b4-4f24-84af-099edf0901dc None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:20.480579 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 506/1026] 10.222.0.36 () {60 vars in 1132 bytes} [Mon Aug 29 22:15:20 2022] POST /identity/v3/users => generated 285 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:15:20.527095 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bc808c-c9b0-465a-b8f8-fbba655aafbf None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:20.561030 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0edf1a4-8737-4fdf-8bf7-977ef5360807 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:20.561299 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0edf1a4-8737-4fdf-8bf7-977ef5360807 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:20.561745 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0edf1a4-8737-4fdf-8bf7-977ef5360807 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:20.563212 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 507/1027] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:15:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:15:20.569193 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a6be9e-da66-47a2-9457-14ac1d052d4f None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:20.570399 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a6be9e-da66-47a2-9457-14ac1d052d4f None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:20.570879 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a6be9e-da66-47a2-9457-14ac1d052d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:20.592171 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-c5a6be9e-da66-47a2-9457-14ac1d052d4f None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:15:20.593493 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c5a6be9e-da66-47a2-9457-14ac1d052d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:15:20.608754 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:20.641580 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bc808c-c9b0-465a-b8f8-fbba655aafbf None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:20.681803 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 508/1028] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:15:20 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:15:20.685838 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd496a-d225-48b5-8906-a1e315aeb8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:20.686728 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd496a-d225-48b5-8906-a1e315aeb8db None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:20.687211 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd496a-d225-48b5-8906-a1e315aeb8db None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:20.687682 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd496a-d225-48b5-8906-a1e315aeb8db None admin] PATH_INFO: `/v3/services/image` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:20.688527 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfd496a-d225-48b5-8906-a1e315aeb8db None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:20.690256 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfd496a-d225-48b5-8906-a1e315aeb8db None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:20.700928 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-5dfd496a-d225-48b5-8906-a1e315aeb8db None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 22:15:20.700928 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:20.700928 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:15:20.700928 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:15:20.700928 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:15:20.700928 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:15:20.700928 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:15:20.700928 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:15:20.700928 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 22:15:20.700928 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:15:20.700928 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:15:20.700928 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:15:20.700928 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:20.700928 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:15:20.700928 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:15:20.700928 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:15:20.700928 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:15:20.701962 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:15:20.701962 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:15:20.701962 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:15:20.701962 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:15:20.701962 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:15:20.701962 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:15:20.701962 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:15:20.701962 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:15:20.701962 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:15:20.701962 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:15:20.701962 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:15:20.701962 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:15:20.701962 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:15:20.701962 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:15:20.701962 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:15:20.701962 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:15:20.702826 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:15:20.702826 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:15:20.702826 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:15:20.702826 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:15:20.702826 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:15:20.702826 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:15:20.702826 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:15:20.702826 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:15:20.702826 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:15:20.702826 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:15:20.702826 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:15:20.702826 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:15:20.702826 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 22:15:20.702826 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:15:20.702826 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 521/1029] 10.222.0.36 () {56 vars in 1105 bytes} [Mon Aug 29 22:15:20 2022] GET /identity/v3/services/image => generated 86 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:15:20.708298 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a6be9e-da66-47a2-9457-14ac1d052d4f None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:20.808124 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a6be9e-da66-47a2-9457-14ac1d052d4f None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:20.843509 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da63c54e-dbc9-419e-9905-3f16e066bedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:20.844125 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63c54e-dbc9-419e-9905-3f16e066bedc None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:20.844405 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63c54e-dbc9-419e-9905-3f16e066bedc None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:20.844695 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63c54e-dbc9-419e-9905-3f16e066bedc None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:20.845331 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da63c54e-dbc9-419e-9905-3f16e066bedc None admin] RBAC: Adding query filter params (name=image) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:20.845635 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da63c54e-dbc9-419e-9905-3f16e066bedc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:20.847007 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da63c54e-dbc9-419e-9905-3f16e066bedc None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:20.852358 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 509/1030] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:15:20 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:20.858166 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd496a-d225-48b5-8906-a1e315aeb8db None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:20.907262 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:20.959874 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da63c54e-dbc9-419e-9905-3f16e066bedc None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:20.968565 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd496a-d225-48b5-8906-a1e315aeb8db None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:20.975898 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:21.009918 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c5fba1-6dd8-43e7-adfe-ea33727de665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:21.010837 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5fba1-6dd8-43e7-adfe-ea33727de665 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:21.011117 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5fba1-6dd8-43e7-adfe-ea33727de665 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:21.011383 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5fba1-6dd8-43e7-adfe-ea33727de665 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:21.012013 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c5fba1-6dd8-43e7-adfe-ea33727de665 None admin] RBAC: Adding query filter params (type=image) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:21.012312 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c5fba1-6dd8-43e7-adfe-ea33727de665 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:21.013702 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c5fba1-6dd8-43e7-adfe-ea33727de665 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:21.019138 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 522/1031] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:15:20 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:21.024868 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c5fba1-6dd8-43e7-adfe-ea33727de665 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:21.074564 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da63c54e-dbc9-419e-9905-3f16e066bedc None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:21.114745 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40646f0-1a56-40fe-aac5-9d500c094f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:21.115693 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40646f0-1a56-40fe-aac5-9d500c094f08 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:21.116119 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40646f0-1a56-40fe-aac5-9d500c094f08 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:21.116610 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40646f0-1a56-40fe-aac5-9d500c094f08 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:21.126885 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c5fba1-6dd8-43e7-adfe-ea33727de665 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:21.128838 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40646f0-1a56-40fe-aac5-9d500c094f08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:15:21.129301 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:21.135791 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-f40646f0-1a56-40fe-aac5-9d500c094f08 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 22:15:21.135791 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:21.135791 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:15:21.135791 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:15:21.135791 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:15:21.135791 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:15:21.135791 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:15:21.135791 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:15:21.135791 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:15:21.135791 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:15:21.135791 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:15:21.135791 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:15:21.135791 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:15:21.135791 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:15:21.135791 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:15:21.135791 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:15:21.137000 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:15:21.137000 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:15:21.137000 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:15:21.137000 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:15:21.137000 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:15:21.137000 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:15:21.137000 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:15:21.137000 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:15:21.137000 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:15:21.137000 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:15:21.137000 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:15:21.137000 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:15:21.137000 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:15:21.137000 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:15:21.137000 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:15:21.137000 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:15:21.137855 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:15:21.137855 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:15:21.137855 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:15:21.137855 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:15:21.137855 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:15:21.137855 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:15:21.137855 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:15:21.137855 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:15:21.137855 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:15:21.137855 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:15:21.137855 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 22:15:21.137855 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:15:21.137855 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 510/1032] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Aug 29 22:15:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:15:21.145221 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40646f0-1a56-40fe-aac5-9d500c094f08 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:21.169947 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8d2450-a8aa-4f5e-9aea-0934c6402f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:21.170550 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d2450-a8aa-4f5e-9aea-0934c6402f06 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:21.171537 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d2450-a8aa-4f5e-9aea-0934c6402f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:21.171829 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d2450-a8aa-4f5e-9aea-0934c6402f06 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:21.172597 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8d2450-a8aa-4f5e-9aea-0934c6402f06 None admin] RBAC: Adding query filter params (interface=public, service_id=1d1a76fce71f458fbff4a42fabd6c364, region_id=RegionOne) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:21.172915 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8d2450-a8aa-4f5e-9aea-0934c6402f06 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:21.174284 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8d2450-a8aa-4f5e-9aea-0934c6402f06 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:21.179520 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 523/1033] 10.222.0.36 () {56 vars in 1251 bytes} [Mon Aug 29 22:15:21 2022] GET /identity/v3/endpoints?service_id=1d1a76fce71f458fbff4a42fabd6c364&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:15:21.185149 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8d2450-a8aa-4f5e-9aea-0934c6402f06 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:21.229226 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:21.263700 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40646f0-1a56-40fe-aac5-9d500c094f08 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:21.293770 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8d2450-a8aa-4f5e-9aea-0934c6402f06 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:21.301554 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65d11f-8773-4cf8-a11b-c995a3e3ff4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:21.302464 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65d11f-8773-4cf8-a11b-c995a3e3ff4e None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:21.302968 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65d11f-8773-4cf8-a11b-c995a3e3ff4e None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:21.303247 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65d11f-8773-4cf8-a11b-c995a3e3ff4e None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:21.303914 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a65d11f-8773-4cf8-a11b-c995a3e3ff4e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:21.304219 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a65d11f-8773-4cf8-a11b-c995a3e3ff4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:21.305969 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a65d11f-8773-4cf8-a11b-c995a3e3ff4e None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:21.314583 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 511/1034] 10.222.0.36 () {56 vars in 1115 bytes} [Mon Aug 29 22:15:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:15:21.320713 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65d11f-8773-4cf8-a11b-c995a3e3ff4e None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:21.329896 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef540e98-abc5-4398-9a3a-7cbee1364864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:21.330525 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef540e98-abc5-4398-9a3a-7cbee1364864 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:21.330805 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef540e98-abc5-4398-9a3a-7cbee1364864 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:21.331124 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef540e98-abc5-4398-9a3a-7cbee1364864 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:21.331740 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef540e98-abc5-4398-9a3a-7cbee1364864 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:21.333176 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef540e98-abc5-4398-9a3a-7cbee1364864 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:21.340265 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 524/1035] 10.222.0.36 () {56 vars in 1087 bytes} [Mon Aug 29 22:15:21 2022] GET /identity/v3/services => generated 1957 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:15:21.442861 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65d11f-8773-4cf8-a11b-c995a3e3ff4e None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:21.483197 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6c38c-4577-4eb1-a868-08d160ee65aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:21.483197 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6c38c-4577-4eb1-a868-08d160ee65aa None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:21.483454 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6c38c-4577-4eb1-a868-08d160ee65aa None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:21.483684 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6c38c-4577-4eb1-a868-08d160ee65aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:21.485694 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:21.500476 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f6c38c-4577-4eb1-a868-08d160ee65aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:21.500476 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f6c38c-4577-4eb1-a868-08d160ee65aa None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:21.515734 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-f3f6c38c-4577-4eb1-a868-08d160ee65aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:15:21.515734 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:21.515734 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:15:21.515734 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:15:21.515734 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:15:21.515734 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:15:21.515734 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:15:21.515734 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:15:21.515734 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:15:21.515734 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:15:21.515734 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:15:21.515734 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:15:21.515734 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:15:21.515734 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:15:21.515734 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:15:21.515734 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:15:21.516834 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:15:21.516834 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:15:21.516834 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:15:21.516834 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:15:21.516834 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:15:21.516834 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:15:21.516834 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:15:21.516834 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:15:21.516834 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:15:21.516834 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:15:21.516834 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:15:21.516834 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:15:21.516834 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:15:21.516834 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:15:21.516834 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:15:21.516834 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:15:21.516834 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:15:21.517742 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:15:21.517742 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:15:21.517742 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:15:21.520537 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 512/1036] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:15:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:15:21.523168 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef540e98-abc5-4398-9a3a-7cbee1364864 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:21.560587 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:21.640238 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef540e98-abc5-4398-9a3a-7cbee1364864 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:21.675874 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ca530-cb62-4b4d-a65e-e0d7bf8bde4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:21.676504 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ca530-cb62-4b4d-a65e-e0d7bf8bde4e None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:21.676795 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ca530-cb62-4b4d-a65e-e0d7bf8bde4e None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:21.677068 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ca530-cb62-4b4d-a65e-e0d7bf8bde4e None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:21.677714 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9ca530-cb62-4b4d-a65e-e0d7bf8bde4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:21.678020 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9ca530-cb62-4b4d-a65e-e0d7bf8bde4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:21.679388 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9ca530-cb62-4b4d-a65e-e0d7bf8bde4e None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:21.692027 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 525/1037] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:15:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:21.697934 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6c38c-4577-4eb1-a868-08d160ee65aa None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:21.804834 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6c38c-4577-4eb1-a868-08d160ee65aa None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:21.839042 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b546ea6-ba12-4b77-9c03-d6689e3ce829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:21.839713 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b546ea6-ba12-4b77-9c03-d6689e3ce829 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:21.839944 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b546ea6-ba12-4b77-9c03-d6689e3ce829 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:21.840223 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b546ea6-ba12-4b77-9c03-d6689e3ce829 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:21.848979 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b546ea6-ba12-4b77-9c03-d6689e3ce829 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:21.850514 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b546ea6-ba12-4b77-9c03-d6689e3ce829 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:21.865895 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-3b546ea6-ba12-4b77-9c03-d6689e3ce829 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:15:21.865895 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:21.865895 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:15:21.865895 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:15:21.865895 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:15:21.865895 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:15:21.865895 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:15:21.865895 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:15:21.865895 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:15:21.865895 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:15:21.865895 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:15:21.865895 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:15:21.865895 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:15:21.865895 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:15:21.865895 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:15:21.865895 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:15:21.866923 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:15:21.866923 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:15:21.866923 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:15:21.866923 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:15:21.866923 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:15:21.866923 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:15:21.866923 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:15:21.866923 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:15:21.866923 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:15:21.866923 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:15:21.866923 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:15:21.866923 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:15:21.866923 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:15:21.866923 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:15:21.866923 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:15:21.866923 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:15:21.866923 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:15:21.866923 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:15:21.873110 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:15:21.873110 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:15:21.873110 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:15:21.873110 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:15:21.873110 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:15:21.873110 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:15:21.873110 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:15:21.873110 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:15:21.873110 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:15:21.873110 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:15:21.873110 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 513/1038] 10.222.0.36 () {56 vars in 1093 bytes} [Mon Aug 29 22:15:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:15:21.875349 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ca530-cb62-4b4d-a65e-e0d7bf8bde4e None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:21.977262 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:21.987383 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ca530-cb62-4b4d-a65e-e0d7bf8bde4e None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:22.023191 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584030e4-d7a3-4977-aa92-e37ab4af55d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:22.023875 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584030e4-d7a3-4977-aa92-e37ab4af55d9 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:22.024281 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584030e4-d7a3-4977-aa92-e37ab4af55d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:22.024590 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584030e4-d7a3-4977-aa92-e37ab4af55d9 None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:22.025331 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584030e4-d7a3-4977-aa92-e37ab4af55d9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:22.025639 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584030e4-d7a3-4977-aa92-e37ab4af55d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:22.027100 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584030e4-d7a3-4977-aa92-e37ab4af55d9 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:22.045341 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 526/1039] 10.222.0.36 () {56 vars in 1133 bytes} [Mon Aug 29 22:15:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:22.051179 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b546ea6-ba12-4b77-9c03-d6689e3ce829 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:22.103631 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:22.162210 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b546ea6-ba12-4b77-9c03-d6689e3ce829 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:22.198928 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d616949b-dd28-4fd2-b4fe-b824b70552bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:22.199548 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616949b-dd28-4fd2-b4fe-b824b70552bd None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:22.199828 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616949b-dd28-4fd2-b4fe-b824b70552bd None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:22.200099 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616949b-dd28-4fd2-b4fe-b824b70552bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:22.268594 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d616949b-dd28-4fd2-b4fe-b824b70552bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:22.270039 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d616949b-dd28-4fd2-b4fe-b824b70552bd None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:22.319087 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:22.377120 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 514/1040] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:15:22 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:15:22.382572 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584030e4-d7a3-4977-aa92-e37ab4af55d9 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:22.477715 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ec795-3a26-4991-9d02-b863261797a2 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:22.477996 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ec795-3a26-4991-9d02-b863261797a2 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:22.478283 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ec795-3a26-4991-9d02-b863261797a2 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:22.479646 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 515/1041] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:15:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:15:22.484177 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584030e4-d7a3-4977-aa92-e37ab4af55d9 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:22.484634 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea0754-47ab-47f0-a424-dd70d507ad6a None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:22.484918 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea0754-47ab-47f0-a424-dd70d507ad6a None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:22.485192 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea0754-47ab-47f0-a424-dd70d507ad6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:22.503391 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-d4ea0754-47ab-47f0-a424-dd70d507ad6a None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:15:22.504593 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-d4ea0754-47ab-47f0-a424-dd70d507ad6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:15:22.524009 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3385e-621d-4b16-9cdb-a513fd2e3a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:22.524554 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3385e-621d-4b16-9cdb-a513fd2e3a27 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:22.524838 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3385e-621d-4b16-9cdb-a513fd2e3a27 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:22.525538 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3385e-621d-4b16-9cdb-a513fd2e3a27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:22.538080 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c3385e-621d-4b16-9cdb-a513fd2e3a27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:22.539662 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c3385e-621d-4b16-9cdb-a513fd2e3a27 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:22.554906 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-b5c3385e-621d-4b16-9cdb-a513fd2e3a27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:15:22.554906 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:22.554906 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:15:22.554906 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:15:22.554906 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:15:22.554906 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:15:22.554906 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:15:22.554906 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:15:22.554906 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:15:22.554906 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:15:22.554906 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:15:22.554906 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:15:22.554906 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:15:22.554906 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:15:22.554906 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:15:22.554906 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:15:22.555923 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:15:22.555923 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:15:22.555923 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:15:22.555923 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:15:22.555923 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:15:22.555923 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:15:22.555923 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:15:22.555923 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:15:22.555923 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:15:22.555923 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:15:22.555923 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:15:22.555923 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:15:22.555923 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:15:22.555923 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:15:22.555923 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:15:22.555923 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:15:22.555923 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:15:22.557003 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:15:22.557003 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:15:22.557003 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:15:22.557003 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 527/1042] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:15:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:15:22.561984 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3385e-621d-4b16-9cdb-a513fd2e3a27 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:22.565382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:22.584501 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 516/1043] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:15:22 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:15:22.665900 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3385e-621d-4b16-9cdb-a513fd2e3a27 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:22.698766 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afd7337-a0b1-42c2-8d0e-553eacbe69bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:22.699377 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd7337-a0b1-42c2-8d0e-553eacbe69bd None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:22.699656 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd7337-a0b1-42c2-8d0e-553eacbe69bd None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:22.699926 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd7337-a0b1-42c2-8d0e-553eacbe69bd None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:22.700597 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afd7337-a0b1-42c2-8d0e-553eacbe69bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:22.700904 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afd7337-a0b1-42c2-8d0e-553eacbe69bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:22.702279 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afd7337-a0b1-42c2-8d0e-553eacbe69bd None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:22.714516 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 528/1044] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:15:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:15:22.720121 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea0754-47ab-47f0-a424-dd70d507ad6a None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:22.799785 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:22.824859 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea0754-47ab-47f0-a424-dd70d507ad6a None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:22.843978 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afd7337-a0b1-42c2-8d0e-553eacbe69bd None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:22.861780 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626fdda4-f996-47fb-b43c-78cce712b202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:22.862524 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626fdda4-f996-47fb-b43c-78cce712b202 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:22.862987 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626fdda4-f996-47fb-b43c-78cce712b202 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:22.863245 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626fdda4-f996-47fb-b43c-78cce712b202 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:22.870525 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626fdda4-f996-47fb-b43c-78cce712b202 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:22.871950 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626fdda4-f996-47fb-b43c-78cce712b202 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:22.883784 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-626fdda4-f996-47fb-b43c-78cce712b202 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:15:22.883784 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:22.883784 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:15:22.883784 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:15:22.883784 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:15:22.883784 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:15:22.883784 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:15:22.883784 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:15:22.883784 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:15:22.883784 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:15:22.883784 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:15:22.883784 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:15:22.883784 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:15:22.883784 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:15:22.883784 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:15:22.884759 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:15:22.884759 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:15:22.884759 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:15:22.884759 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:15:22.884759 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:15:22.884759 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:15:22.884759 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:15:22.884759 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:15:22.884759 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:15:22.884759 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:15:22.884759 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:15:22.884759 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:15:22.884759 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:15:22.884759 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:15:22.884759 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:15:22.884759 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:15:22.884759 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:15:22.885797 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:15:22.885797 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:15:22.885797 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:15:22.885797 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:15:22.885797 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:15:22.885797 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:15:22.885797 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:15:22.885797 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:15:22.885797 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 517/1045] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Aug 29 22:15:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:15:22.891024 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626fdda4-f996-47fb-b43c-78cce712b202 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:22.923354 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:22.963551 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afd7337-a0b1-42c2-8d0e-553eacbe69bd None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:22.999014 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626fdda4-f996-47fb-b43c-78cce712b202 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:23.000196 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baae4eb-ac28-49e7-9af1-b637834a5f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:23.000895 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baae4eb-ac28-49e7-9af1-b637834a5f93 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:23.001176 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baae4eb-ac28-49e7-9af1-b637834a5f93 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:23.002157 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baae4eb-ac28-49e7-9af1-b637834a5f93 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:23.012507 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baae4eb-ac28-49e7-9af1-b637834a5f93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:15:23.017893 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-9baae4eb-ac28-49e7-9af1-b637834a5f93 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:15:23.017893 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:23.017893 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:15:23.017893 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:15:23.017893 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:15:23.017893 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:15:23.017893 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:15:23.017893 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:15:23.017893 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:15:23.017893 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:15:23.017893 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:15:23.017893 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:15:23.017893 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:15:23.017893 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:15:23.017893 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:15:23.017893 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:15:23.020698 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:15:23.020698 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:15:23.020698 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:15:23.020698 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:15:23.020698 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:15:23.020698 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:15:23.020698 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:15:23.020698 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:15:23.020698 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:15:23.020698 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:15:23.020698 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:15:23.020698 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:15:23.020698 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:15:23.020698 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:15:23.020698 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:15:23.020698 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:15:23.021795 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:15:23.021795 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:15:23.021795 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:15:23.021795 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:15:23.021795 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:15:23.021795 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:15:23.021795 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:15:23.021795 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:15:23.021795 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:15:23.021795 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:15:23.021795 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:15:23.021795 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:15:23.021795 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 529/1046] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Aug 29 22:15:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:15:23.025041 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baae4eb-ac28-49e7-9af1-b637834a5f93 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:23.040071 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca71755-3e75-4f03-8bc0-0e175e184771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:23.040715 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca71755-3e75-4f03-8bc0-0e175e184771 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:23.040999 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca71755-3e75-4f03-8bc0-0e175e184771 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:23.041277 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca71755-3e75-4f03-8bc0-0e175e184771 None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:23.041977 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca71755-3e75-4f03-8bc0-0e175e184771 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:23.042282 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca71755-3e75-4f03-8bc0-0e175e184771 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:23.043724 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca71755-3e75-4f03-8bc0-0e175e184771 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:23.046687 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:23.063992 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 518/1047] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Aug 29 22:15:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:15:23.065105 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca71755-3e75-4f03-8bc0-0e175e184771 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:23.131896 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baae4eb-ac28-49e7-9af1-b637834a5f93 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:23.156504 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:23.169305 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe9f9c-d456-4786-82ab-bb3943559cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:23.169920 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe9f9c-d456-4786-82ab-bb3943559cff None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:23.170199 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe9f9c-d456-4786-82ab-bb3943559cff None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:23.170470 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe9f9c-d456-4786-82ab-bb3943559cff None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:23.171143 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfe9f9c-d456-4786-82ab-bb3943559cff None admin] RBAC: Adding query filter params (name=admin) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:23.171445 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfe9f9c-d456-4786-82ab-bb3943559cff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:23.172843 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfe9f9c-d456-4786-82ab-bb3943559cff None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:23.175708 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca71755-3e75-4f03-8bc0-0e175e184771 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:23.182228 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 530/1048] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:15:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:15:23.188676 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe9f9c-d456-4786-82ab-bb3943559cff None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:23.215640 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5e499-4865-4856-895a-b1f8a84eaf88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:23.216261 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5e499-4865-4856-895a-b1f8a84eaf88 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:23.216567 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5e499-4865-4856-895a-b1f8a84eaf88 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:23.216840 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5e499-4865-4856-895a-b1f8a84eaf88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:23.217596 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5e499-4865-4856-895a-b1f8a84eaf88 None admin] RBAC: Adding query filter params (role.id=1689c28a8f8945838ea7fd3cb4cfc598, scope.project.id=696ed25cc0cb43fab4bfaf762a90da54, user.id=90b7213b7111456a93e294ce40b95b21) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:23.217905 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5e499-4865-4856-895a-b1f8a84eaf88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:23.219367 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5e499-4865-4856-895a-b1f8a84eaf88 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:23.232494 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 519/1049] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Aug 29 22:15:23 2022] GET /identity/v3/role_assignments?user.id=90b7213b7111456a93e294ce40b95b21&scope.project.id=696ed25cc0cb43fab4bfaf762a90da54&role.id=1689c28a8f8945838ea7fd3cb4cfc598 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:23.268469 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0e3cf-46de-4b0e-9458-90717c36aa93 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:23.268853 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0e3cf-46de-4b0e-9458-90717c36aa93 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:23.269055 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0e3cf-46de-4b0e-9458-90717c36aa93 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:23.272681 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 520/1050] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:15:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:15:23.278491 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2d513-44e1-4687-b079-1a4dd7290648 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:23.278804 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2d513-44e1-4687-b079-1a4dd7290648 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:23.279038 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2d513-44e1-4687-b079-1a4dd7290648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:23.302368 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-59a2d513-44e1-4687-b079-1a4dd7290648 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:15:23.304324 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-59a2d513-44e1-4687-b079-1a4dd7290648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:15:23.310552 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe9f9c-d456-4786-82ab-bb3943559cff None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:23.360191 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae6a861-4c2b-427f-badd-d728f24fc5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:23.360883 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6a861-4c2b-427f-badd-d728f24fc5e1 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:23.361157 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6a861-4c2b-427f-badd-d728f24fc5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:23.361425 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6a861-4c2b-427f-badd-d728f24fc5e1 None admin] PATH_INFO: `/v3/users/f208852d4db643d8815e6308d9ab380d` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:23.376863 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:23.380170 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae6a861-4c2b-427f-badd-d728f24fc5e1 None admin] RBAC: Authorizing `identity:get_user(user_id=f208852d4db643d8815e6308d9ab380d)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:23.381663 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae6a861-4c2b-427f-badd-d728f24fc5e1 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:23.383605 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 531/1051] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Aug 29 22:15:23 2022] GET /identity/v3/users/f208852d4db643d8815e6308d9ab380d => generated 285 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:15:23.389898 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae6a861-4c2b-427f-badd-d728f24fc5e1 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:23.393146 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 521/1052] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:15:23 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:15:23.433102 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:23.490653 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae6a861-4c2b-427f-badd-d728f24fc5e1 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:23.525618 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe0fe75-6cb9-4781-a86d-8fd2e9dc64ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:23.526250 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0fe75-6cb9-4781-a86d-8fd2e9dc64ae None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:23.526524 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0fe75-6cb9-4781-a86d-8fd2e9dc64ae None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:23.526792 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0fe75-6cb9-4781-a86d-8fd2e9dc64ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:23.598308 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe0fe75-6cb9-4781-a86d-8fd2e9dc64ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:23.599749 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe0fe75-6cb9-4781-a86d-8fd2e9dc64ae None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:23.642569 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:23.657351 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a2d513-44e1-4687-b079-1a4dd7290648 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:23.711601 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 532/1053] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:15:23 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 22:15:23.712686 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe0fe75-6cb9-4781-a86d-8fd2e9dc64ae None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:23.768819 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a2d513-44e1-4687-b079-1a4dd7290648 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:23.803433 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac572c7-2f55-424e-b1ff-d950c0220549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:23.804129 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac572c7-2f55-424e-b1ff-d950c0220549 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:23.804695 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac572c7-2f55-424e-b1ff-d950c0220549 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:23.804978 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac572c7-2f55-424e-b1ff-d950c0220549 None admin] PATH_INFO: `/v3/services/image` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:23.805740 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac572c7-2f55-424e-b1ff-d950c0220549 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:23.807132 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac572c7-2f55-424e-b1ff-d950c0220549 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:23.813725 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe0fe75-6cb9-4781-a86d-8fd2e9dc64ae None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:23.815980 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-3ac572c7-2f55-424e-b1ff-d950c0220549 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 22:15:23.815980 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:23.815980 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:15:23.815980 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:15:23.815980 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:15:23.815980 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:15:23.815980 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:15:23.815980 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:15:23.815980 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 22:15:23.815980 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:15:23.815980 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:15:23.815980 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:15:23.815980 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:23.815980 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:15:23.815980 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:15:23.815980 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:15:23.815980 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:15:23.817054 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:15:23.817054 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:15:23.817054 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:15:23.817054 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:15:23.817054 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:15:23.817054 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:15:23.817054 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:15:23.817054 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:15:23.817054 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:15:23.817054 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:15:23.817054 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:15:23.817054 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:15:23.817054 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:15:23.817054 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:15:23.817054 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:15:23.817054 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:15:23.817944 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:15:23.817944 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:15:23.817944 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:15:23.817944 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:15:23.817944 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:15:23.817944 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:15:23.817944 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:15:23.817944 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:15:23.817944 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:15:23.817944 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:15:23.817944 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:15:23.817944 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:15:23.817944 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 22:15:23.817944 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:15:23.817944 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 522/1054] 10.222.0.36 () {56 vars in 1105 bytes} [Mon Aug 29 22:15:23 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:15:23.822939 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac572c7-2f55-424e-b1ff-d950c0220549 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:23.854283 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045808d4-7c74-466a-bf0d-cdf90e4e03c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:23.855072 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045808d4-7c74-466a-bf0d-cdf90e4e03c9 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:23.855414 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045808d4-7c74-466a-bf0d-cdf90e4e03c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:23.855751 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045808d4-7c74-466a-bf0d-cdf90e4e03c9 None admin] PATH_INFO: `/v3/projects/d919c6585dac4128a3708fffd216d4da` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:23.857084 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045808d4-7c74-466a-bf0d-cdf90e4e03c9 None admin] RBAC: Authorizing `identity:get_project(project_id=d919c6585dac4128a3708fffd216d4da)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:23.858579 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045808d4-7c74-466a-bf0d-cdf90e4e03c9 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:23.860853 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 533/1055] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Aug 29 22:15:23 2022] GET /identity/v3/projects/d919c6585dac4128a3708fffd216d4da => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:23.866538 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045808d4-7c74-466a-bf0d-cdf90e4e03c9 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:23.881724 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:23.886424 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:23.938131 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac572c7-2f55-424e-b1ff-d950c0220549 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:23.975507 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045808d4-7c74-466a-bf0d-cdf90e4e03c9 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:23.977328 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10225679-6eeb-456c-a8a1-a0cc779edfee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:23.977955 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10225679-6eeb-456c-a8a1-a0cc779edfee None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:23.979018 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10225679-6eeb-456c-a8a1-a0cc779edfee None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:23.979299 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10225679-6eeb-456c-a8a1-a0cc779edfee None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:23.979945 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10225679-6eeb-456c-a8a1-a0cc779edfee None admin] RBAC: Adding query filter params (name=image) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:23.980254 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10225679-6eeb-456c-a8a1-a0cc779edfee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:23.981667 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10225679-6eeb-456c-a8a1-a0cc779edfee None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:23.987452 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 523/1056] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:15:23 2022] GET /identity/v3/services?name=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:23.992844 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10225679-6eeb-456c-a8a1-a0cc779edfee None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:24.017716 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a2f46-c6ff-44f2-81a3-5ae5b82f11ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:24.018504 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a2f46-c6ff-44f2-81a3-5ae5b82f11ef None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:24.018708 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a2f46-c6ff-44f2-81a3-5ae5b82f11ef None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:24.018986 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a2f46-c6ff-44f2-81a3-5ae5b82f11ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:24.019684 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58a2f46-c6ff-44f2-81a3-5ae5b82f11ef None admin] RBAC: Adding query filter params (role.id=ff59a239a50b4bd899a83bf3c3fd1f63, scope.project.id=d919c6585dac4128a3708fffd216d4da, user.id=f208852d4db643d8815e6308d9ab380d) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:24.019991 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58a2f46-c6ff-44f2-81a3-5ae5b82f11ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:24.021445 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58a2f46-c6ff-44f2-81a3-5ae5b82f11ef None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:24.027360 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 534/1057] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Aug 29 22:15:23 2022] GET /identity/v3/role_assignments?user.id=f208852d4db643d8815e6308d9ab380d&scope.project.id=d919c6585dac4128a3708fffd216d4da&role.id=ff59a239a50b4bd899a83bf3c3fd1f63 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:24.105838 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10225679-6eeb-456c-a8a1-a0cc779edfee None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:24.125097 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:24.145375 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffbe78c-5d67-4cdf-946d-7a1900689ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:24.146012 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffbe78c-5d67-4cdf-946d-7a1900689ff7 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:24.146291 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffbe78c-5d67-4cdf-946d-7a1900689ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:24.146573 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffbe78c-5d67-4cdf-946d-7a1900689ff7 None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:24.147250 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffbe78c-5d67-4cdf-946d-7a1900689ff7 None admin] RBAC: Adding query filter params (type=image) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:24.147554 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffbe78c-5d67-4cdf-946d-7a1900689ff7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:24.149165 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffbe78c-5d67-4cdf-946d-7a1900689ff7 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:24.154726 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 524/1058] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:15:23 2022] GET /identity/v3/services?type=image => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:15:24.160441 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a2f46-c6ff-44f2-81a3-5ae5b82f11ef None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:24.238469 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:24.264120 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a2f46-c6ff-44f2-81a3-5ae5b82f11ef None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:24.299114 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d41f32-e4ba-4dd9-a437-3b2627f4c188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:24.299727 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d41f32-e4ba-4dd9-a437-3b2627f4c188 None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:24.300005 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d41f32-e4ba-4dd9-a437-3b2627f4c188 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:24.300277 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d41f32-e4ba-4dd9-a437-3b2627f4c188 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:24.301003 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d41f32-e4ba-4dd9-a437-3b2627f4c188 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:24.302372 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d41f32-e4ba-4dd9-a437-3b2627f4c188 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:24.325854 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 535/1059] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:15:24 2022] POST /identity/v3/endpoints => generated 327 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:15:25.185319 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014bdd81-3290-416e-a6fc-dad8b44e6dc2 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:25.185852 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014bdd81-3290-416e-a6fc-dad8b44e6dc2 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:25.185852 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014bdd81-3290-416e-a6fc-dad8b44e6dc2 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:25.187097 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 525/1060] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:15:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:15:25.192639 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce4709-a77c-448c-be65-aae5b2008a94 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:25.193066 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce4709-a77c-448c-be65-aae5b2008a94 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:25.193244 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce4709-a77c-448c-be65-aae5b2008a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:25.213364 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-6cce4709-a77c-448c-be65-aae5b2008a94 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:15:25.214556 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-6cce4709-a77c-448c-be65-aae5b2008a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:15:25.291956 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 536/1061] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:15:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:15:25.571984 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014bdd81-3290-416e-a6fc-dad8b44e6dc2 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:25.707949 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014bdd81-3290-416e-a6fc-dad8b44e6dc2 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:25.754847 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f2bee6-cbc1-4b08-b70d-58374c920189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:25.755497 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2bee6-cbc1-4b08-b70d-58374c920189 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:25.755776 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2bee6-cbc1-4b08-b70d-58374c920189 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:25.756047 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2bee6-cbc1-4b08-b70d-58374c920189 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:25.767708 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f2bee6-cbc1-4b08-b70d-58374c920189 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:15:25.772574 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-73f2bee6-cbc1-4b08-b70d-58374c920189 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 22:15:25.772574 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:25.772574 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:15:25.772574 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:15:25.772574 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:15:25.772574 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:15:25.772574 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:15:25.772574 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:15:25.772574 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:15:25.772574 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:15:25.772574 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:15:25.772574 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:15:25.772574 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:15:25.772574 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:15:25.772574 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:15:25.772574 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:15:25.773539 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:15:25.773539 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:15:25.773539 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:15:25.773539 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:15:25.773539 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:15:25.773539 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:15:25.773539 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:15:25.773539 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:15:25.773539 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:15:25.773539 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:15:25.773539 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:15:25.773539 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:15:25.773539 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:15:25.773539 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:15:25.773539 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:15:25.773539 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:15:25.777298 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:15:25.777298 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:15:25.777298 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:15:25.777298 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:15:25.777298 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:15:25.777298 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:15:25.777298 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:15:25.777298 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:15:25.777298 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:15:25.777298 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:15:25.777298 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 22:15:25.777298 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:15:25.777298 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 526/1062] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Aug 29 22:15:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:15:25.780136 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce4709-a77c-448c-be65-aae5b2008a94 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:25.839140 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:25.893745 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce4709-a77c-448c-be65-aae5b2008a94 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:25.929143 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb6bf8b-bdd8-4d7a-bad0-60fc6a0d1e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:25.929831 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6bf8b-bdd8-4d7a-bad0-60fc6a0d1e45 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:25.930141 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6bf8b-bdd8-4d7a-bad0-60fc6a0d1e45 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:25.930411 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6bf8b-bdd8-4d7a-bad0-60fc6a0d1e45 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:25.931078 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb6bf8b-bdd8-4d7a-bad0-60fc6a0d1e45 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:25.931378 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb6bf8b-bdd8-4d7a-bad0-60fc6a0d1e45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:25.932764 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb6bf8b-bdd8-4d7a-bad0-60fc6a0d1e45 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:25.944501 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 537/1063] 10.222.0.36 () {56 vars in 1115 bytes} [Mon Aug 29 22:15:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:15:25.946494 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1feaec-fa63-4640-b61b-725e94a1ffa0 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:25.946782 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1feaec-fa63-4640-b61b-725e94a1ffa0 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:25.946981 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb6bf8b-bdd8-4d7a-bad0-60fc6a0d1e45 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:25.947084 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1feaec-fa63-4640-b61b-725e94a1ffa0 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:25.949135 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 527/1064] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:15:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:15:25.954178 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f3065-188c-4785-8ee5-acb094662bb6 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:25.954430 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f3065-188c-4785-8ee5-acb094662bb6 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:25.954729 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f3065-188c-4785-8ee5-acb094662bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:25.972902 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-988f3065-188c-4785-8ee5-acb094662bb6 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:15:25.974106 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-988f3065-188c-4785-8ee5-acb094662bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:15:26.013073 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:26.051179 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 528/1065] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:15:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:15:26.056822 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb6bf8b-bdd8-4d7a-bad0-60fc6a0d1e45 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:26.078608 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:26.098180 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f29d2ef-eae5-4bb8-a76e-a32fb45b64b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:26.099109 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29d2ef-eae5-4bb8-a76e-a32fb45b64b6 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:26.099555 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29d2ef-eae5-4bb8-a76e-a32fb45b64b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:26.099975 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29d2ef-eae5-4bb8-a76e-a32fb45b64b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:26.111557 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f29d2ef-eae5-4bb8-a76e-a32fb45b64b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:26.113219 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f29d2ef-eae5-4bb8-a76e-a32fb45b64b6 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:26.128252 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-8f29d2ef-eae5-4bb8-a76e-a32fb45b64b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:15:26.128252 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:26.128252 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:15:26.128252 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:15:26.128252 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:15:26.128252 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:15:26.128252 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:15:26.128252 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:15:26.128252 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:15:26.128252 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:15:26.128252 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:15:26.128252 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:15:26.128252 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:15:26.128252 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:15:26.128252 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:15:26.128252 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:15:26.129443 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:15:26.129443 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:15:26.129443 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:15:26.129443 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:15:26.129443 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:15:26.129443 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:15:26.129443 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:15:26.129443 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:15:26.129443 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:15:26.129443 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:15:26.129443 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:15:26.129443 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:15:26.129443 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:15:26.129443 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:15:26.129443 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:15:26.129443 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:15:26.129443 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:15:26.130581 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:15:26.130581 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:15:26.130581 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:15:26.131967 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 538/1066] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:15:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:15:26.138623 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f3065-188c-4785-8ee5-acb094662bb6 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:26.247124 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b44b3-0403-4482-8319-a7386ab02c2e None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:26.247656 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b44b3-0403-4482-8319-a7386ab02c2e None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:26.247656 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b44b3-0403-4482-8319-a7386ab02c2e None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:26.248244 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f3065-188c-4785-8ee5-acb094662bb6 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:26.249309 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 539/1067] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:15:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:15:26.254123 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa13efc-8f24-4b0f-9cc7-5fc3675a1de0 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:26.254410 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa13efc-8f24-4b0f-9cc7-5fc3675a1de0 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:26.254686 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa13efc-8f24-4b0f-9cc7-5fc3675a1de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:26.275041 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-0aa13efc-8f24-4b0f-9cc7-5fc3675a1de0 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:15:26.276258 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-0aa13efc-8f24-4b0f-9cc7-5fc3675a1de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:15:26.288092 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21707b3c-50da-4453-9242-b283b1c3f59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:26.289187 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21707b3c-50da-4453-9242-b283b1c3f59b None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:26.289856 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21707b3c-50da-4453-9242-b283b1c3f59b None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:26.290189 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21707b3c-50da-4453-9242-b283b1c3f59b None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:26.290847 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21707b3c-50da-4453-9242-b283b1c3f59b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:26.291165 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21707b3c-50da-4453-9242-b283b1c3f59b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:26.292568 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21707b3c-50da-4453-9242-b283b1c3f59b None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:26.304559 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 529/1068] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:15:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:26.310385 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21707b3c-50da-4453-9242-b283b1c3f59b None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:26.345429 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:26.354809 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 540/1069] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:15:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:15:26.355572 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa13efc-8f24-4b0f-9cc7-5fc3675a1de0 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:26.420342 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21707b3c-50da-4453-9242-b283b1c3f59b None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:26.455987 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d343845a-f907-48f0-81b0-21f922670044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:26.456654 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343845a-f907-48f0-81b0-21f922670044 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:26.456937 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343845a-f907-48f0-81b0-21f922670044 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:26.457212 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343845a-f907-48f0-81b0-21f922670044 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:26.459050 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:26.462696 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa13efc-8f24-4b0f-9cc7-5fc3675a1de0 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:26.466303 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d343845a-f907-48f0-81b0-21f922670044 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:26.467795 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d343845a-f907-48f0-81b0-21f922670044 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:26.484084 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-d343845a-f907-48f0-81b0-21f922670044 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:15:26.484084 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:26.484084 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:15:26.484084 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:15:26.484084 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:15:26.484084 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:15:26.484084 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:15:26.484084 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:15:26.484084 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:15:26.484084 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:15:26.484084 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:15:26.484084 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:15:26.484084 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:15:26.484084 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:15:26.484084 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:15:26.484084 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:15:26.485320 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:15:26.485320 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:15:26.485320 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:15:26.485320 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:15:26.485320 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:15:26.485320 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:15:26.485320 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:15:26.485320 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:15:26.485320 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:15:26.485320 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:15:26.485320 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:15:26.485320 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:15:26.485320 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:15:26.485320 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:15:26.485320 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:15:26.485320 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:15:26.485320 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:15:26.485320 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:15:26.486314 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:15:26.486314 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:15:26.486314 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:15:26.486314 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:15:26.486314 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:15:26.486314 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:15:26.486314 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:15:26.486314 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:15:26.486314 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:15:26.486314 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:15:26.486314 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 530/1070] 10.222.0.36 () {56 vars in 1093 bytes} [Mon Aug 29 22:15:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:15:26.491080 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d343845a-f907-48f0-81b0-21f922670044 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:26.506899 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f4764-add0-4c22-8eb4-10bd76425726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:26.508031 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f4764-add0-4c22-8eb4-10bd76425726 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:26.508559 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f4764-add0-4c22-8eb4-10bd76425726 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:26.508841 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f4764-add0-4c22-8eb4-10bd76425726 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:26.519954 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06f4764-add0-4c22-8eb4-10bd76425726 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:15:26.525148 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-a06f4764-add0-4c22-8eb4-10bd76425726 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:15:26.525148 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:26.525148 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:15:26.525148 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:15:26.525148 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:15:26.525148 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:15:26.525148 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:15:26.525148 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:15:26.525148 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:15:26.525148 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:15:26.525148 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:15:26.525148 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:15:26.525148 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:15:26.525148 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:15:26.525148 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:15:26.525148 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:15:26.526132 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:15:26.526132 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:15:26.526132 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:15:26.526132 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:15:26.526132 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:15:26.526132 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:15:26.526132 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:15:26.526132 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:15:26.526132 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:15:26.526132 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:15:26.526132 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:15:26.526132 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:15:26.526132 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:15:26.526132 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:15:26.526132 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:15:26.526132 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:15:26.526991 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:15:26.526991 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:15:26.526991 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:15:26.526991 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:15:26.526991 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:15:26.526991 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:15:26.526991 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:15:26.526991 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:15:26.526991 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:15:26.526991 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:15:26.526991 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:15:26.526991 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:15:26.526991 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 541/1071] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Aug 29 22:15:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:15:26.532003 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f4764-add0-4c22-8eb4-10bd76425726 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:26.596991 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:26.607600 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d343845a-f907-48f0-81b0-21f922670044 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:26.638630 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f4764-add0-4c22-8eb4-10bd76425726 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:26.642178 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54689ea4-6504-4f05-a591-10a4035f0181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:26.642854 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54689ea4-6504-4f05-a591-10a4035f0181 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:26.643134 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54689ea4-6504-4f05-a591-10a4035f0181 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:26.643399 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54689ea4-6504-4f05-a591-10a4035f0181 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:26.644114 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54689ea4-6504-4f05-a591-10a4035f0181 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:26.644413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54689ea4-6504-4f05-a591-10a4035f0181 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:26.645849 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54689ea4-6504-4f05-a591-10a4035f0181 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:26.662987 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 531/1072] 10.222.0.36 () {56 vars in 1133 bytes} [Mon Aug 29 22:15:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:26.663909 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54689ea4-6504-4f05-a591-10a4035f0181 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:26.674325 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b148b5-ec98-4886-a7f5-7ece5c5762d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:26.674944 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b148b5-ec98-4886-a7f5-7ece5c5762d1 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:26.675233 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b148b5-ec98-4886-a7f5-7ece5c5762d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:26.675543 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b148b5-ec98-4886-a7f5-7ece5c5762d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:26.676224 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b148b5-ec98-4886-a7f5-7ece5c5762d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:26.676559 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b148b5-ec98-4886-a7f5-7ece5c5762d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:26.677927 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b148b5-ec98-4886-a7f5-7ece5c5762d1 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:26.686634 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 542/1073] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:15:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:26.687426 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b148b5-ec98-4886-a7f5-7ece5c5762d1 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:26.710472 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:26.770161 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54689ea4-6504-4f05-a591-10a4035f0181 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:26.785735 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b148b5-ec98-4886-a7f5-7ece5c5762d1 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:26.804624 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4311eb9-4ee6-41a9-aa4b-5effed540172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:26.805250 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4311eb9-4ee6-41a9-aa4b-5effed540172 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:26.805533 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4311eb9-4ee6-41a9-aa4b-5effed540172 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:26.805794 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4311eb9-4ee6-41a9-aa4b-5effed540172 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:26.819579 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c730701-b9bd-4e0c-a203-a5d5a88d2bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:26.820247 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c730701-b9bd-4e0c-a203-a5d5a88d2bb1 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:26.820627 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c730701-b9bd-4e0c-a203-a5d5a88d2bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:26.820902 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c730701-b9bd-4e0c-a203-a5d5a88d2bb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:26.824195 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:26.831016 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c730701-b9bd-4e0c-a203-a5d5a88d2bb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:26.832534 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c730701-b9bd-4e0c-a203-a5d5a88d2bb1 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:26.847004 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-1c730701-b9bd-4e0c-a203-a5d5a88d2bb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:15:26.847004 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:26.847004 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:15:26.847004 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:15:26.847004 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:15:26.847004 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:15:26.847004 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:15:26.847004 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:15:26.847004 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:15:26.847004 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:15:26.847004 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:15:26.847004 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:15:26.847004 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:15:26.847004 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:15:26.847004 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:15:26.847004 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:15:26.848222 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:15:26.848222 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:15:26.848222 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:15:26.848222 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:15:26.848222 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:15:26.848222 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:15:26.848222 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:15:26.848222 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:15:26.848222 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:15:26.848222 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:15:26.848222 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:15:26.848222 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:15:26.848222 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:15:26.848222 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:15:26.848222 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:15:26.848222 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:15:26.848222 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:15:26.849183 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:15:26.849183 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:15:26.849183 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:15:26.849183 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 543/1074] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:15:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:15:26.849183 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c730701-b9bd-4e0c-a203-a5d5a88d2bb1 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:26.876550 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4311eb9-4ee6-41a9-aa4b-5effed540172 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:26.877957 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4311eb9-4ee6-41a9-aa4b-5effed540172 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:26.927001 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:26.952478 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c730701-b9bd-4e0c-a203-a5d5a88d2bb1 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:26.979544 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 532/1075] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:15:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:15:26.980390 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4311eb9-4ee6-41a9-aa4b-5effed540172 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:26.990539 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58e1c8-08b9-4feb-9124-be08f3c722b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:26.991182 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58e1c8-08b9-4feb-9124-be08f3c722b1 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:26.991439 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58e1c8-08b9-4feb-9124-be08f3c722b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:26.991715 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58e1c8-08b9-4feb-9124-be08f3c722b1 None admin] PATH_INFO: `/v3/users/f208852d4db643d8815e6308d9ab380d` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:26.993138 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b58e1c8-08b9-4feb-9124-be08f3c722b1 None admin] RBAC: Authorizing `identity:get_user(user_id=f208852d4db643d8815e6308d9ab380d)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:26.994583 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b58e1c8-08b9-4feb-9124-be08f3c722b1 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:26.996200 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 544/1076] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Aug 29 22:15:26 2022] GET /identity/v3/users/f208852d4db643d8815e6308d9ab380d => generated 285 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:27.000986 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58e1c8-08b9-4feb-9124-be08f3c722b1 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:27.032997 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:27.084557 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4311eb9-4ee6-41a9-aa4b-5effed540172 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:27.100066 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58e1c8-08b9-4feb-9124-be08f3c722b1 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:27.121204 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec00283-656f-4b2c-8f23-2e5db1308c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:27.121818 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec00283-656f-4b2c-8f23-2e5db1308c21 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:27.122096 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec00283-656f-4b2c-8f23-2e5db1308c21 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:27.122371 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec00283-656f-4b2c-8f23-2e5db1308c21 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:27.123006 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec00283-656f-4b2c-8f23-2e5db1308c21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:27.123306 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec00283-656f-4b2c-8f23-2e5db1308c21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:27.124724 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec00283-656f-4b2c-8f23-2e5db1308c21 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:27.135930 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005c0cc-7a78-4cb3-8dd8-8c0f2fef29de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:27.136470 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 533/1077] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:15:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:27.136612 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005c0cc-7a78-4cb3-8dd8-8c0f2fef29de None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:27.136798 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005c0cc-7a78-4cb3-8dd8-8c0f2fef29de None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:27.137046 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005c0cc-7a78-4cb3-8dd8-8c0f2fef29de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:27.137267 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec00283-656f-4b2c-8f23-2e5db1308c21 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:27.148808 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c005c0cc-7a78-4cb3-8dd8-8c0f2fef29de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:27.150637 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c005c0cc-7a78-4cb3-8dd8-8c0f2fef29de None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:27.152512 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:27.166931 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-c005c0cc-7a78-4cb3-8dd8-8c0f2fef29de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:15:27.166931 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:27.166931 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:15:27.166931 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:15:27.166931 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:15:27.166931 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:15:27.166931 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:15:27.166931 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:15:27.166931 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:15:27.166931 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:15:27.166931 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:15:27.166931 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:15:27.166931 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:15:27.166931 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:15:27.166931 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:15:27.166931 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:15:27.168141 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:15:27.168141 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:15:27.168141 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:15:27.168141 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:15:27.168141 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:15:27.168141 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:15:27.168141 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:15:27.168141 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:15:27.168141 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:15:27.168141 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:15:27.168141 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:15:27.168141 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:15:27.168141 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:15:27.168141 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:15:27.168141 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:15:27.168141 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:15:27.168141 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:15:27.169392 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:15:27.169392 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:15:27.169392 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:15:27.173068 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 545/1078] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:15:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:15:27.173842 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005c0cc-7a78-4cb3-8dd8-8c0f2fef29de None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:27.239968 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec00283-656f-4b2c-8f23-2e5db1308c21 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:27.250335 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:27.276051 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005c0cc-7a78-4cb3-8dd8-8c0f2fef29de None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:27.276914 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f683ac-7b4b-494b-9e05-3090a769bdac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:27.277563 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f683ac-7b4b-494b-9e05-3090a769bdac None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:27.277846 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f683ac-7b4b-494b-9e05-3090a769bdac None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:27.278123 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f683ac-7b4b-494b-9e05-3090a769bdac None admin] PATH_INFO: `/v3/projects/d919c6585dac4128a3708fffd216d4da` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:27.279332 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f683ac-7b4b-494b-9e05-3090a769bdac None admin] RBAC: Authorizing `identity:get_project(project_id=d919c6585dac4128a3708fffd216d4da)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:27.280811 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f683ac-7b4b-494b-9e05-3090a769bdac None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:27.282465 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 534/1079] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Aug 29 22:15:27 2022] GET /identity/v3/projects/d919c6585dac4128a3708fffd216d4da => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:27.283232 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f683ac-7b4b-494b-9e05-3090a769bdac None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:27.312593 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9043d021-b3f1-4951-8d6d-63d8c9bec2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:27.313219 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043d021-b3f1-4951-8d6d-63d8c9bec2d7 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:27.313497 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043d021-b3f1-4951-8d6d-63d8c9bec2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:27.313766 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043d021-b3f1-4951-8d6d-63d8c9bec2d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:27.320233 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9043d021-b3f1-4951-8d6d-63d8c9bec2d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:27.321921 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9043d021-b3f1-4951-8d6d-63d8c9bec2d7 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:27.333147 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-9043d021-b3f1-4951-8d6d-63d8c9bec2d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:15:27.333147 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:27.333147 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:15:27.333147 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:15:27.333147 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:15:27.333147 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:15:27.333147 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:15:27.333147 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:15:27.333147 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:15:27.333147 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:15:27.333147 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:15:27.333147 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:15:27.333147 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:15:27.333147 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:15:27.333147 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:15:27.334211 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:15:27.334211 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:15:27.334211 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:15:27.334211 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:15:27.334211 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:15:27.334211 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:15:27.334211 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:15:27.334211 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:15:27.334211 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:15:27.334211 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:15:27.334211 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:15:27.334211 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:15:27.334211 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:15:27.334211 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:15:27.334211 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:15:27.334211 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:15:27.334211 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:15:27.335134 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:15:27.335134 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:15:27.335134 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:15:27.335134 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:15:27.335134 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:15:27.335134 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:15:27.335134 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:15:27.335134 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:15:27.335134 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 546/1080] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Aug 29 22:15:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:15:27.335134 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9043d021-b3f1-4951-8d6d-63d8c9bec2d7 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:27.395730 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f683ac-7b4b-494b-9e05-3090a769bdac None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:27.404852 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:27.433618 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af2569-c323-4f17-9542-0747bea39571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:27.434239 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af2569-c323-4f17-9542-0747bea39571 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:27.434517 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af2569-c323-4f17-9542-0747bea39571 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:27.434786 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af2569-c323-4f17-9542-0747bea39571 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:27.435431 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2af2569-c323-4f17-9542-0747bea39571 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:27.435729 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2af2569-c323-4f17-9542-0747bea39571 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:27.437158 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2af2569-c323-4f17-9542-0747bea39571 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:27.449766 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 535/1081] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:15:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:27.450561 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af2569-c323-4f17-9542-0747bea39571 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:27.450661 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9043d021-b3f1-4951-8d6d-63d8c9bec2d7 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:27.495773 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:27.499352 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75bc954-5793-49a5-9cfb-3218773eb42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:27.500043 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75bc954-5793-49a5-9cfb-3218773eb42b None admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:27.500677 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75bc954-5793-49a5-9cfb-3218773eb42b None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:27.500956 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75bc954-5793-49a5-9cfb-3218773eb42b None admin] PATH_INFO: `/v3/projects/d919c6585dac4128a3708fffd216d4da/users/f208852d4db643d8815e6308d9ab380d/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:27.503038 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75bc954-5793-49a5-9cfb-3218773eb42b None admin] RBAC: Authorizing `identity:create_grant(project_id=d919c6585dac4128a3708fffd216d4da, user_id=f208852d4db643d8815e6308d9ab380d, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:27.504574 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75bc954-5793-49a5-9cfb-3218773eb42b None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:27.521703 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 547/1082] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Aug 29 22:15:27 2022] PUT /identity/v3/projects/d919c6585dac4128a3708fffd216d4da/users/f208852d4db643d8815e6308d9ab380d/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:15:27.574666 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af2569-c323-4f17-9542-0747bea39571 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:27.619972 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753abc5-8bbf-43fb-a79a-8d8773f2983b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:27.620207 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753abc5-8bbf-43fb-a79a-8d8773f2983b None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:27.620367 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753abc5-8bbf-43fb-a79a-8d8773f2983b None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:27.621651 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753abc5-8bbf-43fb-a79a-8d8773f2983b None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:27.621651 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a753abc5-8bbf-43fb-a79a-8d8773f2983b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:27.621822 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a753abc5-8bbf-43fb-a79a-8d8773f2983b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:27.624826 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a753abc5-8bbf-43fb-a79a-8d8773f2983b None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:27.640280 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 536/1083] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Aug 29 22:15:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:27.647520 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75bc954-5793-49a5-9cfb-3218773eb42b None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:27.760429 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75bc954-5793-49a5-9cfb-3218773eb42b None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:27.776061 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:27.800074 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2973f8-5e3a-44fc-9df7-65d5a02bd9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:27.800793 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2973f8-5e3a-44fc-9df7-65d5a02bd9ad None admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:27.801068 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2973f8-5e3a-44fc-9df7-65d5a02bd9ad None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:27.801333 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2973f8-5e3a-44fc-9df7-65d5a02bd9ad None admin] PATH_INFO: `/v3/projects/696ed25cc0cb43fab4bfaf762a90da54/users/90b7213b7111456a93e294ce40b95b21/roles/1689c28a8f8945838ea7fd3cb4cfc598` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:27.803465 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2973f8-5e3a-44fc-9df7-65d5a02bd9ad None admin] RBAC: Authorizing `identity:create_grant(project_id=696ed25cc0cb43fab4bfaf762a90da54, user_id=90b7213b7111456a93e294ce40b95b21, role_id=1689c28a8f8945838ea7fd3cb4cfc598)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:27.804951 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2973f8-5e3a-44fc-9df7-65d5a02bd9ad None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:27.819624 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 548/1084] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Aug 29 22:15:27 2022] PUT /identity/v3/projects/696ed25cc0cb43fab4bfaf762a90da54/users/90b7213b7111456a93e294ce40b95b21/roles/1689c28a8f8945838ea7fd3cb4cfc598 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:15:29.438735 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d05c05-efd3-4642-ba75-6b1afb1baf4f None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:29.439325 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d05c05-efd3-4642-ba75-6b1afb1baf4f None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:29.439325 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d05c05-efd3-4642-ba75-6b1afb1baf4f None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:29.440645 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 537/1085] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:15:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:15:29.446408 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9594eb8-c07c-4f63-a142-4c16791fa37a None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:29.446834 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9594eb8-c07c-4f63-a142-4c16791fa37a None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:29.446958 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9594eb8-c07c-4f63-a142-4c16791fa37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:29.467330 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-d9594eb8-c07c-4f63-a142-4c16791fa37a None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:15:29.468577 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d9594eb8-c07c-4f63-a142-4c16791fa37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:15:29.539618 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 549/1086] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:15:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:15:29.768984 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633d1c4-1734-46fe-a8b0-1446f5cb6995 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:29.769177 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633d1c4-1734-46fe-a8b0-1446f5cb6995 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:29.769438 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633d1c4-1734-46fe-a8b0-1446f5cb6995 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:29.770791 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 538/1087] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:15:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:15:29.776681 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4870e0f-5f7e-471b-962f-c43b4c23499e None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:29.776974 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4870e0f-5f7e-471b-962f-c43b4c23499e None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:29.777248 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4870e0f-5f7e-471b-962f-c43b4c23499e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:29.796106 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-f4870e0f-5f7e-471b-962f-c43b4c23499e None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:15:29.797323 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f4870e0f-5f7e-471b-962f-c43b4c23499e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:15:29.804310 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633d1c4-1734-46fe-a8b0-1446f5cb6995 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:29.865747 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 550/1088] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:15:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:15:29.907823 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:29.912719 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633d1c4-1734-46fe-a8b0-1446f5cb6995 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:29.946995 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3888fd-61a5-4c76-9e40-abbc2e69807a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:29.947631 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3888fd-61a5-4c76-9e40-abbc2e69807a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:29.947911 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3888fd-61a5-4c76-9e40-abbc2e69807a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:29.948182 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3888fd-61a5-4c76-9e40-abbc2e69807a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:29.958375 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3888fd-61a5-4c76-9e40-abbc2e69807a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:15:29.963432 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-1c3888fd-61a5-4c76-9e40-abbc2e69807a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:15:29.963432 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:29.963432 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:15:29.963432 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:15:29.963432 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:15:29.963432 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:15:29.963432 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:15:29.963432 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:15:29.963432 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:15:29.963432 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:15:29.963432 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:15:29.963432 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:15:29.963432 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:15:29.963432 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:15:29.963432 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:15:29.963432 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:15:29.964413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:15:29.964413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:15:29.964413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:15:29.964413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:15:29.964413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:15:29.964413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:15:29.964413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:15:29.964413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:15:29.964413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:15:29.964413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:15:29.964413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:15:29.964413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:15:29.964413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:15:29.964413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:15:29.964413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:15:29.964413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:15:29.965320 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:15:29.965320 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:15:29.965320 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:15:29.965320 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:15:29.965320 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:15:29.965320 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:15:29.965320 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:15:29.965320 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:15:29.965320 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:15:29.965320 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:15:29.965320 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:15:29.965320 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:15:29.965320 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 539/1089] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Aug 29 22:15:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:15:29.970654 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4870e0f-5f7e-471b-962f-c43b4c23499e None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:30.004037 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:30.072971 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4870e0f-5f7e-471b-962f-c43b4c23499e None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:30.106955 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24891d47-e400-41d3-8576-e302c07d9958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:30.107562 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24891d47-e400-41d3-8576-e302c07d9958 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:30.107844 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24891d47-e400-41d3-8576-e302c07d9958 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:30.108110 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24891d47-e400-41d3-8576-e302c07d9958 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:30.108815 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24891d47-e400-41d3-8576-e302c07d9958 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:30.109116 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24891d47-e400-41d3-8576-e302c07d9958 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:30.110502 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24891d47-e400-41d3-8576-e302c07d9958 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:30.119620 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 551/1090] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:15:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:30.125512 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3888fd-61a5-4c76-9e40-abbc2e69807a None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:30.137763 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24891d47-e400-41d3-8576-e302c07d9958 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:30.234490 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3888fd-61a5-4c76-9e40-abbc2e69807a None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:30.240646 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:30.247770 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24891d47-e400-41d3-8576-e302c07d9958 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:30.269949 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75136eb6-2f91-4279-addd-82f1ccec8cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:30.270581 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75136eb6-2f91-4279-addd-82f1ccec8cd5 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:30.271062 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75136eb6-2f91-4279-addd-82f1ccec8cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:30.271386 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75136eb6-2f91-4279-addd-82f1ccec8cd5 None admin] PATH_INFO: `/v3/users/f208852d4db643d8815e6308d9ab380d` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:30.272796 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75136eb6-2f91-4279-addd-82f1ccec8cd5 None admin] RBAC: Authorizing `identity:get_user(user_id=f208852d4db643d8815e6308d9ab380d)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:30.274412 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75136eb6-2f91-4279-addd-82f1ccec8cd5 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:30.276322 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 540/1091] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Aug 29 22:15:30 2022] GET /identity/v3/users/f208852d4db643d8815e6308d9ab380d => generated 285 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:30.283331 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75136eb6-2f91-4279-addd-82f1ccec8cd5 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:30.291724 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a7bbf-4878-4b0d-9cca-4cc24b7b1e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:30.292369 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a7bbf-4878-4b0d-9cca-4cc24b7b1e92 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:30.292661 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a7bbf-4878-4b0d-9cca-4cc24b7b1e92 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:30.292933 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a7bbf-4878-4b0d-9cca-4cc24b7b1e92 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:30.304938 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a7bbf-4878-4b0d-9cca-4cc24b7b1e92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:15:30.310031 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-c18a7bbf-4878-4b0d-9cca-4cc24b7b1e92 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 22:15:30.310031 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:30.310031 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:15:30.310031 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:15:30.310031 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:15:30.310031 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:15:30.310031 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:15:30.310031 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:15:30.310031 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:15:30.310031 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:15:30.310031 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:15:30.310031 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:15:30.310031 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:15:30.310031 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:15:30.310031 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:15:30.310031 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:15:30.311702 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:15:30.311702 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:15:30.311702 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:15:30.311702 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:15:30.311702 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:15:30.311702 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:15:30.311702 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:15:30.311702 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:15:30.311702 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:15:30.311702 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:15:30.311702 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:15:30.311702 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:15:30.311702 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:15:30.311702 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:15:30.311702 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:15:30.311702 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:15:30.312712 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:15:30.312712 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:15:30.312712 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:15:30.312712 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:15:30.312712 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:15:30.312712 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:15:30.312712 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:15:30.312712 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:15:30.312712 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:15:30.312712 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:15:30.312712 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 22:15:30.312712 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:15:30.312712 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 552/1092] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Aug 29 22:15:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:15:30.317070 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a7bbf-4878-4b0d-9cca-4cc24b7b1e92 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:30.319250 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:30.393909 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75136eb6-2f91-4279-addd-82f1ccec8cd5 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:30.417340 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a7bbf-4878-4b0d-9cca-4cc24b7b1e92 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:30.429048 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118553a0-6756-45c5-bdfd-04b10f39b416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:30.429864 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118553a0-6756-45c5-bdfd-04b10f39b416 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:30.430407 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118553a0-6756-45c5-bdfd-04b10f39b416 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:30.430407 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118553a0-6756-45c5-bdfd-04b10f39b416 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:30.452637 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d3f46c-4375-4556-89dd-37c11e02db31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:30.453226 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3f46c-4375-4556-89dd-37c11e02db31 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:30.453516 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3f46c-4375-4556-89dd-37c11e02db31 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:30.453820 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3f46c-4375-4556-89dd-37c11e02db31 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:30.454502 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d3f46c-4375-4556-89dd-37c11e02db31 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:30.454809 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d3f46c-4375-4556-89dd-37c11e02db31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:30.456166 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d3f46c-4375-4556-89dd-37c11e02db31 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:30.464571 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 553/1093] 10.222.0.36 () {56 vars in 1115 bytes} [Mon Aug 29 22:15:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:30.470240 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d3f46c-4375-4556-89dd-37c11e02db31 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:30.489616 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:30.502695 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118553a0-6756-45c5-bdfd-04b10f39b416 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:30.504185 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118553a0-6756-45c5-bdfd-04b10f39b416 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:30.535412 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:30.571829 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d3f46c-4375-4556-89dd-37c11e02db31 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:30.606459 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99a5c3-a00c-41b2-ad19-bdc525f6a6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:30.607089 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99a5c3-a00c-41b2-ad19-bdc525f6a6af None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:30.607384 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99a5c3-a00c-41b2-ad19-bdc525f6a6af None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:30.607582 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 541/1094] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:15:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 22:15:30.607684 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99a5c3-a00c-41b2-ad19-bdc525f6a6af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:30.613190 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118553a0-6756-45c5-bdfd-04b10f39b416 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:30.621906 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf99a5c3-a00c-41b2-ad19-bdc525f6a6af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:30.623349 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf99a5c3-a00c-41b2-ad19-bdc525f6a6af None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:30.637895 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-bf99a5c3-a00c-41b2-ad19-bdc525f6a6af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:15:30.637895 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:30.637895 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:15:30.637895 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:15:30.637895 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:15:30.637895 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:15:30.637895 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:15:30.637895 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:15:30.637895 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:15:30.637895 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:15:30.637895 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:15:30.637895 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:15:30.637895 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:15:30.637895 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:15:30.637895 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:15:30.637895 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:15:30.638884 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:15:30.638884 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:15:30.638884 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:15:30.638884 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:15:30.638884 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:15:30.638884 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:15:30.638884 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:15:30.638884 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:15:30.638884 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:15:30.638884 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:15:30.638884 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:15:30.638884 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:15:30.638884 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:15:30.638884 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:15:30.638884 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:15:30.638884 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:15:30.638884 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:15:30.640792 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:15:30.640792 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:15:30.640792 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:15:30.640792 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 554/1095] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:15:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:15:30.645408 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99a5c3-a00c-41b2-ad19-bdc525f6a6af None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:30.713667 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:30.717198 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118553a0-6756-45c5-bdfd-04b10f39b416 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:30.742792 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:30.744925 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99a5c3-a00c-41b2-ad19-bdc525f6a6af None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:30.752473 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127f8cd-ab2e-4c93-af35-9cb87e94f1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:30.752903 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127f8cd-ab2e-4c93-af35-9cb87e94f1d0 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:30.753213 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127f8cd-ab2e-4c93-af35-9cb87e94f1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:30.753506 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127f8cd-ab2e-4c93-af35-9cb87e94f1d0 None admin] PATH_INFO: `/v3/projects/d919c6585dac4128a3708fffd216d4da` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:30.754644 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3127f8cd-ab2e-4c93-af35-9cb87e94f1d0 None admin] RBAC: Authorizing `identity:get_project(project_id=d919c6585dac4128a3708fffd216d4da)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:30.756089 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3127f8cd-ab2e-4c93-af35-9cb87e94f1d0 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:30.757856 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 542/1096] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Aug 29 22:15:30 2022] GET /identity/v3/projects/d919c6585dac4128a3708fffd216d4da => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:15:30.763877 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127f8cd-ab2e-4c93-af35-9cb87e94f1d0 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:30.780110 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432090a0-3bd5-4d9f-ac2e-c1726374a759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:30.780753 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432090a0-3bd5-4d9f-ac2e-c1726374a759 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:30.781025 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432090a0-3bd5-4d9f-ac2e-c1726374a759 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:30.781300 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432090a0-3bd5-4d9f-ac2e-c1726374a759 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:30.781965 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432090a0-3bd5-4d9f-ac2e-c1726374a759 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:30.782270 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432090a0-3bd5-4d9f-ac2e-c1726374a759 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:30.783625 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432090a0-3bd5-4d9f-ac2e-c1726374a759 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:30.797448 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 555/1097] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:15:30.807227 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432090a0-3bd5-4d9f-ac2e-c1726374a759 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:30.885412 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127f8cd-ab2e-4c93-af35-9cb87e94f1d0 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:30.920174 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13309dd0-624c-4764-afb8-fa00d182763d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:30.920739 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13309dd0-624c-4764-afb8-fa00d182763d None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:30.921024 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13309dd0-624c-4764-afb8-fa00d182763d None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:30.921301 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13309dd0-624c-4764-afb8-fa00d182763d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:30.922029 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13309dd0-624c-4764-afb8-fa00d182763d None admin] RBAC: Adding query filter params (role.id=ff59a239a50b4bd899a83bf3c3fd1f63, scope.project.id=d919c6585dac4128a3708fffd216d4da, user.id=f208852d4db643d8815e6308d9ab380d) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:30.922184 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432090a0-3bd5-4d9f-ac2e-c1726374a759 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:30.922341 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13309dd0-624c-4764-afb8-fa00d182763d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:30.923784 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13309dd0-624c-4764-afb8-fa00d182763d None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:30.929491 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 543/1098] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Aug 29 22:15:30 2022] GET /identity/v3/role_assignments?user.id=f208852d4db643d8815e6308d9ab380d&scope.project.id=d919c6585dac4128a3708fffd216d4da&role.id=ff59a239a50b4bd899a83bf3c3fd1f63 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:15:30.951935 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:30.959709 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d13aa41-304c-45df-bbbe-d2fa69e251b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:30.960379 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13aa41-304c-45df-bbbe-d2fa69e251b4 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:30.960706 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13aa41-304c-45df-bbbe-d2fa69e251b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:30.961015 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13aa41-304c-45df-bbbe-d2fa69e251b4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:30.969224 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d13aa41-304c-45df-bbbe-d2fa69e251b4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:30.970696 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d13aa41-304c-45df-bbbe-d2fa69e251b4 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:30.983832 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-1d13aa41-304c-45df-bbbe-d2fa69e251b4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:15:30.983832 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:30.983832 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:15:30.983832 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:15:30.983832 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:15:30.983832 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:15:30.983832 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:15:30.983832 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:15:30.983832 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:15:30.983832 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:15:30.983832 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:15:30.983832 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:15:30.983832 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:15:30.983832 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:15:30.983832 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:15:30.983832 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:15:30.984968 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:15:30.984968 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:15:30.984968 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:15:30.984968 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:15:30.984968 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:15:30.984968 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:15:30.984968 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:15:30.984968 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:15:30.984968 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:15:30.984968 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:15:30.984968 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:15:30.984968 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:15:30.984968 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:15:30.984968 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:15:30.984968 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:15:30.984968 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:15:30.984968 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:15:30.984968 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:15:30.985943 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:15:30.985943 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:15:30.985943 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:15:30.985943 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:15:30.985943 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:15:30.985943 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:15:30.985943 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:15:30.985943 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:15:30.985943 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:15:30.985943 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:15:30.985943 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 556/1099] 10.222.0.36 () {56 vars in 1093 bytes} [Mon Aug 29 22:15:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:15:30.991371 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13309dd0-624c-4764-afb8-fa00d182763d None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:31.056047 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:31.106236 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13309dd0-624c-4764-afb8-fa00d182763d None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:31.143146 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758679b6-0b3f-4726-8343-64f2ffc05875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:31.143768 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758679b6-0b3f-4726-8343-64f2ffc05875 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:31.144049 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758679b6-0b3f-4726-8343-64f2ffc05875 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:31.144327 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758679b6-0b3f-4726-8343-64f2ffc05875 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:31.145097 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758679b6-0b3f-4726-8343-64f2ffc05875 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:31.145461 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758679b6-0b3f-4726-8343-64f2ffc05875 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:31.146920 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758679b6-0b3f-4726-8343-64f2ffc05875 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:31.166020 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 544/1100] 10.222.0.36 () {56 vars in 1133 bytes} [Mon Aug 29 22:15:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:31.171988 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d13aa41-304c-45df-bbbe-d2fa69e251b4 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:31.285628 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d13aa41-304c-45df-bbbe-d2fa69e251b4 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:31.320324 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e0fcd0-7585-439d-b5f8-1e5c829a52ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:31.321056 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0fcd0-7585-439d-b5f8-1e5c829a52ea None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:31.321332 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0fcd0-7585-439d-b5f8-1e5c829a52ea None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:31.321639 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0fcd0-7585-439d-b5f8-1e5c829a52ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:31.380891 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:31.392481 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e0fcd0-7585-439d-b5f8-1e5c829a52ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:31.393960 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e0fcd0-7585-439d-b5f8-1e5c829a52ea None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:31.497508 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 557/1101] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:15:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:15:31.503769 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758679b6-0b3f-4726-8343-64f2ffc05875 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:31.614661 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758679b6-0b3f-4726-8343-64f2ffc05875 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:31.632222 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:31.653446 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d939707-11f9-40fc-acf2-8fad69e95a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:31.654078 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d939707-11f9-40fc-acf2-8fad69e95a98 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:31.654361 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d939707-11f9-40fc-acf2-8fad69e95a98 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:31.654636 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d939707-11f9-40fc-acf2-8fad69e95a98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:31.665513 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d939707-11f9-40fc-acf2-8fad69e95a98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:31.666988 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d939707-11f9-40fc-acf2-8fad69e95a98 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:31.682610 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-0d939707-11f9-40fc-acf2-8fad69e95a98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:15:31.682610 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:31.682610 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:15:31.682610 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:15:31.682610 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:15:31.682610 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:15:31.682610 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:15:31.682610 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:15:31.682610 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:15:31.682610 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:15:31.682610 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:15:31.682610 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:15:31.682610 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:15:31.682610 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:15:31.682610 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:15:31.682610 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:15:31.683777 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:15:31.683777 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:15:31.683777 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:15:31.683777 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:15:31.683777 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:15:31.683777 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:15:31.683777 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:15:31.683777 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:15:31.683777 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:15:31.683777 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:15:31.683777 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:15:31.683777 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:15:31.683777 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:15:31.683777 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:15:31.683777 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:15:31.683777 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:15:31.683777 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:15:31.684921 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:15:31.684921 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:15:31.684921 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:15:31.684921 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 545/1102] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:15:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:15:31.690287 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e0fcd0-7585-439d-b5f8-1e5c829a52ea None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:31.783884 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:31.794645 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e0fcd0-7585-439d-b5f8-1e5c829a52ea None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:31.830290 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11521ac-151d-41d0-a829-58c61c3db660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:31.830815 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11521ac-151d-41d0-a829-58c61c3db660 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:31.831092 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11521ac-151d-41d0-a829-58c61c3db660 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:31.831366 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11521ac-151d-41d0-a829-58c61c3db660 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:31.832009 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11521ac-151d-41d0-a829-58c61c3db660 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:31.832296 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11521ac-151d-41d0-a829-58c61c3db660 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:31.833821 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11521ac-151d-41d0-a829-58c61c3db660 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:31.845249 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 558/1103] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:15:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:31.851125 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d939707-11f9-40fc-acf2-8fad69e95a98 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:31.962941 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d939707-11f9-40fc-acf2-8fad69e95a98 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:32.002454 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ae2e0-45e7-48db-a72a-528e3b884532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:32.002714 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ae2e0-45e7-48db-a72a-528e3b884532 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:32.002842 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ae2e0-45e7-48db-a72a-528e3b884532 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:32.003125 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ae2e0-45e7-48db-a72a-528e3b884532 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:32.010140 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739ae2e0-45e7-48db-a72a-528e3b884532 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:32.011633 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739ae2e0-45e7-48db-a72a-528e3b884532 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:32.023795 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-739ae2e0-45e7-48db-a72a-528e3b884532 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:15:32.023795 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:32.023795 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:15:32.023795 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:15:32.023795 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:15:32.023795 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:15:32.023795 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:15:32.023795 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:15:32.023795 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:15:32.023795 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:15:32.023795 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:15:32.023795 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:15:32.023795 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:15:32.023795 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:15:32.023795 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:15:32.024930 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:15:32.024930 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:15:32.024930 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:15:32.024930 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:15:32.024930 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:15:32.024930 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:15:32.024930 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:15:32.024930 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:15:32.024930 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:15:32.024930 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:15:32.024930 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:15:32.024930 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:15:32.024930 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:15:32.024930 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:15:32.024930 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:15:32.024930 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:15:32.024930 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:15:32.026340 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:15:32.026340 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:15:32.026340 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:15:32.026340 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:15:32.026340 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:15:32.026340 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:15:32.026340 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:15:32.026340 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:15:32.026340 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 546/1104] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Aug 29 22:15:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:15:32.032038 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11521ac-151d-41d0-a829-58c61c3db660 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:32.143491 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11521ac-151d-41d0-a829-58c61c3db660 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:32.184585 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b8d41a-1ff0-4894-9cff-2a0d021690f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:32.185254 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8d41a-1ff0-4894-9cff-2a0d021690f5 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:32.185536 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8d41a-1ff0-4894-9cff-2a0d021690f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:32.185807 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8d41a-1ff0-4894-9cff-2a0d021690f5 None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:32.186519 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b8d41a-1ff0-4894-9cff-2a0d021690f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:32.186821 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b8d41a-1ff0-4894-9cff-2a0d021690f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:32.188296 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b8d41a-1ff0-4894-9cff-2a0d021690f5 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:32.202732 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 559/1105] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Aug 29 22:15:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:32.209274 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ae2e0-45e7-48db-a72a-528e3b884532 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:32.247301 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:32.325973 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ae2e0-45e7-48db-a72a-528e3b884532 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:32.366928 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601207f4-497e-4751-b602-201c2b1094fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:32.367581 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601207f4-497e-4751-b602-201c2b1094fd None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:32.367859 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601207f4-497e-4751-b602-201c2b1094fd None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:32.368211 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601207f4-497e-4751-b602-201c2b1094fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:32.369107 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601207f4-497e-4751-b602-201c2b1094fd None admin] RBAC: Adding query filter params (role.id=1689c28a8f8945838ea7fd3cb4cfc598, scope.project.id=696ed25cc0cb43fab4bfaf762a90da54, user.id=90b7213b7111456a93e294ce40b95b21) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:32.369417 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601207f4-497e-4751-b602-201c2b1094fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:32.370850 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601207f4-497e-4751-b602-201c2b1094fd None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:32.378243 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 547/1106] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Aug 29 22:15:32 2022] GET /identity/v3/role_assignments?user.id=90b7213b7111456a93e294ce40b95b21&scope.project.id=696ed25cc0cb43fab4bfaf762a90da54&role.id=1689c28a8f8945838ea7fd3cb4cfc598 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:32.874007 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d450ff-1ac0-45af-9af8-adb0e632731c None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:32.874535 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d450ff-1ac0-45af-9af8-adb0e632731c None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:32.874535 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d450ff-1ac0-45af-9af8-adb0e632731c None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:32.876101 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 560/1107] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:15:32.882302 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856561e-28a8-4760-a67c-27f12ceb7d1a None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:32.883105 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856561e-28a8-4760-a67c-27f12ceb7d1a None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:32.883364 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856561e-28a8-4760-a67c-27f12ceb7d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:32.907762 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-2856561e-28a8-4760-a67c-27f12ceb7d1a None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:15:32.909126 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-2856561e-28a8-4760-a67c-27f12ceb7d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:15:32.985878 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 548/1108] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:15:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:15:33.316979 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d450ff-1ac0-45af-9af8-adb0e632731c None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:33.331109 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:33.432098 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d450ff-1ac0-45af-9af8-adb0e632731c None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:33.470381 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56345484-5704-4446-b3aa-81de70555ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:33.471013 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56345484-5704-4446-b3aa-81de70555ca9 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:33.471289 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56345484-5704-4446-b3aa-81de70555ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:33.471566 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56345484-5704-4446-b3aa-81de70555ca9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:33.472833 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56345484-5704-4446-b3aa-81de70555ca9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:33.474264 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56345484-5704-4446-b3aa-81de70555ca9 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:33.475849 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 561/1109] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:15:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:33.484957 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2856561e-28a8-4760-a67c-27f12ceb7d1a None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:33.513184 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:33.601420 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2856561e-28a8-4760-a67c-27f12ceb7d1a None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:33.640515 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d28b1-9436-4731-918d-8d5a35b0aa5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:33.641154 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d28b1-9436-4731-918d-8d5a35b0aa5e None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:33.641436 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d28b1-9436-4731-918d-8d5a35b0aa5e None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:33.641709 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d28b1-9436-4731-918d-8d5a35b0aa5e None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:33.642360 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297d28b1-9436-4731-918d-8d5a35b0aa5e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:33.643795 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297d28b1-9436-4731-918d-8d5a35b0aa5e None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:33.667971 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 549/1110] 10.222.0.36 () {60 vars in 1132 bytes} [Mon Aug 29 22:15:33 2022] POST /identity/v3/users => generated 286 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:15:35.585893 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379df864-b177-4b0d-a7ec-775b98fe8867 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:35.586509 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379df864-b177-4b0d-a7ec-775b98fe8867 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:35.586509 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379df864-b177-4b0d-a7ec-775b98fe8867 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:35.588520 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 562/1111] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:15:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:15:35.596442 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a788c34-7679-4540-b0ff-3aa1935702a9 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:35.596929 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a788c34-7679-4540-b0ff-3aa1935702a9 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:35.597026 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a788c34-7679-4540-b0ff-3aa1935702a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:35.617219 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-1a788c34-7679-4540-b0ff-3aa1935702a9 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:15:35.618436 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-1a788c34-7679-4540-b0ff-3aa1935702a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:15:35.692491 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 550/1112] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:15:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:15:35.964788 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379df864-b177-4b0d-a7ec-775b98fe8867 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:36.049963 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:36.074318 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379df864-b177-4b0d-a7ec-775b98fe8867 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:36.120130 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413569ed-fe3c-4707-88b4-d4a0db1ea299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:36.120787 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413569ed-fe3c-4707-88b4-d4a0db1ea299 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:36.121067 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413569ed-fe3c-4707-88b4-d4a0db1ea299 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:36.121338 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413569ed-fe3c-4707-88b4-d4a0db1ea299 None admin] PATH_INFO: `/v3/roles/8767fe0bd994478fac741fc8c76f649e` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:36.122861 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413569ed-fe3c-4707-88b4-d4a0db1ea299 None admin] RBAC: Authorizing `identity:get_role(role_id=8767fe0bd994478fac741fc8c76f649e)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:36.124226 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413569ed-fe3c-4707-88b4-d4a0db1ea299 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:36.125590 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 563/1113] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Aug 29 22:15:35 2022] GET /identity/v3/roles/8767fe0bd994478fac741fc8c76f649e => generated 223 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:36.133380 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a788c34-7679-4540-b0ff-3aa1935702a9 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:36.144533 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:36.244078 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a788c34-7679-4540-b0ff-3aa1935702a9 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:36.281165 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93429746-f1d1-4aee-855b-cc8480dd3960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:36.281800 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93429746-f1d1-4aee-855b-cc8480dd3960 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:36.282106 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93429746-f1d1-4aee-855b-cc8480dd3960 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:36.282382 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93429746-f1d1-4aee-855b-cc8480dd3960 None admin] PATH_INFO: `/v3/users/01b64dd4d6b049999b50ec8480864421` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:36.297087 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93429746-f1d1-4aee-855b-cc8480dd3960 None admin] RBAC: Authorizing `identity:get_user(user_id=01b64dd4d6b049999b50ec8480864421)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:36.298546 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93429746-f1d1-4aee-855b-cc8480dd3960 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:36.300203 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 551/1114] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Aug 29 22:15:36 2022] GET /identity/v3/users/01b64dd4d6b049999b50ec8480864421 => generated 286 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:36.308465 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413569ed-fe3c-4707-88b4-d4a0db1ea299 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:36.420543 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413569ed-fe3c-4707-88b4-d4a0db1ea299 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:36.454735 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655eb07e-3a8d-44b5-825e-e321af60472c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:36.455328 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655eb07e-3a8d-44b5-825e-e321af60472c None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:36.455604 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655eb07e-3a8d-44b5-825e-e321af60472c None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:36.455871 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655eb07e-3a8d-44b5-825e-e321af60472c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:36.471406 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:36.541521 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655eb07e-3a8d-44b5-825e-e321af60472c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:36.542976 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655eb07e-3a8d-44b5-825e-e321af60472c None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:36.649818 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 564/1115] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:15:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:15:36.658580 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93429746-f1d1-4aee-855b-cc8480dd3960 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:36.733516 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:36.779345 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93429746-f1d1-4aee-855b-cc8480dd3960 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:36.823460 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2672b896-a4f3-47df-977b-357685e2a068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:36.824097 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672b896-a4f3-47df-977b-357685e2a068 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:36.824378 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672b896-a4f3-47df-977b-357685e2a068 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:36.824695 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672b896-a4f3-47df-977b-357685e2a068 None admin] PATH_INFO: `/v3/projects/d919c6585dac4128a3708fffd216d4da` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:36.825922 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2672b896-a4f3-47df-977b-357685e2a068 None admin] RBAC: Authorizing `identity:get_project(project_id=d919c6585dac4128a3708fffd216d4da)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:36.827357 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2672b896-a4f3-47df-977b-357685e2a068 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:36.829035 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 552/1116] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Aug 29 22:15:36 2022] GET /identity/v3/projects/d919c6585dac4128a3708fffd216d4da => generated 311 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:36.836071 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655eb07e-3a8d-44b5-825e-e321af60472c None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:36.894893 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:36.948721 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655eb07e-3a8d-44b5-825e-e321af60472c None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:36.983688 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a490ba8e-f016-4ad7-85d4-277e294ca3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:36.984223 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490ba8e-f016-4ad7-85d4-277e294ca3f8 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:36.984538 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490ba8e-f016-4ad7-85d4-277e294ca3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:36.984809 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490ba8e-f016-4ad7-85d4-277e294ca3f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:36.985540 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a490ba8e-f016-4ad7-85d4-277e294ca3f8 None admin] RBAC: Adding query filter params (role.id=8767fe0bd994478fac741fc8c76f649e, scope.project.id=d919c6585dac4128a3708fffd216d4da, user.id=01b64dd4d6b049999b50ec8480864421) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:36.985851 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a490ba8e-f016-4ad7-85d4-277e294ca3f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:36.987290 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a490ba8e-f016-4ad7-85d4-277e294ca3f8 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:36.992698 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 565/1117] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Aug 29 22:15:36 2022] GET /identity/v3/role_assignments?user.id=01b64dd4d6b049999b50ec8480864421&scope.project.id=d919c6585dac4128a3708fffd216d4da&role.id=8767fe0bd994478fac741fc8c76f649e => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:38.873101 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17550288-dedf-4fda-89c8-4c7549203599 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:38.873943 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17550288-dedf-4fda-89c8-4c7549203599 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:38.873943 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17550288-dedf-4fda-89c8-4c7549203599 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:38.876041 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 553/1118] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:15:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:15:38.881411 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a247453-be92-457b-ba29-ef8c03889ca1 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:38.881854 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a247453-be92-457b-ba29-ef8c03889ca1 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:38.881954 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a247453-be92-457b-ba29-ef8c03889ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:38.904756 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-3a247453-be92-457b-ba29-ef8c03889ca1 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:15:38.905988 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-3a247453-be92-457b-ba29-ef8c03889ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:15:38.986264 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 566/1119] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:15:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:15:39.265894 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17550288-dedf-4fda-89c8-4c7549203599 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:39.400710 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17550288-dedf-4fda-89c8-4c7549203599 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:39.442231 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47186827-b339-4dd7-9213-3b3d2e2e69f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:39.442863 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47186827-b339-4dd7-9213-3b3d2e2e69f8 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:39.443142 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47186827-b339-4dd7-9213-3b3d2e2e69f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:39.443417 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47186827-b339-4dd7-9213-3b3d2e2e69f8 None admin] PATH_INFO: `/v3/roles/8767fe0bd994478fac741fc8c76f649e` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:39.444950 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47186827-b339-4dd7-9213-3b3d2e2e69f8 None admin] RBAC: Authorizing `identity:get_role(role_id=8767fe0bd994478fac741fc8c76f649e)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:39.446443 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47186827-b339-4dd7-9213-3b3d2e2e69f8 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:39.447760 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 554/1120] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Aug 29 22:15:39 2022] GET /identity/v3/roles/8767fe0bd994478fac741fc8c76f649e => generated 223 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:39.453982 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a247453-be92-457b-ba29-ef8c03889ca1 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:39.498743 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:39.558103 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a247453-be92-457b-ba29-ef8c03889ca1 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:39.609223 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aaf293-4c82-41cf-a3b3-0844d8edd73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:39.610314 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aaf293-4c82-41cf-a3b3-0844d8edd73d None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:39.610776 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aaf293-4c82-41cf-a3b3-0844d8edd73d None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:39.611234 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aaf293-4c82-41cf-a3b3-0844d8edd73d None admin] PATH_INFO: `/v3/users/01b64dd4d6b049999b50ec8480864421` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:39.613344 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aaf293-4c82-41cf-a3b3-0844d8edd73d None admin] RBAC: Authorizing `identity:get_user(user_id=01b64dd4d6b049999b50ec8480864421)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:39.615044 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aaf293-4c82-41cf-a3b3-0844d8edd73d None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:39.618229 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 567/1121] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Aug 29 22:15:39 2022] GET /identity/v3/users/01b64dd4d6b049999b50ec8480864421 => generated 286 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:39.627307 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47186827-b339-4dd7-9213-3b3d2e2e69f8 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:39.631723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:39.737416 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47186827-b339-4dd7-9213-3b3d2e2e69f8 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:39.772877 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4acda51-c2a0-4d6a-b37a-79e33f689c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:39.773547 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4acda51-c2a0-4d6a-b37a-79e33f689c16 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:39.773829 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4acda51-c2a0-4d6a-b37a-79e33f689c16 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:39.774098 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4acda51-c2a0-4d6a-b37a-79e33f689c16 None admin] PATH_INFO: `/v3/projects/d919c6585dac4128a3708fffd216d4da` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:39.775256 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4acda51-c2a0-4d6a-b37a-79e33f689c16 None admin] RBAC: Authorizing `identity:get_project(project_id=d919c6585dac4128a3708fffd216d4da)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:39.776712 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4acda51-c2a0-4d6a-b37a-79e33f689c16 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:39.778370 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 555/1122] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Aug 29 22:15:39 2022] GET /identity/v3/projects/d919c6585dac4128a3708fffd216d4da => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:39.785289 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aaf293-4c82-41cf-a3b3-0844d8edd73d None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:39.894924 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aaf293-4c82-41cf-a3b3-0844d8edd73d None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:39.904496 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:39.929632 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b0d9bb-6682-4d98-88c9-0dd7fbee7a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:39.930283 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0d9bb-6682-4d98-88c9-0dd7fbee7a77 None admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:39.930563 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0d9bb-6682-4d98-88c9-0dd7fbee7a77 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:39.930834 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0d9bb-6682-4d98-88c9-0dd7fbee7a77 None admin] PATH_INFO: `/v3/projects/d919c6585dac4128a3708fffd216d4da/users/01b64dd4d6b049999b50ec8480864421/roles/8767fe0bd994478fac741fc8c76f649e` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:39.933033 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b0d9bb-6682-4d98-88c9-0dd7fbee7a77 None admin] RBAC: Authorizing `identity:create_grant(project_id=d919c6585dac4128a3708fffd216d4da, user_id=01b64dd4d6b049999b50ec8480864421, role_id=8767fe0bd994478fac741fc8c76f649e)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:39.934466 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b0d9bb-6682-4d98-88c9-0dd7fbee7a77 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:39.954318 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 568/1123] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Aug 29 22:15:39 2022] PUT /identity/v3/projects/d919c6585dac4128a3708fffd216d4da/users/01b64dd4d6b049999b50ec8480864421/roles/8767fe0bd994478fac741fc8c76f649e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:15:41.859547 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55487e8-de4c-4ed7-b311-aec53c905a3b None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:41.860115 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55487e8-de4c-4ed7-b311-aec53c905a3b None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:41.860115 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55487e8-de4c-4ed7-b311-aec53c905a3b None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:41.862358 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 556/1124] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:15:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:15:41.868352 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0e64c-6afb-4b55-b4b0-dc2b075a35d5 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:41.868867 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0e64c-6afb-4b55-b4b0-dc2b075a35d5 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:41.868988 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0e64c-6afb-4b55-b4b0-dc2b075a35d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:41.887435 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-52e0e64c-6afb-4b55-b4b0-dc2b075a35d5 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:15:41.888661 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-52e0e64c-6afb-4b55-b4b0-dc2b075a35d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:15:41.963856 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 569/1125] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:15:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:15:42.230782 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55487e8-de4c-4ed7-b311-aec53c905a3b None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:42.313855 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:42.353114 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55487e8-de4c-4ed7-b311-aec53c905a3b None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:42.395245 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d88d69c-e041-4b57-8a49-3f7b7a8e5114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:42.395865 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88d69c-e041-4b57-8a49-3f7b7a8e5114 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:42.396141 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88d69c-e041-4b57-8a49-3f7b7a8e5114 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:42.396413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88d69c-e041-4b57-8a49-3f7b7a8e5114 None admin] PATH_INFO: `/v3/roles/8767fe0bd994478fac741fc8c76f649e` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:42.397939 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d88d69c-e041-4b57-8a49-3f7b7a8e5114 None admin] RBAC: Authorizing `identity:get_role(role_id=8767fe0bd994478fac741fc8c76f649e)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:42.399323 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d88d69c-e041-4b57-8a49-3f7b7a8e5114 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:42.400665 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 557/1126] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Aug 29 22:15:42 2022] GET /identity/v3/roles/8767fe0bd994478fac741fc8c76f649e => generated 223 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:42.407472 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e0e64c-6afb-4b55-b4b0-dc2b075a35d5 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:42.520292 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:42.525261 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e0e64c-6afb-4b55-b4b0-dc2b075a35d5 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:42.572115 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7611c5-5d23-4e75-b35f-b03a00f82b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:42.572794 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7611c5-5d23-4e75-b35f-b03a00f82b96 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:42.573061 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7611c5-5d23-4e75-b35f-b03a00f82b96 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:42.573337 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7611c5-5d23-4e75-b35f-b03a00f82b96 None admin] PATH_INFO: `/v3/users/01b64dd4d6b049999b50ec8480864421` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:42.574535 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7611c5-5d23-4e75-b35f-b03a00f82b96 None admin] RBAC: Authorizing `identity:get_user(user_id=01b64dd4d6b049999b50ec8480864421)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:42.575986 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7611c5-5d23-4e75-b35f-b03a00f82b96 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:42.577654 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 570/1127] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Aug 29 22:15:42 2022] GET /identity/v3/users/01b64dd4d6b049999b50ec8480864421 => generated 286 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:42.583688 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d88d69c-e041-4b57-8a49-3f7b7a8e5114 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:42.698831 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d88d69c-e041-4b57-8a49-3f7b7a8e5114 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:42.746922 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892fb95a-0daa-4f86-928b-4816660059eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:42.747518 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fb95a-0daa-4f86-928b-4816660059eb None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:42.747769 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fb95a-0daa-4f86-928b-4816660059eb None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:42.748066 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fb95a-0daa-4f86-928b-4816660059eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:42.759841 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:42.824928 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892fb95a-0daa-4f86-928b-4816660059eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:42.826377 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892fb95a-0daa-4f86-928b-4816660059eb None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:42.941590 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 558/1128] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:15:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:15:42.949581 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7611c5-5d23-4e75-b35f-b03a00f82b96 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:43.065113 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7611c5-5d23-4e75-b35f-b03a00f82b96 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:43.104200 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb5261a-fe99-47c2-a048-6b808b7dccc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:43.104779 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5261a-fe99-47c2-a048-6b808b7dccc7 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:43.105056 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5261a-fe99-47c2-a048-6b808b7dccc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:43.105330 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5261a-fe99-47c2-a048-6b808b7dccc7 None admin] PATH_INFO: `/v3/projects/d919c6585dac4128a3708fffd216d4da` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:43.106457 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb5261a-fe99-47c2-a048-6b808b7dccc7 None admin] RBAC: Authorizing `identity:get_project(project_id=d919c6585dac4128a3708fffd216d4da)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:43.107880 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb5261a-fe99-47c2-a048-6b808b7dccc7 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:43.109566 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 571/1129] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Aug 29 22:15:42 2022] GET /identity/v3/projects/d919c6585dac4128a3708fffd216d4da => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:43.116177 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892fb95a-0daa-4f86-928b-4816660059eb None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:43.164585 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:43.227963 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892fb95a-0daa-4f86-928b-4816660059eb None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:43.266187 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c5445-cfb2-40d1-a9cc-008c6abaa47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:43.266775 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c5445-cfb2-40d1-a9cc-008c6abaa47f None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:43.267054 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c5445-cfb2-40d1-a9cc-008c6abaa47f None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:43.267328 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c5445-cfb2-40d1-a9cc-008c6abaa47f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:43.268057 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993c5445-cfb2-40d1-a9cc-008c6abaa47f None admin] RBAC: Adding query filter params (role.id=8767fe0bd994478fac741fc8c76f649e, scope.project.id=d919c6585dac4128a3708fffd216d4da, user.id=01b64dd4d6b049999b50ec8480864421) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:43.268364 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993c5445-cfb2-40d1-a9cc-008c6abaa47f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:43.269821 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993c5445-cfb2-40d1-a9cc-008c6abaa47f None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:43.275903 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 559/1130] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Aug 29 22:15:43 2022] GET /identity/v3/role_assignments?user.id=01b64dd4d6b049999b50ec8480864421&scope.project.id=d919c6585dac4128a3708fffd216d4da&role.id=8767fe0bd994478fac741fc8c76f649e => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:45.259086 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241c370-02da-4835-a37b-1922ead7eb04 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:45.259903 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241c370-02da-4835-a37b-1922ead7eb04 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:45.259903 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241c370-02da-4835-a37b-1922ead7eb04 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:45.262002 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 572/1131] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:15:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:15:45.268617 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a6d7a-9810-48bb-b51d-ac30e97e923b None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:45.269071 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a6d7a-9810-48bb-b51d-ac30e97e923b None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:45.269164 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a6d7a-9810-48bb-b51d-ac30e97e923b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:45.296154 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-fa5a6d7a-9810-48bb-b51d-ac30e97e923b None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:15:45.297415 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-fa5a6d7a-9810-48bb-b51d-ac30e97e923b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:15:45.373559 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 560/1132] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:15:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:15:45.638028 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241c370-02da-4835-a37b-1922ead7eb04 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:45.683326 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:45.756678 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241c370-02da-4835-a37b-1922ead7eb04 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:45.794316 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a23eb7-0fcc-4733-bc60-2eea6e4371c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:45.794940 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a23eb7-0fcc-4733-bc60-2eea6e4371c5 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:45.795216 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a23eb7-0fcc-4733-bc60-2eea6e4371c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:45.795481 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a23eb7-0fcc-4733-bc60-2eea6e4371c5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:45.796738 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a23eb7-0fcc-4733-bc60-2eea6e4371c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:45.798164 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a23eb7-0fcc-4733-bc60-2eea6e4371c5 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:45.799722 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 573/1133] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:15:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:45.805954 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a6d7a-9810-48bb-b51d-ac30e97e923b None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:45.837775 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:45.924140 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a6d7a-9810-48bb-b51d-ac30e97e923b None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:45.959688 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb7f3b-abcd-4df6-a3b5-2b02bffdb612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:45.960288 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb7f3b-abcd-4df6-a3b5-2b02bffdb612 None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:45.960591 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb7f3b-abcd-4df6-a3b5-2b02bffdb612 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:45.960840 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb7f3b-abcd-4df6-a3b5-2b02bffdb612 None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:45.961617 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb7f3b-abcd-4df6-a3b5-2b02bffdb612 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:45.963042 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb7f3b-abcd-4df6-a3b5-2b02bffdb612 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:45.991613 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 561/1134] 10.222.0.36 () {60 vars in 1141 bytes} [Mon Aug 29 22:15:45 2022] POST /identity/v3/projects => generated 311 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:15:47.981617 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3d85d-28ca-49e5-a9a6-ff0bead8a5c3 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:47.982220 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3d85d-28ca-49e5-a9a6-ff0bead8a5c3 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:47.982220 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3d85d-28ca-49e5-a9a6-ff0bead8a5c3 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:47.983482 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 574/1135] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:15:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:15:47.989036 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb06fb6-0c81-4529-a16b-b2fff0a0a1f9 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:47.989486 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb06fb6-0c81-4529-a16b-b2fff0a0a1f9 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:47.989603 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb06fb6-0c81-4529-a16b-b2fff0a0a1f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:48.009551 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-6bb06fb6-0c81-4529-a16b-b2fff0a0a1f9 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:15:48.010740 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-6bb06fb6-0c81-4529-a16b-b2fff0a0a1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:15:48.082390 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 562/1136] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:15:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:15:48.349617 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d3d85d-28ca-49e5-a9a6-ff0bead8a5c3 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:48.454185 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d3d85d-28ca-49e5-a9a6-ff0bead8a5c3 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:48.455760 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:48.489461 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42750f5-83a2-419a-ae7a-7ed15bf63b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:48.490084 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42750f5-83a2-419a-ae7a-7ed15bf63b9e None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:48.490364 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42750f5-83a2-419a-ae7a-7ed15bf63b9e None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:48.490633 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42750f5-83a2-419a-ae7a-7ed15bf63b9e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:48.491750 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42750f5-83a2-419a-ae7a-7ed15bf63b9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:48.493311 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42750f5-83a2-419a-ae7a-7ed15bf63b9e None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:48.494911 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 575/1137] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:15:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:48.500921 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb06fb6-0c81-4529-a16b-b2fff0a0a1f9 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:48.517429 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:48.607611 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb06fb6-0c81-4529-a16b-b2fff0a0a1f9 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:48.643477 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f40bdcf-e4bf-488f-9429-c86e99cfe38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:48.644083 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40bdcf-e4bf-488f-9429-c86e99cfe38b None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:48.644363 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40bdcf-e4bf-488f-9429-c86e99cfe38b None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:48.644668 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40bdcf-e4bf-488f-9429-c86e99cfe38b None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:48.645316 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f40bdcf-e4bf-488f-9429-c86e99cfe38b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:48.646748 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f40bdcf-e4bf-488f-9429-c86e99cfe38b None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:48.668526 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 563/1138] 10.222.0.36 () {60 vars in 1132 bytes} [Mon Aug 29 22:15:48 2022] POST /identity/v3/users => generated 286 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:15:50.603598 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99374ce-191e-4366-bc0a-0a0968be25b2 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:50.604214 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99374ce-191e-4366-bc0a-0a0968be25b2 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:50.604214 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99374ce-191e-4366-bc0a-0a0968be25b2 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:50.605548 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 576/1139] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:15:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:15:50.611307 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628d6b0-db1f-45fe-87bd-1db77b30c0d1 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:50.611818 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628d6b0-db1f-45fe-87bd-1db77b30c0d1 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:50.611956 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628d6b0-db1f-45fe-87bd-1db77b30c0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:50.631122 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-f628d6b0-db1f-45fe-87bd-1db77b30c0d1 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:15:50.632337 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f628d6b0-db1f-45fe-87bd-1db77b30c0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:15:50.697702 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:50.702913 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 564/1140] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:15:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:15:50.974433 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99374ce-191e-4366-bc0a-0a0968be25b2 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:51.090431 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99374ce-191e-4366-bc0a-0a0968be25b2 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:51.127880 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eca9e0-c9f1-443a-b801-b2191bf05a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:51.128529 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eca9e0-c9f1-443a-b801-b2191bf05a04 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:51.128814 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eca9e0-c9f1-443a-b801-b2191bf05a04 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:51.129083 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eca9e0-c9f1-443a-b801-b2191bf05a04 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:51.140078 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eca9e0-c9f1-443a-b801-b2191bf05a04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:15:51.145018 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-37eca9e0-c9f1-443a-b801-b2191bf05a04 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:15:51.145018 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:51.145018 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:15:51.145018 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:15:51.145018 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:15:51.145018 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:15:51.145018 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:15:51.145018 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:15:51.145018 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:15:51.145018 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:15:51.145018 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:15:51.145018 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:15:51.145018 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:15:51.145018 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:15:51.145018 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:15:51.145018 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:15:51.146176 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:15:51.146176 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:15:51.146176 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:15:51.146176 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:15:51.146176 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:15:51.146176 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:15:51.146176 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:15:51.146176 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:15:51.146176 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:15:51.146176 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:15:51.146176 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:15:51.146176 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:15:51.146176 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:15:51.146176 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:15:51.146176 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:15:51.146176 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:15:51.148047 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:15:51.148047 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:15:51.148047 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:15:51.148047 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:15:51.148047 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:15:51.148047 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:15:51.148047 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:15:51.148047 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:15:51.148047 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:15:51.148047 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:15:51.148047 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:15:51.148047 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:15:51.148047 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 577/1141] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Aug 29 22:15:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:15:51.155041 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f628d6b0-db1f-45fe-87bd-1db77b30c0d1 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:51.264007 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f628d6b0-db1f-45fe-87bd-1db77b30c0d1 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:51.305555 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253b4e6-7159-4788-9119-6b5eebc3312a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:51.306186 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253b4e6-7159-4788-9119-6b5eebc3312a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:51.306467 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253b4e6-7159-4788-9119-6b5eebc3312a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:51.306738 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253b4e6-7159-4788-9119-6b5eebc3312a None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:51.307401 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6253b4e6-7159-4788-9119-6b5eebc3312a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:51.307703 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6253b4e6-7159-4788-9119-6b5eebc3312a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:51.309117 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6253b4e6-7159-4788-9119-6b5eebc3312a None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:51.317365 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 565/1142] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:15:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:51.323969 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eca9e0-c9f1-443a-b801-b2191bf05a04 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:51.356327 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:51.440754 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eca9e0-c9f1-443a-b801-b2191bf05a04 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:51.477809 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0d84a-827a-49d9-b885-e6fd2bba6689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:51.478437 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0d84a-827a-49d9-b885-e6fd2bba6689 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:51.478718 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0d84a-827a-49d9-b885-e6fd2bba6689 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:51.478995 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0d84a-827a-49d9-b885-e6fd2bba6689 None admin] PATH_INFO: `/v3/users/0088ac89127844dea19f7254e8637d7b` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:51.493470 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b0d84a-827a-49d9-b885-e6fd2bba6689 None admin] RBAC: Authorizing `identity:get_user(user_id=0088ac89127844dea19f7254e8637d7b)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:51.494914 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b0d84a-827a-49d9-b885-e6fd2bba6689 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:51.496591 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 578/1143] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Aug 29 22:15:51 2022] GET /identity/v3/users/0088ac89127844dea19f7254e8637d7b => generated 286 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:51.503003 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253b4e6-7159-4788-9119-6b5eebc3312a None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:51.569401 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:51.609853 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253b4e6-7159-4788-9119-6b5eebc3312a None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:51.644365 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c898e440-a347-4b7e-a397-b86a75759cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:51.645006 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898e440-a347-4b7e-a397-b86a75759cbe None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:51.645212 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898e440-a347-4b7e-a397-b86a75759cbe None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:51.645512 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898e440-a347-4b7e-a397-b86a75759cbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:51.722953 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c898e440-a347-4b7e-a397-b86a75759cbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:51.724335 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c898e440-a347-4b7e-a397-b86a75759cbe None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:51.787303 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:51.827020 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 566/1144] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:15:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:15:51.833758 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0d84a-827a-49d9-b885-e6fd2bba6689 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:51.928248 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:51.942047 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0d84a-827a-49d9-b885-e6fd2bba6689 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:51.976315 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f5c4b-fc2c-4eda-965f-0ceff63475aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:51.977083 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f5c4b-fc2c-4eda-965f-0ceff63475aa None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:51.977390 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f5c4b-fc2c-4eda-965f-0ceff63475aa None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:51.977646 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f5c4b-fc2c-4eda-965f-0ceff63475aa None admin] PATH_INFO: `/v3/projects/3fb9c5bf7edc4648b3e08b691f531043` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:51.978910 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0f5c4b-fc2c-4eda-965f-0ceff63475aa None admin] RBAC: Authorizing `identity:get_project(project_id=3fb9c5bf7edc4648b3e08b691f531043)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:51.980343 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0f5c4b-fc2c-4eda-965f-0ceff63475aa None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:51.982013 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 579/1145] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Aug 29 22:15:51 2022] GET /identity/v3/projects/3fb9c5bf7edc4648b3e08b691f531043 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:51.989096 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c898e440-a347-4b7e-a397-b86a75759cbe None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:52.103953 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c898e440-a347-4b7e-a397-b86a75759cbe None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:52.140296 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd0081-c387-4b5d-868a-c52ff9c42a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:52.140934 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd0081-c387-4b5d-868a-c52ff9c42a4e None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:52.141206 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd0081-c387-4b5d-868a-c52ff9c42a4e None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:52.141478 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd0081-c387-4b5d-868a-c52ff9c42a4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:52.142202 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd0081-c387-4b5d-868a-c52ff9c42a4e None admin] RBAC: Adding query filter params (role.id=ff59a239a50b4bd899a83bf3c3fd1f63, scope.project.id=3fb9c5bf7edc4648b3e08b691f531043, user.id=0088ac89127844dea19f7254e8637d7b) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:52.142514 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd0081-c387-4b5d-868a-c52ff9c42a4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:52.143942 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd0081-c387-4b5d-868a-c52ff9c42a4e None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:52.149864 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 567/1146] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Aug 29 22:15:51 2022] GET /identity/v3/role_assignments?user.id=0088ac89127844dea19f7254e8637d7b&scope.project.id=3fb9c5bf7edc4648b3e08b691f531043&role.id=ff59a239a50b4bd899a83bf3c3fd1f63 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:54.057385 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c9469-b9e5-4326-a79d-8431a8e84d76 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:54.057933 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c9469-b9e5-4326-a79d-8431a8e84d76 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:54.057933 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c9469-b9e5-4326-a79d-8431a8e84d76 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:54.059273 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 580/1147] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:15:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:15:54.065660 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad85dc2-1c79-4499-8122-d44babe17b12 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:54.066097 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad85dc2-1c79-4499-8122-d44babe17b12 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:54.066317 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad85dc2-1c79-4499-8122-d44babe17b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:54.088715 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-cad85dc2-1c79-4499-8122-d44babe17b12 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:15:54.089899 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-cad85dc2-1c79-4499-8122-d44babe17b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:15:54.113022 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:54.162539 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 568/1148] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:15:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:15:54.425110 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c9469-b9e5-4326-a79d-8431a8e84d76 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:54.534376 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c9469-b9e5-4326-a79d-8431a8e84d76 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:54.578657 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8516301a-e3d2-420e-8657-a867e8c7b0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:54.579299 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516301a-e3d2-420e-8657-a867e8c7b0e7 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:54.579574 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516301a-e3d2-420e-8657-a867e8c7b0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:54.579839 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516301a-e3d2-420e-8657-a867e8c7b0e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:54.590983 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8516301a-e3d2-420e-8657-a867e8c7b0e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:15:54.595970 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-8516301a-e3d2-420e-8657-a867e8c7b0e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:15:54.595970 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:54.595970 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:15:54.595970 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:15:54.595970 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:15:54.595970 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:15:54.595970 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:15:54.595970 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:15:54.595970 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:15:54.595970 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:15:54.595970 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:15:54.595970 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:15:54.595970 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:15:54.595970 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:15:54.595970 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:15:54.595970 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:15:54.597032 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:15:54.597032 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:15:54.597032 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:15:54.597032 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:15:54.597032 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:15:54.597032 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:15:54.597032 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:15:54.597032 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:15:54.597032 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:15:54.597032 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:15:54.597032 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:15:54.597032 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:15:54.597032 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:15:54.597032 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:15:54.597032 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:15:54.597032 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:15:54.598437 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:15:54.598437 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:15:54.598437 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:15:54.598437 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:15:54.598437 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:15:54.598437 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:15:54.598437 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:15:54.598437 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:15:54.598437 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:15:54.598437 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:15:54.598437 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:15:54.598437 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:15:54.598437 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 581/1149] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Aug 29 22:15:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:15:54.606690 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad85dc2-1c79-4499-8122-d44babe17b12 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:54.718866 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad85dc2-1c79-4499-8122-d44babe17b12 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:54.753564 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1c36a-8166-4a5d-9646-deddb8b30d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:54.754169 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1c36a-8166-4a5d-9646-deddb8b30d5f None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:54.754444 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1c36a-8166-4a5d-9646-deddb8b30d5f None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:54.754713 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1c36a-8166-4a5d-9646-deddb8b30d5f None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:54.755373 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1c36a-8166-4a5d-9646-deddb8b30d5f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:54.755674 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1c36a-8166-4a5d-9646-deddb8b30d5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:54.757066 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1c36a-8166-4a5d-9646-deddb8b30d5f None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:54.766538 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 569/1150] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:15:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:54.772789 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8516301a-e3d2-420e-8657-a867e8c7b0e7 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:54.792184 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:54.892246 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8516301a-e3d2-420e-8657-a867e8c7b0e7 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:54.936332 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc9fd7a-5e1e-41d2-9dea-a01a75212ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:54.936990 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9fd7a-5e1e-41d2-9dea-a01a75212ca7 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:54.937278 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9fd7a-5e1e-41d2-9dea-a01a75212ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:54.937543 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9fd7a-5e1e-41d2-9dea-a01a75212ca7 None admin] PATH_INFO: `/v3/users/0088ac89127844dea19f7254e8637d7b` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:54.938713 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc9fd7a-5e1e-41d2-9dea-a01a75212ca7 None admin] RBAC: Authorizing `identity:get_user(user_id=0088ac89127844dea19f7254e8637d7b)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:54.940177 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc9fd7a-5e1e-41d2-9dea-a01a75212ca7 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:54.941812 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 582/1151] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Aug 29 22:15:54 2022] GET /identity/v3/users/0088ac89127844dea19f7254e8637d7b => generated 286 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:15:54.950806 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1c36a-8166-4a5d-9646-deddb8b30d5f None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:54.974230 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:55.069129 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1c36a-8166-4a5d-9646-deddb8b30d5f None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:55.107458 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e882c6-7c73-41b6-a694-e61951037c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:55.108094 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e882c6-7c73-41b6-a694-e61951037c68 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:55.108375 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e882c6-7c73-41b6-a694-e61951037c68 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:55.108685 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e882c6-7c73-41b6-a694-e61951037c68 None admin] PATH_INFO: `/v3/projects/3fb9c5bf7edc4648b3e08b691f531043` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:55.109933 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e882c6-7c73-41b6-a694-e61951037c68 None admin] RBAC: Authorizing `identity:get_project(project_id=3fb9c5bf7edc4648b3e08b691f531043)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:55.111379 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e882c6-7c73-41b6-a694-e61951037c68 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:55.113081 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 570/1152] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Aug 29 22:15:54 2022] GET /identity/v3/projects/3fb9c5bf7edc4648b3e08b691f531043 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:55.122577 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc9fd7a-5e1e-41d2-9dea-a01a75212ca7 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:55.218940 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:55.243376 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc9fd7a-5e1e-41d2-9dea-a01a75212ca7 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:55.279553 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facaa749-b933-4668-8b1b-ad33ea4b846e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:55.280205 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facaa749-b933-4668-8b1b-ad33ea4b846e None admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:55.280495 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facaa749-b933-4668-8b1b-ad33ea4b846e None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:55.280772 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facaa749-b933-4668-8b1b-ad33ea4b846e None admin] PATH_INFO: `/v3/projects/3fb9c5bf7edc4648b3e08b691f531043/users/0088ac89127844dea19f7254e8637d7b/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:55.282830 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facaa749-b933-4668-8b1b-ad33ea4b846e None admin] RBAC: Authorizing `identity:create_grant(project_id=3fb9c5bf7edc4648b3e08b691f531043, user_id=0088ac89127844dea19f7254e8637d7b, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:55.284258 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facaa749-b933-4668-8b1b-ad33ea4b846e None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:55.305027 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 583/1153] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Aug 29 22:15:55 2022] PUT /identity/v3/projects/3fb9c5bf7edc4648b3e08b691f531043/users/0088ac89127844dea19f7254e8637d7b/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:15:57.180781 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa0575-9e72-4980-ae24-57cacdcbb787 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:57.181614 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa0575-9e72-4980-ae24-57cacdcbb787 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:57.181614 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa0575-9e72-4980-ae24-57cacdcbb787 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:57.183685 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 571/1154] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:15:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:15:57.189195 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58876deb-d2f8-4e94-bc47-a512a0c2e611 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:57.189634 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58876deb-d2f8-4e94-bc47-a512a0c2e611 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:57.189756 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58876deb-d2f8-4e94-bc47-a512a0c2e611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:57.209784 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-58876deb-d2f8-4e94-bc47-a512a0c2e611 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:15:57.212258 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-58876deb-d2f8-4e94-bc47-a512a0c2e611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:15:57.288251 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 584/1155] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:15:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:15:57.551079 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fa0575-9e72-4980-ae24-57cacdcbb787 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:57.655152 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:57.674740 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fa0575-9e72-4980-ae24-57cacdcbb787 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:57.710578 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68574691-987a-4016-ab22-0a9381001e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:57.711301 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68574691-987a-4016-ab22-0a9381001e73 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:57.711583 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68574691-987a-4016-ab22-0a9381001e73 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:57.711857 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68574691-987a-4016-ab22-0a9381001e73 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:57.722554 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68574691-987a-4016-ab22-0a9381001e73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:15:57.727665 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-68574691-987a-4016-ab22-0a9381001e73 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:15:57.727665 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:15:57.727665 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:15:57.727665 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:15:57.727665 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:15:57.727665 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:15:57.727665 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:15:57.727665 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:15:57.727665 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:15:57.727665 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:15:57.727665 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:15:57.727665 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:15:57.727665 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:15:57.727665 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:15:57.727665 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:15:57.727665 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:15:57.728801 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:15:57.728801 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:15:57.728801 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:15:57.728801 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:15:57.728801 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:15:57.728801 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:15:57.728801 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:15:57.728801 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:15:57.728801 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:15:57.728801 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:15:57.728801 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:15:57.728801 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:15:57.728801 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:15:57.728801 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:15:57.728801 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:15:57.728801 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:15:57.729959 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:15:57.729959 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:15:57.729959 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:15:57.729959 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:15:57.729959 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:15:57.729959 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:15:57.729959 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:15:57.729959 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:15:57.729959 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:15:57.729959 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:15:57.729959 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:15:57.729959 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:15:57.729959 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 572/1156] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Aug 29 22:15:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:15:57.738218 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58876deb-d2f8-4e94-bc47-a512a0c2e611 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:57.826057 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:57.860883 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58876deb-d2f8-4e94-bc47-a512a0c2e611 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:57.900573 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3587a1-d56a-4e90-a8f2-efe983677c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:57.901214 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3587a1-d56a-4e90-a8f2-efe983677c3c None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:57.901493 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3587a1-d56a-4e90-a8f2-efe983677c3c None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:57.901767 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3587a1-d56a-4e90-a8f2-efe983677c3c None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:57.902443 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3587a1-d56a-4e90-a8f2-efe983677c3c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:57.902754 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3587a1-d56a-4e90-a8f2-efe983677c3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:57.904144 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3587a1-d56a-4e90-a8f2-efe983677c3c None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:57.913455 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 585/1157] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:15:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:57.920042 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68574691-987a-4016-ab22-0a9381001e73 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:58.025191 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68574691-987a-4016-ab22-0a9381001e73 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:58.059121 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b3ab5-6d28-4b17-bb49-6a2f5f326cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:58.059742 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b3ab5-6d28-4b17-bb49-6a2f5f326cb9 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:58.060017 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b3ab5-6d28-4b17-bb49-6a2f5f326cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:58.060279 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b3ab5-6d28-4b17-bb49-6a2f5f326cb9 None admin] PATH_INFO: `/v3/users/0088ac89127844dea19f7254e8637d7b` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:58.061457 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558b3ab5-6d28-4b17-bb49-6a2f5f326cb9 None admin] RBAC: Authorizing `identity:get_user(user_id=0088ac89127844dea19f7254e8637d7b)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:58.062886 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558b3ab5-6d28-4b17-bb49-6a2f5f326cb9 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:58.064445 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 573/1158] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Aug 29 22:15:57 2022] GET /identity/v3/users/0088ac89127844dea19f7254e8637d7b => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:58.073593 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3587a1-d56a-4e90-a8f2-efe983677c3c None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:58.189996 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3587a1-d56a-4e90-a8f2-efe983677c3c None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:58.229828 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738756c-84e8-4cd2-8327-6a407ad68aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:58.230493 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738756c-84e8-4cd2-8327-6a407ad68aa3 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:58.230766 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738756c-84e8-4cd2-8327-6a407ad68aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:58.231030 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738756c-84e8-4cd2-8327-6a407ad68aa3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:58.235175 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:58.316784 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e738756c-84e8-4cd2-8327-6a407ad68aa3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:58.318268 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e738756c-84e8-4cd2-8327-6a407ad68aa3 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:58.423043 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 586/1159] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:15:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:15:58.432102 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b3ab5-6d28-4b17-bb49-6a2f5f326cb9 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:58.451216 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:58.543036 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b3ab5-6d28-4b17-bb49-6a2f5f326cb9 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:58.577712 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a89973-d154-4545-8a9f-79c25fae0473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:58.578333 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a89973-d154-4545-8a9f-79c25fae0473 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:58.578616 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a89973-d154-4545-8a9f-79c25fae0473 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:58.578889 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a89973-d154-4545-8a9f-79c25fae0473 None admin] PATH_INFO: `/v3/projects/3fb9c5bf7edc4648b3e08b691f531043` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:58.580033 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a89973-d154-4545-8a9f-79c25fae0473 None admin] RBAC: Authorizing `identity:get_project(project_id=3fb9c5bf7edc4648b3e08b691f531043)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:58.581492 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a89973-d154-4545-8a9f-79c25fae0473 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:58.583118 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 574/1160] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Aug 29 22:15:58 2022] GET /identity/v3/projects/3fb9c5bf7edc4648b3e08b691f531043 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:15:58.590104 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738756c-84e8-4cd2-8327-6a407ad68aa3 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:15:58.634321 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:15:58.710119 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738756c-84e8-4cd2-8327-6a407ad68aa3 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:15:58.747497 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2759dc9a-9d4b-40f2-9f9f-9971cf6d83f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:15:58.748093 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759dc9a-9d4b-40f2-9f9f-9971cf6d83f2 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:15:58.748373 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759dc9a-9d4b-40f2-9f9f-9971cf6d83f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:15:58.748661 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759dc9a-9d4b-40f2-9f9f-9971cf6d83f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:15:58.749388 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2759dc9a-9d4b-40f2-9f9f-9971cf6d83f2 None admin] RBAC: Adding query filter params (role.id=ff59a239a50b4bd899a83bf3c3fd1f63, scope.project.id=3fb9c5bf7edc4648b3e08b691f531043, user.id=0088ac89127844dea19f7254e8637d7b) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:15:58.749694 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2759dc9a-9d4b-40f2-9f9f-9971cf6d83f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:15:58.751153 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2759dc9a-9d4b-40f2-9f9f-9971cf6d83f2 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:15:58.756971 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 587/1161] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Aug 29 22:15:58 2022] GET /identity/v3/role_assignments?user.id=0088ac89127844dea19f7254e8637d7b&scope.project.id=3fb9c5bf7edc4648b3e08b691f531043&role.id=ff59a239a50b4bd899a83bf3c3fd1f63 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:16:00.662399 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f630b-9c37-4b70-a197-4a44f95b8821 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:16:00.663282 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f630b-9c37-4b70-a197-4a44f95b8821 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:16:00.663282 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f630b-9c37-4b70-a197-4a44f95b8821 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:16:00.665887 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 575/1162] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:16:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:16:00.681380 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191b062-563b-48ad-975f-2dc61827265f None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:16:00.681854 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191b062-563b-48ad-975f-2dc61827265f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:16:00.681945 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191b062-563b-48ad-975f-2dc61827265f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:16:00.708112 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-8191b062-563b-48ad-975f-2dc61827265f None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:16:00.709652 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-8191b062-563b-48ad-975f-2dc61827265f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:16:00.783089 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 588/1163] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:16:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:16:01.048035 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f630b-9c37-4b70-a197-4a44f95b8821 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:16:01.156721 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:16:01.179469 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f630b-9c37-4b70-a197-4a44f95b8821 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:16:01.217688 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd2d02c-95f4-4cfa-bb05-c10038c3b799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:16:01.218295 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2d02c-95f4-4cfa-bb05-c10038c3b799 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:16:01.218573 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2d02c-95f4-4cfa-bb05-c10038c3b799 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:16:01.218843 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2d02c-95f4-4cfa-bb05-c10038c3b799 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:16:01.287146 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd2d02c-95f4-4cfa-bb05-c10038c3b799 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:16:01.288619 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd2d02c-95f4-4cfa-bb05-c10038c3b799 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:16:01.371680 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:16:01.391739 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 576/1164] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:16:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:16:01.400485 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191b062-563b-48ad-975f-2dc61827265f None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:16:01.431512 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:16:01.519084 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191b062-563b-48ad-975f-2dc61827265f None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:16:01.564053 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f99123-2d8a-4202-81d3-126974f31ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:16:01.564987 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f99123-2d8a-4202-81d3-126974f31ce8 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:16:01.565387 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f99123-2d8a-4202-81d3-126974f31ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:16:01.565832 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f99123-2d8a-4202-81d3-126974f31ce8 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:16:01.574506 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f99123-2d8a-4202-81d3-126974f31ce8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:16:01.575971 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f99123-2d8a-4202-81d3-126974f31ce8 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:16:01.587632 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-f4f99123-2d8a-4202-81d3-126974f31ce8 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 29 22:16:01.587632 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:16:01.587632 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 29 22:16:01.587632 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 29 22:16:01.587632 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:16:01.587632 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:16:01.587632 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:16:01.587632 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:16:01.587632 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 29 22:16:01.587632 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:16:01.587632 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:16:01.587632 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:16:01.587632 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:16:01.587632 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:16:01.587632 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:16:01.587632 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:16:01.587632 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:16:01.590033 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:16:01.590033 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:16:01.590033 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:16:01.590033 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:16:01.590033 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:16:01.590033 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:16:01.590033 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:16:01.590033 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:16:01.590033 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:16:01.590033 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:16:01.590033 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:16:01.590033 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:16:01.590033 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:16:01.590033 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:16:01.590033 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:16:01.590033 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:16:01.591251 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:16:01.591251 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:16:01.591251 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:16:01.591251 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:16:01.591251 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:16:01.591251 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:16:01.591251 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:16:01.591251 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:16:01.591251 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:16:01.591251 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:16:01.591251 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 29 22:16:01.591251 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:16:01.591251 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 29 22:16:01.591251 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:16:01.591251 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 589/1165] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Aug 29 22:16:01 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:16:01.595044 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd2d02c-95f4-4cfa-bb05-c10038c3b799 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:16:01.700662 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd2d02c-95f4-4cfa-bb05-c10038c3b799 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:16:01.740750 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7081c4c-ac31-4242-9ae8-770f6342ac42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:16:01.741359 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7081c4c-ac31-4242-9ae8-770f6342ac42 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:16:01.741644 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7081c4c-ac31-4242-9ae8-770f6342ac42 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:16:01.741919 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7081c4c-ac31-4242-9ae8-770f6342ac42 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:16:01.742598 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7081c4c-ac31-4242-9ae8-770f6342ac42 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:16:01.742926 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7081c4c-ac31-4242-9ae8-770f6342ac42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:16:01.744304 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7081c4c-ac31-4242-9ae8-770f6342ac42 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:16:01.751573 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 577/1166] 10.222.0.36 () {56 vars in 1115 bytes} [Mon Aug 29 22:16:01 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:16:03.666245 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca12dd-61cb-47f3-91d3-346fcd9eee23 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:16:03.667099 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca12dd-61cb-47f3-91d3-346fcd9eee23 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:16:03.667099 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca12dd-61cb-47f3-91d3-346fcd9eee23 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:16:03.669327 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 590/1167] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:16:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:16:03.674999 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7ebbb-6159-4a91-a344-09c763492632 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:16:03.675438 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7ebbb-6159-4a91-a344-09c763492632 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:16:03.675545 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7ebbb-6159-4a91-a344-09c763492632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:16:03.697654 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-d1d7ebbb-6159-4a91-a344-09c763492632 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:16:03.698847 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-d1d7ebbb-6159-4a91-a344-09c763492632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:16:03.749489 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:16:03.775830 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 578/1168] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:16:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:16:04.047604 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca12dd-61cb-47f3-91d3-346fcd9eee23 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:16:04.155540 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:16:04.167681 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca12dd-61cb-47f3-91d3-346fcd9eee23 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:16:04.204376 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e2f75-3b43-4558-aac4-29f3545c53e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:16:04.205032 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e2f75-3b43-4558-aac4-29f3545c53e1 None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:16:04.205306 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e2f75-3b43-4558-aac4-29f3545c53e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:16:04.205584 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e2f75-3b43-4558-aac4-29f3545c53e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:16:04.206247 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093e2f75-3b43-4558-aac4-29f3545c53e1 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:16:04.207619 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093e2f75-3b43-4558-aac4-29f3545c53e1 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:16:04.227007 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 591/1169] 10.222.0.36 () {60 vars in 1138 bytes} [Mon Aug 29 22:16:04 2022] POST /identity/v3/domains => generated 267 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:16:06.220910 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bce84-554b-49c5-ae6d-794388c79545 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:16:06.221493 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bce84-554b-49c5-ae6d-794388c79545 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:16:06.221493 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bce84-554b-49c5-ae6d-794388c79545 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:16:06.222721 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 579/1170] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:16:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:16:06.229388 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00926e22-b145-4809-9ac8-d7e9b0fc2727 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:16:06.230174 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00926e22-b145-4809-9ac8-d7e9b0fc2727 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:16:06.230338 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00926e22-b145-4809-9ac8-d7e9b0fc2727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:16:06.260070 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-00926e22-b145-4809-9ac8-d7e9b0fc2727 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:16:06.261328 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-00926e22-b145-4809-9ac8-d7e9b0fc2727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:16:06.336795 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 592/1171] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:16:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:16:06.596820 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8bce84-554b-49c5-ae6d-794388c79545 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:16:06.712680 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8bce84-554b-49c5-ae6d-794388c79545 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:16:06.757566 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6efd2c-7ada-49a3-b969-b83b39adfa59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:16:06.758396 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6efd2c-7ada-49a3-b969-b83b39adfa59 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:16:06.758656 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6efd2c-7ada-49a3-b969-b83b39adfa59 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:16:06.758930 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6efd2c-7ada-49a3-b969-b83b39adfa59 None admin] PATH_INFO: `/v3/domains/a95902b1f03d4e3480aed9c7b65f86d5` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:16:06.771193 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6efd2c-7ada-49a3-b969-b83b39adfa59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=a95902b1f03d4e3480aed9c7b65f86d5)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:16:06.772696 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6efd2c-7ada-49a3-b969-b83b39adfa59 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:16:06.774634 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 580/1172] 10.222.0.36 () {56 vars in 1183 bytes} [Mon Aug 29 22:16:06 2022] GET /identity/v3/domains/a95902b1f03d4e3480aed9c7b65f86d5 => generated 267 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:16:06.780896 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00926e22-b145-4809-9ac8-d7e9b0fc2727 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:16:06.867438 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:16:06.893997 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00926e22-b145-4809-9ac8-d7e9b0fc2727 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:16:06.932016 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e498b44-1ddc-474b-839d-49d954ff1823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:16:06.932653 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e498b44-1ddc-474b-839d-49d954ff1823 None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:16:06.932928 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e498b44-1ddc-474b-839d-49d954ff1823 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:16:06.933205 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e498b44-1ddc-474b-839d-49d954ff1823 None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:16:06.933853 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e498b44-1ddc-474b-839d-49d954ff1823 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:16:06.935345 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e498b44-1ddc-474b-839d-49d954ff1823 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:16:06.966701 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 593/1173] 10.222.0.36 () {60 vars in 1141 bytes} [Mon Aug 29 22:16:06 2022] POST /identity/v3/projects => generated 361 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:16:08.882508 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ca3ea-ce85-4e05-91fd-b64a344f3160 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:16:08.883082 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ca3ea-ce85-4e05-91fd-b64a344f3160 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:16:08.883082 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ca3ea-ce85-4e05-91fd-b64a344f3160 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:16:08.885026 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 581/1174] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:16:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:16:08.891655 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061cb3b1-b485-4d24-bb0f-9e5552f87c44 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:16:08.892139 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061cb3b1-b485-4d24-bb0f-9e5552f87c44 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:16:08.892241 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061cb3b1-b485-4d24-bb0f-9e5552f87c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:16:08.917785 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-061cb3b1-b485-4d24-bb0f-9e5552f87c44 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:16:08.918983 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-061cb3b1-b485-4d24-bb0f-9e5552f87c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:16:08.993179 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 594/1175] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:16:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:16:09.279872 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ca3ea-ce85-4e05-91fd-b64a344f3160 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:16:09.324363 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:16:09.396631 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ca3ea-ce85-4e05-91fd-b64a344f3160 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:16:09.433095 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf7918-5249-43b7-b89d-92b38a0f300a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:16:09.433733 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf7918-5249-43b7-b89d-92b38a0f300a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:16:09.434015 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf7918-5249-43b7-b89d-92b38a0f300a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:16:09.434291 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf7918-5249-43b7-b89d-92b38a0f300a None admin] PATH_INFO: `/v3/domains/a95902b1f03d4e3480aed9c7b65f86d5` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:16:09.435539 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaf7918-5249-43b7-b89d-92b38a0f300a None admin] RBAC: Authorizing `identity:get_domain(domain_id=a95902b1f03d4e3480aed9c7b65f86d5)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:16:09.437043 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaf7918-5249-43b7-b89d-92b38a0f300a None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:16:09.438626 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 582/1176] 10.222.0.36 () {56 vars in 1183 bytes} [Mon Aug 29 22:16:09 2022] GET /identity/v3/domains/a95902b1f03d4e3480aed9c7b65f86d5 => generated 267 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:16:09.448618 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061cb3b1-b485-4d24-bb0f-9e5552f87c44 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:16:09.521677 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:16:09.566165 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061cb3b1-b485-4d24-bb0f-9e5552f87c44 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:16:09.600293 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e954a3b5-68bb-4d85-9fef-a7461eeac576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:16:09.600934 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954a3b5-68bb-4d85-9fef-a7461eeac576 None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:16:09.601239 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954a3b5-68bb-4d85-9fef-a7461eeac576 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:16:09.601509 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954a3b5-68bb-4d85-9fef-a7461eeac576 None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:16:09.602157 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e954a3b5-68bb-4d85-9fef-a7461eeac576 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:16:09.603638 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e954a3b5-68bb-4d85-9fef-a7461eeac576 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:16:09.633036 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 595/1177] 10.222.0.36 () {60 vars in 1132 bytes} [Mon Aug 29 22:16:09 2022] POST /identity/v3/users => generated 311 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:16:11.565965 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db78bb-42f1-45d2-b627-8f114fddde7a None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:16:11.566810 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db78bb-42f1-45d2-b627-8f114fddde7a None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:16:11.566810 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db78bb-42f1-45d2-b627-8f114fddde7a None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:16:11.569052 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 583/1178] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:16:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:16:11.576058 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06cd1b-db7c-4578-8f25-39a148cfda6f None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:16:11.576534 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06cd1b-db7c-4578-8f25-39a148cfda6f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:16:11.576635 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06cd1b-db7c-4578-8f25-39a148cfda6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:16:11.596744 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-0a06cd1b-db7c-4578-8f25-39a148cfda6f None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:16:11.597917 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-0a06cd1b-db7c-4578-8f25-39a148cfda6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:16:11.683660 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 596/1179] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:16:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:16:11.968803 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6db78bb-42f1-45d2-b627-8f114fddde7a None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:16:12.087888 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6db78bb-42f1-45d2-b627-8f114fddde7a None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:16:12.090410 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:16:12.129762 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7479391-cefa-4ed8-a9eb-bca6642cfcfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:16:12.130435 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7479391-cefa-4ed8-a9eb-bca6642cfcfe None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:16:12.130711 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7479391-cefa-4ed8-a9eb-bca6642cfcfe None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:16:12.130978 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7479391-cefa-4ed8-a9eb-bca6642cfcfe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:16:12.142115 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7479391-cefa-4ed8-a9eb-bca6642cfcfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:16:12.146938 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-d7479391-cefa-4ed8-a9eb-bca6642cfcfe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:16:12.146938 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:16:12.146938 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:16:12.146938 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:16:12.146938 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:16:12.146938 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:16:12.146938 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:16:12.146938 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:16:12.146938 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:16:12.146938 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:16:12.146938 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:16:12.146938 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:16:12.146938 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:16:12.146938 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:16:12.146938 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:16:12.146938 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:16:12.148740 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:16:12.148740 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:16:12.148740 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:16:12.148740 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:16:12.148740 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:16:12.148740 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:16:12.148740 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:16:12.148740 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:16:12.148740 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:16:12.148740 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:16:12.148740 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:16:12.148740 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:16:12.148740 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:16:12.148740 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:16:12.148740 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:16:12.148740 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:16:12.149981 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:16:12.149981 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:16:12.149981 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:16:12.149981 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:16:12.149981 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:16:12.149981 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:16:12.149981 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:16:12.149981 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:16:12.149981 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:16:12.149981 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:16:12.149981 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:16:12.149981 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:16:12.149981 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 584/1180] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Aug 29 22:16:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:16:12.156797 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a06cd1b-db7c-4578-8f25-39a148cfda6f None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:16:12.212191 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:16:12.268058 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a06cd1b-db7c-4578-8f25-39a148cfda6f None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:16:12.304490 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259884a2-0e60-45fe-adf6-f4f49602ab3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:16:12.305267 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259884a2-0e60-45fe-adf6-f4f49602ab3f None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:16:12.305407 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259884a2-0e60-45fe-adf6-f4f49602ab3f None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:16:12.305697 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259884a2-0e60-45fe-adf6-f4f49602ab3f None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:16:12.306455 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259884a2-0e60-45fe-adf6-f4f49602ab3f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:16:12.306779 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259884a2-0e60-45fe-adf6-f4f49602ab3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:16:12.308153 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259884a2-0e60-45fe-adf6-f4f49602ab3f None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:16:12.316848 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 597/1181] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:16:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:16:12.323179 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7479391-cefa-4ed8-a9eb-bca6642cfcfe None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:16:12.433902 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7479391-cefa-4ed8-a9eb-bca6642cfcfe None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:16:12.469742 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1441cc5e-1ef9-4860-9d92-09091880928c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:16:12.470375 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441cc5e-1ef9-4860-9d92-09091880928c None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:16:12.470655 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441cc5e-1ef9-4860-9d92-09091880928c None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:16:12.470940 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441cc5e-1ef9-4860-9d92-09091880928c None admin] PATH_INFO: `/v3/users/f97cf19346c5400da460321bab513cbe` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:16:12.486458 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1441cc5e-1ef9-4860-9d92-09091880928c None admin] RBAC: Authorizing `identity:get_user(user_id=f97cf19346c5400da460321bab513cbe)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:16:12.487973 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1441cc5e-1ef9-4860-9d92-09091880928c None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:16:12.489603 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 585/1182] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Aug 29 22:16:12 2022] GET /identity/v3/users/f97cf19346c5400da460321bab513cbe => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:16:12.496165 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259884a2-0e60-45fe-adf6-f4f49602ab3f None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:16:12.605124 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259884a2-0e60-45fe-adf6-f4f49602ab3f None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:16:12.615112 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:16:12.642622 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f8fc0a-edac-4637-8afb-07a6c24047fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:16:12.643272 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8fc0a-edac-4637-8afb-07a6c24047fd None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:16:12.643547 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8fc0a-edac-4637-8afb-07a6c24047fd None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:16:12.643816 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8fc0a-edac-4637-8afb-07a6c24047fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:16:12.719547 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f8fc0a-edac-4637-8afb-07a6c24047fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:16:12.720994 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f8fc0a-edac-4637-8afb-07a6c24047fd None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:16:12.828927 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 598/1183] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:16:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:16:12.836179 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1441cc5e-1ef9-4860-9d92-09091880928c None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:16:12.865091 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:16:12.950348 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1441cc5e-1ef9-4860-9d92-09091880928c None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:16:12.985836 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025cc9a1-7254-4a4d-8130-0a0c15790f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:16:12.986413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025cc9a1-7254-4a4d-8130-0a0c15790f54 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:16:12.986681 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025cc9a1-7254-4a4d-8130-0a0c15790f54 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:16:12.986950 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025cc9a1-7254-4a4d-8130-0a0c15790f54 None admin] PATH_INFO: `/v3/projects/b5c2bf94823d4c4f84d58c89c3f21c3e` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:16:12.988163 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025cc9a1-7254-4a4d-8130-0a0c15790f54 None admin] RBAC: Authorizing `identity:get_project(project_id=b5c2bf94823d4c4f84d58c89c3f21c3e)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:16:12.989623 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025cc9a1-7254-4a4d-8130-0a0c15790f54 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:16:12.991236 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 586/1184] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Aug 29 22:16:12 2022] GET /identity/v3/projects/b5c2bf94823d4c4f84d58c89c3f21c3e => generated 361 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:16:13.000431 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f8fc0a-edac-4637-8afb-07a6c24047fd None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:16:13.012741 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:16:13.110014 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f8fc0a-edac-4637-8afb-07a6c24047fd None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:16:13.146600 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b349d540-06d2-4fd4-9485-bb9da2569752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:16:13.147206 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349d540-06d2-4fd4-9485-bb9da2569752 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:16:13.147490 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349d540-06d2-4fd4-9485-bb9da2569752 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:16:13.147759 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349d540-06d2-4fd4-9485-bb9da2569752 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:16:13.148508 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b349d540-06d2-4fd4-9485-bb9da2569752 None admin] RBAC: Adding query filter params (role.id=ff59a239a50b4bd899a83bf3c3fd1f63, scope.project.id=b5c2bf94823d4c4f84d58c89c3f21c3e, user.id=f97cf19346c5400da460321bab513cbe) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:16:13.148825 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b349d540-06d2-4fd4-9485-bb9da2569752 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:16:13.150803 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b349d540-06d2-4fd4-9485-bb9da2569752 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:16:13.165167 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 599/1185] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Aug 29 22:16:12 2022] GET /identity/v3/role_assignments?user.id=f97cf19346c5400da460321bab513cbe&scope.project.id=b5c2bf94823d4c4f84d58c89c3f21c3e&role.id=ff59a239a50b4bd899a83bf3c3fd1f63 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:16:15.037996 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4776458d-d12a-4b7b-a05b-64fd18784530 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:16:15.038569 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4776458d-d12a-4b7b-a05b-64fd18784530 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:16:15.038569 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4776458d-d12a-4b7b-a05b-64fd18784530 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:16:15.040937 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 587/1186] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:16:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:16:15.047784 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40419abf-b21f-48b2-b72e-c143fe52b945 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:16:15.048245 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40419abf-b21f-48b2-b72e-c143fe52b945 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:16:15.048339 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40419abf-b21f-48b2-b72e-c143fe52b945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:16:15.075728 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-40419abf-b21f-48b2-b72e-c143fe52b945 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:16:15.076977 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-40419abf-b21f-48b2-b72e-c143fe52b945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:16:15.147220 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 600/1187] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:16:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:16:15.419758 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4776458d-d12a-4b7b-a05b-64fd18784530 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:16:15.529466 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:16:15.541876 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4776458d-d12a-4b7b-a05b-64fd18784530 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:16:15.581670 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb695c75-a87a-47fc-a95d-2ed8d983f3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:16:15.582317 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb695c75-a87a-47fc-a95d-2ed8d983f3c4 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:16:15.582596 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb695c75-a87a-47fc-a95d-2ed8d983f3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:16:15.582869 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb695c75-a87a-47fc-a95d-2ed8d983f3c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:16:15.594681 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb695c75-a87a-47fc-a95d-2ed8d983f3c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:16:15.599532 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-eb695c75-a87a-47fc-a95d-2ed8d983f3c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:16:15.599532 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:16:15.599532 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:16:15.599532 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:16:15.599532 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:16:15.599532 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:16:15.599532 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:16:15.599532 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:16:15.599532 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:16:15.599532 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:16:15.599532 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:16:15.599532 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:16:15.599532 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:16:15.599532 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:16:15.599532 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:16:15.599532 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:16:15.600633 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:16:15.600633 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:16:15.600633 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:16:15.600633 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:16:15.600633 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:16:15.600633 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:16:15.600633 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:16:15.600633 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:16:15.600633 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:16:15.600633 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:16:15.600633 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:16:15.600633 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:16:15.600633 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:16:15.600633 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:16:15.600633 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:16:15.600633 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:16:15.601941 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:16:15.601941 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:16:15.601941 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:16:15.601941 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:16:15.601941 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:16:15.601941 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:16:15.601941 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:16:15.601941 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:16:15.601941 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:16:15.601941 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:16:15.601941 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:16:15.601941 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:16:15.601941 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 588/1188] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Aug 29 22:16:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:16:15.607966 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40419abf-b21f-48b2-b72e-c143fe52b945 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:16:15.612982 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:16:15.759410 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40419abf-b21f-48b2-b72e-c143fe52b945 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:16:15.798946 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14484a-413d-42ad-9e3e-ac60e2079ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:16:15.799554 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14484a-413d-42ad-9e3e-ac60e2079ec6 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:16:15.799830 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14484a-413d-42ad-9e3e-ac60e2079ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:16:15.800108 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14484a-413d-42ad-9e3e-ac60e2079ec6 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:16:15.800816 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a14484a-413d-42ad-9e3e-ac60e2079ec6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:16:15.801149 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a14484a-413d-42ad-9e3e-ac60e2079ec6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:16:15.802550 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a14484a-413d-42ad-9e3e-ac60e2079ec6 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:16:15.810902 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 601/1189] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:16:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:16:15.817075 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb695c75-a87a-47fc-a95d-2ed8d983f3c4 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:16:15.933735 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb695c75-a87a-47fc-a95d-2ed8d983f3c4 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:16:15.973458 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e60b1-f894-4bfd-9d57-c75728a0f021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:16:15.974500 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e60b1-f894-4bfd-9d57-c75728a0f021 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:16:15.974963 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e60b1-f894-4bfd-9d57-c75728a0f021 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:16:15.975441 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e60b1-f894-4bfd-9d57-c75728a0f021 None admin] PATH_INFO: `/v3/users/f97cf19346c5400da460321bab513cbe` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:16:15.977490 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1e60b1-f894-4bfd-9d57-c75728a0f021 None admin] RBAC: Authorizing `identity:get_user(user_id=f97cf19346c5400da460321bab513cbe)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:16:15.980255 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1e60b1-f894-4bfd-9d57-c75728a0f021 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:16:15.983071 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 589/1190] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Aug 29 22:16:15 2022] GET /identity/v3/users/f97cf19346c5400da460321bab513cbe => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:16:15.991664 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14484a-413d-42ad-9e3e-ac60e2079ec6 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:16:16.062702 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:16:16.098448 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14484a-413d-42ad-9e3e-ac60e2079ec6 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:16:16.132822 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a6f47-846b-4e70-b7e7-2a088ebd1b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:16:16.133480 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a6f47-846b-4e70-b7e7-2a088ebd1b13 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:16:16.133763 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a6f47-846b-4e70-b7e7-2a088ebd1b13 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:16:16.134029 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a6f47-846b-4e70-b7e7-2a088ebd1b13 None admin] PATH_INFO: `/v3/projects/b5c2bf94823d4c4f84d58c89c3f21c3e` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:16:16.135469 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54a6f47-846b-4e70-b7e7-2a088ebd1b13 None admin] RBAC: Authorizing `identity:get_project(project_id=b5c2bf94823d4c4f84d58c89c3f21c3e)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:16:16.136927 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54a6f47-846b-4e70-b7e7-2a088ebd1b13 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:16:16.138560 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 602/1191] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Aug 29 22:16:15 2022] GET /identity/v3/projects/b5c2bf94823d4c4f84d58c89c3f21c3e => generated 361 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:16:16.147881 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e60b1-f894-4bfd-9d57-c75728a0f021 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:16:16.169095 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:16:16.252051 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e60b1-f894-4bfd-9d57-c75728a0f021 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:16:16.293205 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda2b08-09b3-41d3-b3b8-a16c1e69a690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:16:16.293912 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda2b08-09b3-41d3-b3b8-a16c1e69a690 None admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:16:16.294197 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda2b08-09b3-41d3-b3b8-a16c1e69a690 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:16:16.294421 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda2b08-09b3-41d3-b3b8-a16c1e69a690 None admin] PATH_INFO: `/v3/projects/b5c2bf94823d4c4f84d58c89c3f21c3e/users/f97cf19346c5400da460321bab513cbe/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:16:16.296361 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccda2b08-09b3-41d3-b3b8-a16c1e69a690 None admin] RBAC: Authorizing `identity:create_grant(project_id=b5c2bf94823d4c4f84d58c89c3f21c3e, user_id=f97cf19346c5400da460321bab513cbe, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:16:16.297852 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccda2b08-09b3-41d3-b3b8-a16c1e69a690 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:16:16.318536 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 590/1192] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Aug 29 22:16:16 2022] PUT /identity/v3/projects/b5c2bf94823d4c4f84d58c89c3f21c3e/users/f97cf19346c5400da460321bab513cbe/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:16:18.213104 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce753d-1dc4-43cd-b7c7-0c8b61e971ea None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:16:18.213924 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce753d-1dc4-43cd-b7c7-0c8b61e971ea None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:16:18.213924 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce753d-1dc4-43cd-b7c7-0c8b61e971ea None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:16:18.216018 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 603/1193] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:16:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:16:18.221739 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c4895-2b20-43d5-ab78-12500e49028b None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:16:18.222175 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c4895-2b20-43d5-ab78-12500e49028b None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:16:18.222273 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c4895-2b20-43d5-ab78-12500e49028b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:16:18.243038 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-6d9c4895-2b20-43d5-ab78-12500e49028b None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:16:18.244801 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-6d9c4895-2b20-43d5-ab78-12500e49028b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:16:18.325369 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 591/1194] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:16:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:16:18.590854 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce753d-1dc4-43cd-b7c7-0c8b61e971ea None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:16:18.712130 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce753d-1dc4-43cd-b7c7-0c8b61e971ea None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:16:18.747729 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19b617e-e7b6-4ea1-bae6-fd1adbbf9707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:16:18.748354 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b617e-e7b6-4ea1-bae6-fd1adbbf9707 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:16:18.748662 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b617e-e7b6-4ea1-bae6-fd1adbbf9707 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:16:18.748932 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b617e-e7b6-4ea1-bae6-fd1adbbf9707 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:16:18.750907 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:16:18.761893 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19b617e-e7b6-4ea1-bae6-fd1adbbf9707 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:16:18.767069 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-d19b617e-e7b6-4ea1-bae6-fd1adbbf9707 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:16:18.767069 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:16:18.767069 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:16:18.767069 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:16:18.767069 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:16:18.767069 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:16:18.767069 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:16:18.767069 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:16:18.767069 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:16:18.767069 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:16:18.767069 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:16:18.767069 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:16:18.767069 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:16:18.767069 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:16:18.767069 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:16:18.767069 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:16:18.768159 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:16:18.768159 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:16:18.768159 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:16:18.768159 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:16:18.768159 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:16:18.768159 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:16:18.768159 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:16:18.768159 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:16:18.768159 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:16:18.768159 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:16:18.768159 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:16:18.768159 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:16:18.768159 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:16:18.768159 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:16:18.768159 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:16:18.768159 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:16:18.769116 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:16:18.769116 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:16:18.769116 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:16:18.769116 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:16:18.769116 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:16:18.769116 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:16:18.769116 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:16:18.769116 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:16:18.769116 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:16:18.769116 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:16:18.769116 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:16:18.769116 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:16:18.769116 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 604/1195] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Aug 29 22:16:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:16:18.775556 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9c4895-2b20-43d5-ab78-12500e49028b None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:16:18.791788 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:16:18.906522 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9c4895-2b20-43d5-ab78-12500e49028b None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:16:18.946149 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7c24b-4a30-4ba4-b087-340ad2f81350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:16:18.946757 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7c24b-4a30-4ba4-b087-340ad2f81350 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:16:18.947121 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7c24b-4a30-4ba4-b087-340ad2f81350 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:16:18.947398 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7c24b-4a30-4ba4-b087-340ad2f81350 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:16:18.948068 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7c24b-4a30-4ba4-b087-340ad2f81350 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:16:18.948374 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7c24b-4a30-4ba4-b087-340ad2f81350 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:16:18.949766 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7c24b-4a30-4ba4-b087-340ad2f81350 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:16:18.959594 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 592/1196] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:16:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:16:18.966998 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19b617e-e7b6-4ea1-bae6-fd1adbbf9707 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:16:19.077735 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19b617e-e7b6-4ea1-bae6-fd1adbbf9707 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:16:19.113257 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a57a5a-b94a-4e8d-89ff-589d9372e004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:16:19.113890 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a57a5a-b94a-4e8d-89ff-589d9372e004 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:16:19.114172 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a57a5a-b94a-4e8d-89ff-589d9372e004 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:16:19.114478 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a57a5a-b94a-4e8d-89ff-589d9372e004 None admin] PATH_INFO: `/v3/users/f97cf19346c5400da460321bab513cbe` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:16:19.115756 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a57a5a-b94a-4e8d-89ff-589d9372e004 None admin] RBAC: Authorizing `identity:get_user(user_id=f97cf19346c5400da460321bab513cbe)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:16:19.117228 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a57a5a-b94a-4e8d-89ff-589d9372e004 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:16:19.118911 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 605/1197] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Aug 29 22:16:18 2022] GET /identity/v3/users/f97cf19346c5400da460321bab513cbe => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:16:19.128173 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7c24b-4a30-4ba4-b087-340ad2f81350 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:16:19.209771 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:16:19.244035 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7c24b-4a30-4ba4-b087-340ad2f81350 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:16:19.286353 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0938ca92-0b44-4583-bd58-04fac0399338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:16:19.287244 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938ca92-0b44-4583-bd58-04fac0399338 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:16:19.287686 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938ca92-0b44-4583-bd58-04fac0399338 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:16:19.288070 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938ca92-0b44-4583-bd58-04fac0399338 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:16:19.367276 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0938ca92-0b44-4583-bd58-04fac0399338 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:16:19.368940 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0938ca92-0b44-4583-bd58-04fac0399338 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:16:19.439202 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:16:19.474298 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 593/1198] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:16:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:16:19.480416 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a57a5a-b94a-4e8d-89ff-589d9372e004 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:16:19.546197 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:16:19.589767 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a57a5a-b94a-4e8d-89ff-589d9372e004 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:16:19.625998 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71cf5ff-7c15-4b11-a170-410115fe53f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:16:19.626620 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71cf5ff-7c15-4b11-a170-410115fe53f5 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:16:19.626896 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71cf5ff-7c15-4b11-a170-410115fe53f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:16:19.627171 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71cf5ff-7c15-4b11-a170-410115fe53f5 None admin] PATH_INFO: `/v3/projects/b5c2bf94823d4c4f84d58c89c3f21c3e` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:16:19.628416 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71cf5ff-7c15-4b11-a170-410115fe53f5 None admin] RBAC: Authorizing `identity:get_project(project_id=b5c2bf94823d4c4f84d58c89c3f21c3e)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:16:19.629931 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71cf5ff-7c15-4b11-a170-410115fe53f5 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:16:19.631572 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 606/1199] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Aug 29 22:16:19 2022] GET /identity/v3/projects/b5c2bf94823d4c4f84d58c89c3f21c3e => generated 361 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:16:19.638284 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0938ca92-0b44-4583-bd58-04fac0399338 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:16:19.762924 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0938ca92-0b44-4583-bd58-04fac0399338 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:16:19.799986 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39813b90-104e-4562-b4e2-89159c70f6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:16:19.800611 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39813b90-104e-4562-b4e2-89159c70f6fa None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:16:19.800895 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39813b90-104e-4562-b4e2-89159c70f6fa None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:16:19.801167 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39813b90-104e-4562-b4e2-89159c70f6fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:16:19.801887 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39813b90-104e-4562-b4e2-89159c70f6fa None admin] RBAC: Adding query filter params (role.id=ff59a239a50b4bd899a83bf3c3fd1f63, scope.project.id=b5c2bf94823d4c4f84d58c89c3f21c3e, user.id=f97cf19346c5400da460321bab513cbe) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:16:19.802203 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39813b90-104e-4562-b4e2-89159c70f6fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:16:19.803621 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39813b90-104e-4562-b4e2-89159c70f6fa None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:16:19.810204 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 594/1200] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Aug 29 22:16:19 2022] GET /identity/v3/role_assignments?user.id=f97cf19346c5400da460321bab513cbe&scope.project.id=b5c2bf94823d4c4f84d58c89c3f21c3e&role.id=ff59a239a50b4bd899a83bf3c3fd1f63 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:16:29.621460 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=35 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:16:29.807237 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=83 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:16.232866 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f71c6c-7e49-4dce-b7f0-708aaccdf968 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:16.232866 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f71c6c-7e49-4dce-b7f0-708aaccdf968 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:16.232866 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f71c6c-7e49-4dce-b7f0-708aaccdf968 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:16.232866 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 607/1201] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:17:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:17:16.238555 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826c204-f87c-4c47-ab56-914275b54e85 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:16.239137 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826c204-f87c-4c47-ab56-914275b54e85 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:16.239137 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826c204-f87c-4c47-ab56-914275b54e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:16.259788 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-c826c204-f87c-4c47-ab56-914275b54e85 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:17:16.261083 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c826c204-f87c-4c47-ab56-914275b54e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:17:16.368518 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 595/1202] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:17:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:17:16.710244 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f71c6c-7e49-4dce-b7f0-708aaccdf968 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:16.875624 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f71c6c-7e49-4dce-b7f0-708aaccdf968 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:16.939418 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e406ef0-3833-43f4-85e2-8ef20e4843ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:16.940085 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e406ef0-3833-43f4-85e2-8ef20e4843ce None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:16.940537 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e406ef0-3833-43f4-85e2-8ef20e4843ce None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:16.940700 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e406ef0-3833-43f4-85e2-8ef20e4843ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:16.952564 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e406ef0-3833-43f4-85e2-8ef20e4843ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:16.954093 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e406ef0-3833-43f4-85e2-8ef20e4843ce None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:16.969803 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-8e406ef0-3833-43f4-85e2-8ef20e4843ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:17:16.969803 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:17:16.969803 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:17:16.969803 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:17:16.969803 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:17:16.969803 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:17:16.969803 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:17:16.969803 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:17:16.969803 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:17:16.969803 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:17:16.969803 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:17:16.969803 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:17:16.969803 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:17:16.969803 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:17:16.969803 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:17:16.969803 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:17:16.973175 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:17:16.973175 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:17:16.973175 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:17:16.973175 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:17:16.973175 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:17:16.973175 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:17:16.973175 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:17:16.973175 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:17:16.973175 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:17:16.973175 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:17:16.973175 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:17:16.973175 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:17:16.973175 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:17:16.973175 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:17:16.973175 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:17:16.973175 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:17:16.973175 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:17:16.974374 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:17:16.974374 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:17:16.974374 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:17:16.974374 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 608/1203] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:17:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:17:16.977687 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826c204-f87c-4c47-ab56-914275b54e85 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:17.095777 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826c204-f87c-4c47-ab56-914275b54e85 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:17.136353 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:17.146291 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b6845-ae36-43fa-ac9b-617b7feacbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:17.147074 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b6845-ae36-43fa-ac9b-617b7feacbea None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:17.147721 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b6845-ae36-43fa-ac9b-617b7feacbea None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:17.148225 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b6845-ae36-43fa-ac9b-617b7feacbea None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:17.149120 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85b6845-ae36-43fa-ac9b-617b7feacbea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:17:17.149840 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85b6845-ae36-43fa-ac9b-617b7feacbea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:17.151928 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85b6845-ae36-43fa-ac9b-617b7feacbea None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:17.168422 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 596/1204] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:17:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:17:17.174346 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e406ef0-3833-43f4-85e2-8ef20e4843ce None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:17.244789 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:17.301196 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e406ef0-3833-43f4-85e2-8ef20e4843ce None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:17.346350 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc4ffa-43c8-40bc-ab0a-8fcc956c9af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:17.346951 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc4ffa-43c8-40bc-ab0a-8fcc956c9af2 None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:17.347337 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc4ffa-43c8-40bc-ab0a-8fcc956c9af2 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:17.347501 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc4ffa-43c8-40bc-ab0a-8fcc956c9af2 None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:17.348174 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dc4ffa-43c8-40bc-ab0a-8fcc956c9af2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:17.349632 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dc4ffa-43c8-40bc-ab0a-8fcc956c9af2 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:17.380640 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 609/1205] 10.222.0.36 () {60 vars in 1132 bytes} [Mon Aug 29 22:17:17 2022] POST /identity/v3/users => generated 251 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:17:19.621316 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d80e8b-8284-4835-8652-6a01ae7807c6 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:19.621932 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d80e8b-8284-4835-8652-6a01ae7807c6 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:19.622023 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d80e8b-8284-4835-8652-6a01ae7807c6 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:19.623589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 597/1206] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:17:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:17:19.629656 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71179b3e-2eaf-48a6-925b-2fb9dcd82435 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:19.630139 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71179b3e-2eaf-48a6-925b-2fb9dcd82435 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:19.630275 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71179b3e-2eaf-48a6-925b-2fb9dcd82435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:19.651955 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-71179b3e-2eaf-48a6-925b-2fb9dcd82435 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:17:19.653354 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-71179b3e-2eaf-48a6-925b-2fb9dcd82435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:17:19.735162 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 610/1207] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:17:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:17:20.026579 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d80e8b-8284-4835-8652-6a01ae7807c6 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:20.152190 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d80e8b-8284-4835-8652-6a01ae7807c6 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:20.192067 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6563d4f-c80d-402a-a3c7-ebb7eaba762e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:20.192742 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6563d4f-c80d-402a-a3c7-ebb7eaba762e None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:20.193035 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6563d4f-c80d-402a-a3c7-ebb7eaba762e None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:20.193263 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6563d4f-c80d-402a-a3c7-ebb7eaba762e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:20.205644 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6563d4f-c80d-402a-a3c7-ebb7eaba762e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:17:20.211596 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-d6563d4f-c80d-402a-a3c7-ebb7eaba762e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:17:20.211596 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:17:20.211596 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:17:20.211596 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:17:20.211596 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:17:20.211596 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:17:20.211596 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:17:20.211596 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:17:20.211596 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:17:20.211596 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:17:20.211596 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:17:20.211596 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:17:20.211596 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:17:20.211596 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:17:20.211596 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:17:20.211596 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:17:20.212814 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:17:20.212814 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:17:20.212814 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:17:20.212814 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:17:20.212814 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:17:20.212814 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:17:20.212814 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:17:20.212814 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:17:20.212814 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:17:20.212814 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:17:20.212814 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:17:20.212814 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:17:20.212814 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:17:20.212814 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:17:20.212814 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:17:20.212814 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:17:20.214002 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:17:20.214002 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:17:20.214002 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:17:20.214002 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:17:20.214002 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:17:20.214002 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:17:20.214002 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:17:20.214002 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:17:20.214002 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:17:20.214002 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:17:20.214002 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:17:20.214002 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:17:20.214002 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 598/1208] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Aug 29 22:17:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:17:20.220562 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71179b3e-2eaf-48a6-925b-2fb9dcd82435 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:20.268494 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:20.348054 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71179b3e-2eaf-48a6-925b-2fb9dcd82435 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:20.391417 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035bb56d-767f-42a0-b979-e63f27820fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:20.392273 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035bb56d-767f-42a0-b979-e63f27820fb4 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:20.392661 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035bb56d-767f-42a0-b979-e63f27820fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:20.393060 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035bb56d-767f-42a0-b979-e63f27820fb4 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:20.394046 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035bb56d-767f-42a0-b979-e63f27820fb4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:17:20.394278 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035bb56d-767f-42a0-b979-e63f27820fb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:20.395805 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035bb56d-767f-42a0-b979-e63f27820fb4 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:20.408557 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 611/1209] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Aug 29 22:17:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:17:20.414794 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6563d4f-c80d-402a-a3c7-ebb7eaba762e None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:20.484879 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:20.543653 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6563d4f-c80d-402a-a3c7-ebb7eaba762e None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:20.582409 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a444d-e17b-4a60-b448-bcdd49503f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:20.583099 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a444d-e17b-4a60-b448-bcdd49503f36 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:20.583371 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a444d-e17b-4a60-b448-bcdd49503f36 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:20.583648 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a444d-e17b-4a60-b448-bcdd49503f36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:20.598219 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a444d-e17b-4a60-b448-bcdd49503f36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:20.599871 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a444d-e17b-4a60-b448-bcdd49503f36 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:20.619187 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-049a444d-e17b-4a60-b448-bcdd49503f36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:17:20.619187 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:17:20.619187 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:17:20.619187 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:17:20.619187 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:17:20.619187 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:17:20.619187 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:17:20.619187 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:17:20.619187 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:17:20.619187 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:17:20.619187 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:17:20.619187 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:17:20.619187 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:17:20.619187 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:17:20.619187 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:17:20.619187 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:17:20.620589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:17:20.620589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:17:20.620589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:17:20.620589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:17:20.620589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:17:20.620589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:17:20.620589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:17:20.620589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:17:20.620589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:17:20.620589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:17:20.620589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:17:20.620589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:17:20.620589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:17:20.620589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:17:20.620589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:17:20.620589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:17:20.620589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:17:20.622643 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:17:20.622643 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:17:20.622643 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:17:20.622643 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 599/1210] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:17:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:17:20.629625 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035bb56d-767f-42a0-b979-e63f27820fb4 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:20.756707 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:20.761327 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035bb56d-767f-42a0-b979-e63f27820fb4 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:20.812632 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfacac7d-6210-4afa-b424-136804a66ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:20.813454 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfacac7d-6210-4afa-b424-136804a66ead None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:20.813797 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfacac7d-6210-4afa-b424-136804a66ead None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:20.814128 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfacac7d-6210-4afa-b424-136804a66ead None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:20.815009 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfacac7d-6210-4afa-b424-136804a66ead None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:17:20.815377 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfacac7d-6210-4afa-b424-136804a66ead None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:20.817509 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfacac7d-6210-4afa-b424-136804a66ead None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:20.832995 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 612/1211] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:17:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:17:20.839043 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a444d-e17b-4a60-b448-bcdd49503f36 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:20.977449 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a444d-e17b-4a60-b448-bcdd49503f36 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:20.979507 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:21.022654 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26954f81-f4b1-4691-81d1-9744353d3928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:21.023299 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26954f81-f4b1-4691-81d1-9744353d3928 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:21.023727 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26954f81-f4b1-4691-81d1-9744353d3928 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:21.024061 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26954f81-f4b1-4691-81d1-9744353d3928 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:21.033869 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26954f81-f4b1-4691-81d1-9744353d3928 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:21.035096 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26954f81-f4b1-4691-81d1-9744353d3928 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:21.048995 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-26954f81-f4b1-4691-81d1-9744353d3928 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 22:17:21.048995 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:17:21.048995 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:17:21.048995 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:17:21.048995 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:17:21.048995 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:17:21.048995 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:17:21.048995 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:17:21.048995 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:17:21.048995 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:17:21.048995 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:17:21.048995 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:17:21.048995 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:17:21.048995 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:17:21.048995 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:17:21.048995 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:17:21.050094 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:17:21.050094 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:17:21.050094 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:17:21.050094 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:17:21.050094 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:17:21.050094 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:17:21.050094 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:17:21.050094 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:17:21.050094 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:17:21.050094 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:17:21.050094 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:17:21.050094 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:17:21.050094 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:17:21.050094 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:17:21.050094 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:17:21.050094 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:17:21.050094 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:17:21.050094 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:17:21.051102 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:17:21.051102 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:17:21.051102 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:17:21.051102 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:17:21.051102 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:17:21.051102 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:17:21.051102 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:17:21.051102 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:17:21.051102 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 22:17:21.051102 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:17:21.051102 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 600/1212] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:17:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:17:21.056723 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfacac7d-6210-4afa-b424-136804a66ead None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:21.232418 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfacac7d-6210-4afa-b424-136804a66ead None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:21.275035 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e6f5c2-2326-4564-bf78-619c5f028360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:21.275935 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e6f5c2-2326-4564-bf78-619c5f028360 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:21.276225 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e6f5c2-2326-4564-bf78-619c5f028360 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:21.276508 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e6f5c2-2326-4564-bf78-619c5f028360 None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:21.277402 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e6f5c2-2326-4564-bf78-619c5f028360 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:17:21.277708 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e6f5c2-2326-4564-bf78-619c5f028360 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:21.279141 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e6f5c2-2326-4564-bf78-619c5f028360 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:21.299503 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 613/1213] 10.222.0.36 () {56 vars in 1143 bytes} [Mon Aug 29 22:17:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:17:21.307210 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26954f81-f4b1-4691-81d1-9744353d3928 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:21.448295 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26954f81-f4b1-4691-81d1-9744353d3928 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:21.501360 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee66b4-f78b-473a-8463-afae04ccb71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:21.502365 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee66b4-f78b-473a-8463-afae04ccb71d None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:21.502909 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee66b4-f78b-473a-8463-afae04ccb71d None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:21.503355 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee66b4-f78b-473a-8463-afae04ccb71d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:21.542070 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:21.591111 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ee66b4-f78b-473a-8463-afae04ccb71d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:21.592690 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ee66b4-f78b-473a-8463-afae04ccb71d None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:21.707710 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 601/1214] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:17:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:17:21.714457 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e6f5c2-2326-4564-bf78-619c5f028360 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:21.736295 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:21.831175 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e6f5c2-2326-4564-bf78-619c5f028360 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:21.868893 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68545c-3a01-4e07-9d7e-1192f39b10bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:21.870287 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68545c-3a01-4e07-9d7e-1192f39b10bf None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:21.870287 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68545c-3a01-4e07-9d7e-1192f39b10bf None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:21.870287 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68545c-3a01-4e07-9d7e-1192f39b10bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:21.880824 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a68545c-3a01-4e07-9d7e-1192f39b10bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:21.882314 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a68545c-3a01-4e07-9d7e-1192f39b10bf None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:21.902755 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-9a68545c-3a01-4e07-9d7e-1192f39b10bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:17:21.902755 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:17:21.902755 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:17:21.902755 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:17:21.902755 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:17:21.902755 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:17:21.902755 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:17:21.902755 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:17:21.902755 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:17:21.902755 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:17:21.902755 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:17:21.902755 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:17:21.902755 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:17:21.902755 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:17:21.902755 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:17:21.902755 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:17:21.904080 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:17:21.904080 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:17:21.904080 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:17:21.904080 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:17:21.904080 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:17:21.904080 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:17:21.904080 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:17:21.904080 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:17:21.904080 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:17:21.904080 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:17:21.904080 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:17:21.904080 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:17:21.904080 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:17:21.904080 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:17:21.904080 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:17:21.904080 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:17:21.904080 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:17:21.905073 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:17:21.905073 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:17:21.905073 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:17:21.905073 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 614/1215] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:17:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:17:21.910068 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee66b4-f78b-473a-8463-afae04ccb71d None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:21.974419 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:22.023872 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee66b4-f78b-473a-8463-afae04ccb71d None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:22.064761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce497dfc-f6c3-44d1-addc-eb41c36b69cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:22.065670 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce497dfc-f6c3-44d1-addc-eb41c36b69cb None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:22.065840 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce497dfc-f6c3-44d1-addc-eb41c36b69cb None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:22.066134 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce497dfc-f6c3-44d1-addc-eb41c36b69cb None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:22.066779 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce497dfc-f6c3-44d1-addc-eb41c36b69cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:17:22.067079 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce497dfc-f6c3-44d1-addc-eb41c36b69cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:22.068674 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce497dfc-f6c3-44d1-addc-eb41c36b69cb None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:22.084215 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 602/1216] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:17:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:17:22.090200 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68545c-3a01-4e07-9d7e-1192f39b10bf None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:22.173186 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:22.215584 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68545c-3a01-4e07-9d7e-1192f39b10bf None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:22.263365 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f59e27-6522-460f-8ab7-b14db07aeb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:22.264208 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f59e27-6522-460f-8ab7-b14db07aeb82 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:22.264616 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f59e27-6522-460f-8ab7-b14db07aeb82 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:22.265009 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f59e27-6522-460f-8ab7-b14db07aeb82 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:22.273361 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f59e27-6522-460f-8ab7-b14db07aeb82 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:22.275383 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f59e27-6522-460f-8ab7-b14db07aeb82 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:22.289311 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-35f59e27-6522-460f-8ab7-b14db07aeb82 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:17:22.289311 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:17:22.289311 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:17:22.289311 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:17:22.289311 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:17:22.289311 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:17:22.289311 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:17:22.289311 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:17:22.289311 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:17:22.289311 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:17:22.289311 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:17:22.289311 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:17:22.289311 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:17:22.289311 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:17:22.289311 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:17:22.290491 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:17:22.290491 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:17:22.290491 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:17:22.290491 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:17:22.290491 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:17:22.290491 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:17:22.290491 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:17:22.290491 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:17:22.290491 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:17:22.290491 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:17:22.290491 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:17:22.290491 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:17:22.290491 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:17:22.290491 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:17:22.290491 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:17:22.290491 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:17:22.290491 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:17:22.291549 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:17:22.291549 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:17:22.291549 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:17:22.291549 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:17:22.291549 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:17:22.291549 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:17:22.291549 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:17:22.291549 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:17:22.291549 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 615/1217] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Aug 29 22:17:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:17:22.298116 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce497dfc-f6c3-44d1-addc-eb41c36b69cb None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:22.440546 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce497dfc-f6c3-44d1-addc-eb41c36b69cb None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:22.466295 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:22.479224 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8571d-b379-4533-8981-44c7dac164cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:22.480600 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8571d-b379-4533-8981-44c7dac164cb None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:22.480887 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8571d-b379-4533-8981-44c7dac164cb None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:22.481176 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8571d-b379-4533-8981-44c7dac164cb None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:22.481877 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead8571d-b379-4533-8981-44c7dac164cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:17:22.482243 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead8571d-b379-4533-8981-44c7dac164cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:22.483744 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead8571d-b379-4533-8981-44c7dac164cb None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:22.498050 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 603/1218] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Aug 29 22:17:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:17:22.504911 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f59e27-6522-460f-8ab7-b14db07aeb82 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:22.616959 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f59e27-6522-460f-8ab7-b14db07aeb82 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:22.651270 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:22.659352 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c14d5-7423-43b8-a7fd-98fa88a530b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:22.660064 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c14d5-7423-43b8-a7fd-98fa88a530b1 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:22.660409 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c14d5-7423-43b8-a7fd-98fa88a530b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:22.660811 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c14d5-7423-43b8-a7fd-98fa88a530b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:22.661603 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12c14d5-7423-43b8-a7fd-98fa88a530b1 None admin] RBAC: Adding query filter params (role.id=bc7b902c0870483ba03c139d941f78ac, scope.project.id=696ed25cc0cb43fab4bfaf762a90da54, user.id=bce3d9397cca4ae58e14c8a5ae844f8e) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:17:22.661930 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12c14d5-7423-43b8-a7fd-98fa88a530b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:22.663440 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12c14d5-7423-43b8-a7fd-98fa88a530b1 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:22.670995 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 616/1219] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Aug 29 22:17:22 2022] GET /identity/v3/role_assignments?user.id=bce3d9397cca4ae58e14c8a5ae844f8e&scope.project.id=696ed25cc0cb43fab4bfaf762a90da54&role.id=bc7b902c0870483ba03c139d941f78ac => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:17:24.721134 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f452c6c-21e8-4fcd-b13a-1b84864788f0 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:24.721728 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f452c6c-21e8-4fcd-b13a-1b84864788f0 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:24.721728 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f452c6c-21e8-4fcd-b13a-1b84864788f0 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:24.722996 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 604/1220] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:17:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:17:24.731957 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10000a65-7de8-42ab-919c-a8b419438aa8 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:24.732407 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10000a65-7de8-42ab-919c-a8b419438aa8 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:24.732528 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10000a65-7de8-42ab-919c-a8b419438aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:24.755748 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-10000a65-7de8-42ab-919c-a8b419438aa8 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:17:24.757123 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-10000a65-7de8-42ab-919c-a8b419438aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:17:24.830516 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 617/1221] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:17:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:17:25.131270 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f452c6c-21e8-4fcd-b13a-1b84864788f0 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:25.247185 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f452c6c-21e8-4fcd-b13a-1b84864788f0 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:25.286357 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc6e93-4e89-422f-9ad2-b9513f07ac49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:25.287059 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc6e93-4e89-422f-9ad2-b9513f07ac49 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:25.287348 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc6e93-4e89-422f-9ad2-b9513f07ac49 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:25.287650 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc6e93-4e89-422f-9ad2-b9513f07ac49 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:25.303173 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefc6e93-4e89-422f-9ad2-b9513f07ac49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:17:25.312230 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-aefc6e93-4e89-422f-9ad2-b9513f07ac49 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:17:25.312230 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:17:25.312230 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:17:25.312230 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:17:25.312230 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:17:25.312230 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:17:25.312230 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:17:25.312230 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:17:25.312230 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:17:25.312230 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:17:25.312230 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:17:25.312230 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:17:25.312230 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:17:25.312230 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:17:25.312230 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:17:25.312230 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:17:25.313445 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:17:25.313445 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:17:25.313445 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:17:25.313445 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:17:25.313445 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:17:25.313445 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:17:25.313445 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:17:25.313445 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:17:25.313445 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:17:25.313445 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:17:25.313445 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:17:25.313445 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:17:25.313445 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:17:25.313445 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:17:25.313445 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:17:25.313445 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:17:25.314441 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:17:25.314441 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:17:25.314441 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:17:25.314441 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:17:25.314441 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:17:25.314441 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:17:25.314441 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:17:25.314441 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:17:25.314441 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:17:25.314441 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:17:25.314441 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:17:25.314441 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:17:25.315259 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 605/1222] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Aug 29 22:17:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:17:25.324360 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10000a65-7de8-42ab-919c-a8b419438aa8 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:25.439027 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10000a65-7de8-42ab-919c-a8b419438aa8 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:25.465364 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:25.478576 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002165a-886d-445d-b572-c7b72c12226a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:25.479483 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002165a-886d-445d-b572-c7b72c12226a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:25.479762 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002165a-886d-445d-b572-c7b72c12226a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:25.480167 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002165a-886d-445d-b572-c7b72c12226a None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:25.480874 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4002165a-886d-445d-b572-c7b72c12226a None admin] RBAC: Adding query filter params (name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:17:25.481183 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4002165a-886d-445d-b572-c7b72c12226a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:25.482775 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4002165a-886d-445d-b572-c7b72c12226a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:25.491586 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 618/1223] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Aug 29 22:17:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:17:25.497683 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc6e93-4e89-422f-9ad2-b9513f07ac49 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:25.551942 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:25.613624 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc6e93-4e89-422f-9ad2-b9513f07ac49 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:25.661754 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c1eeb-d1e2-438f-a46a-cf10197d1b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:25.662404 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c1eeb-d1e2-438f-a46a-cf10197d1b78 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:25.662678 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c1eeb-d1e2-438f-a46a-cf10197d1b78 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:25.662949 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c1eeb-d1e2-438f-a46a-cf10197d1b78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:25.674755 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275c1eeb-d1e2-438f-a46a-cf10197d1b78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:25.676244 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275c1eeb-d1e2-438f-a46a-cf10197d1b78 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:25.692516 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-275c1eeb-d1e2-438f-a46a-cf10197d1b78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:17:25.692516 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:17:25.692516 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:17:25.692516 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:17:25.692516 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:17:25.692516 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:17:25.692516 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:17:25.692516 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:17:25.692516 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:17:25.692516 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:17:25.692516 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:17:25.692516 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:17:25.692516 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:17:25.692516 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:17:25.692516 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:17:25.692516 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:17:25.693562 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:17:25.693562 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:17:25.693562 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:17:25.693562 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:17:25.693562 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:17:25.693562 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:17:25.693562 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:17:25.693562 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:17:25.693562 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:17:25.693562 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:17:25.693562 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:17:25.693562 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:17:25.693562 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:17:25.693562 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:17:25.693562 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:17:25.693562 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:17:25.693562 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:17:25.694738 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:17:25.694738 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:17:25.694738 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:17:25.694738 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 606/1224] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:17:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:17:25.700204 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002165a-886d-445d-b572-c7b72c12226a None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:25.810421 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002165a-886d-445d-b572-c7b72c12226a None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:25.847972 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3462c1-2b63-4034-b03c-f9f75b0401b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:25.848666 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3462c1-2b63-4034-b03c-f9f75b0401b4 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:25.848986 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3462c1-2b63-4034-b03c-f9f75b0401b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:25.849263 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3462c1-2b63-4034-b03c-f9f75b0401b4 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:25.849935 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3462c1-2b63-4034-b03c-f9f75b0401b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:17:25.850284 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3462c1-2b63-4034-b03c-f9f75b0401b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:25.851854 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3462c1-2b63-4034-b03c-f9f75b0401b4 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:25.864233 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 619/1225] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:17:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:17:25.871149 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c1eeb-d1e2-438f-a46a-cf10197d1b78 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:25.977614 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:25.988153 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c1eeb-d1e2-438f-a46a-cf10197d1b78 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:26.032457 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ba5fb-967a-44fb-be86-419481e914c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:26.033122 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ba5fb-967a-44fb-be86-419481e914c9 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:26.033516 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ba5fb-967a-44fb-be86-419481e914c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:26.033735 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ba5fb-967a-44fb-be86-419481e914c9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:26.041486 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ba5fb-967a-44fb-be86-419481e914c9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:26.043138 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ba5fb-967a-44fb-be86-419481e914c9 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:26.055987 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-691ba5fb-967a-44fb-be86-419481e914c9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 22:17:26.055987 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:17:26.055987 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:17:26.055987 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:17:26.055987 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:17:26.055987 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:17:26.055987 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:17:26.055987 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:17:26.055987 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:17:26.055987 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:17:26.055987 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:17:26.055987 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:17:26.055987 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:17:26.055987 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:17:26.055987 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:17:26.055987 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:17:26.057147 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:17:26.057147 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:17:26.057147 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:17:26.057147 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:17:26.057147 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:17:26.057147 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:17:26.057147 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:17:26.057147 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:17:26.057147 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:17:26.057147 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:17:26.057147 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:17:26.057147 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:17:26.057147 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:17:26.057147 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:17:26.057147 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:17:26.057147 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:17:26.057147 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:17:26.057147 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:17:26.058944 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:17:26.058944 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:17:26.058944 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:17:26.058944 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:17:26.058944 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:17:26.058944 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:17:26.058944 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:17:26.058944 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:17:26.058944 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 22:17:26.058944 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:17:26.058944 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 607/1226] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:17:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:17:26.063577 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3462c1-2b63-4034-b03c-f9f75b0401b4 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:26.116160 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:26.178220 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3462c1-2b63-4034-b03c-f9f75b0401b4 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:26.217413 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d3490-9590-44f7-abfd-1ef454ddc690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:26.218009 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d3490-9590-44f7-abfd-1ef454ddc690 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:26.218291 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d3490-9590-44f7-abfd-1ef454ddc690 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:26.218604 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d3490-9590-44f7-abfd-1ef454ddc690 None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:26.219349 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d3490-9590-44f7-abfd-1ef454ddc690 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:17:26.219692 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d3490-9590-44f7-abfd-1ef454ddc690 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:26.221130 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d3490-9590-44f7-abfd-1ef454ddc690 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:26.240103 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 620/1227] 10.222.0.36 () {56 vars in 1143 bytes} [Mon Aug 29 22:17:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:17:26.247179 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ba5fb-967a-44fb-be86-419481e914c9 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:26.366421 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ba5fb-967a-44fb-be86-419481e914c9 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:26.403468 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fd454e-f0f1-4193-a537-446efd26438b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:26.404122 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd454e-f0f1-4193-a537-446efd26438b None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:26.404398 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd454e-f0f1-4193-a537-446efd26438b None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:26.404702 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd454e-f0f1-4193-a537-446efd26438b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:26.415728 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fd454e-f0f1-4193-a537-446efd26438b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:26.417436 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fd454e-f0f1-4193-a537-446efd26438b None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:26.431907 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-69fd454e-f0f1-4193-a537-446efd26438b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:17:26.431907 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:17:26.431907 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:17:26.431907 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:17:26.431907 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:17:26.431907 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:17:26.431907 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:17:26.431907 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:17:26.431907 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:17:26.431907 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:17:26.431907 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:17:26.431907 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:17:26.431907 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:17:26.431907 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:17:26.431907 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:17:26.431907 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:17:26.433702 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:17:26.433702 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:17:26.433702 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:17:26.433702 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:17:26.433702 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:17:26.433702 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:17:26.433702 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:17:26.433702 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:17:26.433702 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:17:26.433702 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:17:26.433702 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:17:26.433702 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:17:26.433702 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:17:26.433702 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:17:26.433702 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:17:26.433702 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:17:26.433702 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:17:26.435003 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:17:26.435003 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:17:26.435003 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:17:26.435003 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 608/1228] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:17:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:17:26.439532 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d3490-9590-44f7-abfd-1ef454ddc690 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:26.553576 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d3490-9590-44f7-abfd-1ef454ddc690 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:26.557080 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:26.599806 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15430b7c-9c1f-4600-a606-5acdd16d9c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:26.600763 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15430b7c-9c1f-4600-a606-5acdd16d9c43 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:26.601185 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15430b7c-9c1f-4600-a606-5acdd16d9c43 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:26.601633 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15430b7c-9c1f-4600-a606-5acdd16d9c43 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:26.602487 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15430b7c-9c1f-4600-a606-5acdd16d9c43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:17:26.602923 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15430b7c-9c1f-4600-a606-5acdd16d9c43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:26.605551 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15430b7c-9c1f-4600-a606-5acdd16d9c43 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:26.620338 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 621/1229] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:17:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:17:26.626415 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fd454e-f0f1-4193-a537-446efd26438b None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:26.637296 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:26.744502 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fd454e-f0f1-4193-a537-446efd26438b None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:26.787259 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef903f23-e609-4fb5-96fd-98b63b4f9f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:26.787925 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef903f23-e609-4fb5-96fd-98b63b4f9f58 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:26.788215 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef903f23-e609-4fb5-96fd-98b63b4f9f58 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:26.788507 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef903f23-e609-4fb5-96fd-98b63b4f9f58 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:26.796354 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef903f23-e609-4fb5-96fd-98b63b4f9f58 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:26.797998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef903f23-e609-4fb5-96fd-98b63b4f9f58 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:26.810344 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-ef903f23-e609-4fb5-96fd-98b63b4f9f58 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:17:26.810344 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:17:26.810344 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:17:26.810344 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:17:26.810344 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:17:26.810344 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:17:26.810344 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:17:26.810344 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:17:26.810344 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:17:26.810344 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:17:26.810344 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:17:26.810344 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:17:26.810344 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:17:26.810344 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:17:26.810344 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:17:26.811451 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:17:26.811451 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:17:26.811451 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:17:26.811451 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:17:26.811451 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:17:26.811451 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:17:26.811451 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:17:26.811451 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:17:26.811451 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:17:26.811451 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:17:26.811451 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:17:26.811451 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:17:26.811451 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:17:26.811451 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:17:26.811451 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:17:26.811451 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:17:26.811451 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:17:26.812534 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:17:26.812534 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:17:26.812534 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:17:26.812534 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:17:26.812534 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:17:26.812534 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:17:26.812534 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:17:26.812534 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:17:26.812534 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 609/1230] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Aug 29 22:17:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:17:26.817797 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15430b7c-9c1f-4600-a606-5acdd16d9c43 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:26.959910 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15430b7c-9c1f-4600-a606-5acdd16d9c43 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:27.011749 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325072c3-f3de-4dd7-9a2e-84e5d3aad0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:27.012494 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325072c3-f3de-4dd7-9a2e-84e5d3aad0eb None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:27.012783 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325072c3-f3de-4dd7-9a2e-84e5d3aad0eb None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:27.013061 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325072c3-f3de-4dd7-9a2e-84e5d3aad0eb None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:27.013824 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325072c3-f3de-4dd7-9a2e-84e5d3aad0eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:17:27.014149 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325072c3-f3de-4dd7-9a2e-84e5d3aad0eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:27.015812 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325072c3-f3de-4dd7-9a2e-84e5d3aad0eb None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:27.030880 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 622/1231] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Aug 29 22:17:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:17:27.037974 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef903f23-e609-4fb5-96fd-98b63b4f9f58 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:27.114206 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:27.149872 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef903f23-e609-4fb5-96fd-98b63b4f9f58 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:27.186619 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e560c4c-7e09-4c0c-99a4-c4222ed0eeab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:27.187347 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e560c4c-7e09-4c0c-99a4-c4222ed0eeab None admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:27.187613 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e560c4c-7e09-4c0c-99a4-c4222ed0eeab None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:27.187889 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e560c4c-7e09-4c0c-99a4-c4222ed0eeab None admin] PATH_INFO: `/v3/projects/696ed25cc0cb43fab4bfaf762a90da54/users/bce3d9397cca4ae58e14c8a5ae844f8e/roles/bc7b902c0870483ba03c139d941f78ac` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:27.207748 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e560c4c-7e09-4c0c-99a4-c4222ed0eeab None admin] RBAC: Authorizing `identity:create_grant(project_id=696ed25cc0cb43fab4bfaf762a90da54, user_id=bce3d9397cca4ae58e14c8a5ae844f8e, role_id=bc7b902c0870483ba03c139d941f78ac)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:27.209238 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e560c4c-7e09-4c0c-99a4-c4222ed0eeab None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:27.230029 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 610/1232] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Aug 29 22:17:27 2022] PUT /identity/v3/projects/696ed25cc0cb43fab4bfaf762a90da54/users/bce3d9397cca4ae58e14c8a5ae844f8e/roles/bc7b902c0870483ba03c139d941f78ac => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:17:29.140381 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a311af5-fe6f-4dc1-be06-1b40a1bd5c82 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:29.141376 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a311af5-fe6f-4dc1-be06-1b40a1bd5c82 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:29.141376 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a311af5-fe6f-4dc1-be06-1b40a1bd5c82 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:29.142943 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 623/1233] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:17:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:17:29.148279 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2fa93d-03d3-4f4a-8f3f-51235de2c45a None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:29.148708 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2fa93d-03d3-4f4a-8f3f-51235de2c45a None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:29.148875 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2fa93d-03d3-4f4a-8f3f-51235de2c45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:29.168830 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-ac2fa93d-03d3-4f4a-8f3f-51235de2c45a None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:17:29.170062 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-ac2fa93d-03d3-4f4a-8f3f-51235de2c45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:17:29.249416 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 611/1234] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:17:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:17:29.549625 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a311af5-fe6f-4dc1-be06-1b40a1bd5c82 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:29.579822 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:29.676265 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a311af5-fe6f-4dc1-be06-1b40a1bd5c82 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:29.716063 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aba805-32cc-4487-81d7-8b9a9d64b1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:29.716747 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aba805-32cc-4487-81d7-8b9a9d64b1b3 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:29.717074 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aba805-32cc-4487-81d7-8b9a9d64b1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:29.717287 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aba805-32cc-4487-81d7-8b9a9d64b1b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:29.729332 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aba805-32cc-4487-81d7-8b9a9d64b1b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:17:29.734692 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-e3aba805-32cc-4487-81d7-8b9a9d64b1b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:17:29.734692 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:17:29.734692 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:17:29.734692 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:17:29.734692 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:17:29.734692 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:17:29.734692 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:17:29.734692 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:17:29.734692 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:17:29.734692 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:17:29.734692 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:17:29.734692 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:17:29.734692 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:17:29.734692 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:17:29.734692 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:17:29.734692 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:17:29.735799 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:17:29.735799 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:17:29.735799 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:17:29.735799 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:17:29.735799 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:17:29.735799 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:17:29.735799 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:17:29.735799 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:17:29.735799 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:17:29.735799 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:17:29.735799 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:17:29.735799 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:17:29.735799 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:17:29.735799 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:17:29.735799 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:17:29.735799 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:17:29.736692 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:17:29.736692 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:17:29.736692 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:17:29.736692 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:17:29.736692 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:17:29.736692 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:17:29.736692 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:17:29.736692 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:17:29.736692 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:17:29.736692 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:17:29.736692 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:17:29.736692 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:17:29.736692 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 624/1235] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Aug 29 22:17:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:17:29.742569 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2fa93d-03d3-4f4a-8f3f-51235de2c45a None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:29.793514 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:29.857233 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2fa93d-03d3-4f4a-8f3f-51235de2c45a None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:29.898775 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a491f36d-fc35-4c5f-b6e2-f594321b4ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:29.899813 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491f36d-fc35-4c5f-b6e2-f594321b4ed7 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:29.900301 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491f36d-fc35-4c5f-b6e2-f594321b4ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:29.900790 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491f36d-fc35-4c5f-b6e2-f594321b4ed7 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:29.902192 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a491f36d-fc35-4c5f-b6e2-f594321b4ed7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:17:29.902743 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a491f36d-fc35-4c5f-b6e2-f594321b4ed7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:29.905590 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a491f36d-fc35-4c5f-b6e2-f594321b4ed7 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:29.916342 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 612/1236] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Aug 29 22:17:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:17:29.922542 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aba805-32cc-4487-81d7-8b9a9d64b1b3 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:30.017283 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:30.035305 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aba805-32cc-4487-81d7-8b9a9d64b1b3 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:30.074477 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85397cee-df7a-4ff3-9a19-b128224e9c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:30.075222 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85397cee-df7a-4ff3-9a19-b128224e9c48 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:30.075638 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85397cee-df7a-4ff3-9a19-b128224e9c48 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:30.075900 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85397cee-df7a-4ff3-9a19-b128224e9c48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:30.088752 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85397cee-df7a-4ff3-9a19-b128224e9c48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:30.090873 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85397cee-df7a-4ff3-9a19-b128224e9c48 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:30.109758 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-85397cee-df7a-4ff3-9a19-b128224e9c48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:17:30.109758 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:17:30.109758 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:17:30.109758 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:17:30.109758 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:17:30.109758 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:17:30.109758 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:17:30.109758 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:17:30.109758 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:17:30.109758 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:17:30.109758 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:17:30.109758 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:17:30.109758 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:17:30.109758 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:17:30.109758 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:17:30.109758 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:17:30.110917 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:17:30.110917 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:17:30.110917 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:17:30.110917 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:17:30.110917 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:17:30.110917 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:17:30.110917 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:17:30.110917 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:17:30.110917 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:17:30.110917 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:17:30.110917 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:17:30.110917 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:17:30.110917 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:17:30.110917 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:17:30.110917 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:17:30.110917 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:17:30.110917 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:17:30.111882 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:17:30.111882 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:17:30.111882 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:17:30.111882 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 625/1237] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:17:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:17:30.116970 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a491f36d-fc35-4c5f-b6e2-f594321b4ed7 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:30.227270 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a491f36d-fc35-4c5f-b6e2-f594321b4ed7 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:30.237176 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:30.267932 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b9507-b71e-4663-a02b-fa24bebf8f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:30.268712 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b9507-b71e-4663-a02b-fa24bebf8f2b None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:30.269022 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b9507-b71e-4663-a02b-fa24bebf8f2b None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:30.269404 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b9507-b71e-4663-a02b-fa24bebf8f2b None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:30.270068 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b9507-b71e-4663-a02b-fa24bebf8f2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:17:30.270387 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b9507-b71e-4663-a02b-fa24bebf8f2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:30.271812 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b9507-b71e-4663-a02b-fa24bebf8f2b None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:30.284965 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 613/1238] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:17:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:17:30.290936 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85397cee-df7a-4ff3-9a19-b128224e9c48 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:30.411471 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85397cee-df7a-4ff3-9a19-b128224e9c48 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:30.449639 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c5064-1aff-4114-99a5-da205c6a970f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:30.450291 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c5064-1aff-4114-99a5-da205c6a970f None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:30.450567 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c5064-1aff-4114-99a5-da205c6a970f None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:30.450839 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c5064-1aff-4114-99a5-da205c6a970f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:30.453678 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:30.458946 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2c5064-1aff-4114-99a5-da205c6a970f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:30.460692 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2c5064-1aff-4114-99a5-da205c6a970f None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:30.474012 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-be2c5064-1aff-4114-99a5-da205c6a970f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 22:17:30.474012 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:17:30.474012 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:17:30.474012 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:17:30.474012 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:17:30.474012 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:17:30.474012 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:17:30.474012 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:17:30.474012 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:17:30.474012 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:17:30.474012 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:17:30.474012 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:17:30.474012 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:17:30.474012 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:17:30.474012 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:17:30.474012 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:17:30.475588 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:17:30.475588 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:17:30.475588 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:17:30.475588 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:17:30.475588 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:17:30.475588 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:17:30.475588 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:17:30.475588 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:17:30.475588 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:17:30.475588 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:17:30.475588 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:17:30.475588 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:17:30.475588 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:17:30.475588 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:17:30.475588 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:17:30.475588 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:17:30.475588 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:17:30.475588 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:17:30.476862 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:17:30.476862 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:17:30.476862 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:17:30.476862 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:17:30.476862 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:17:30.476862 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:17:30.476862 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:17:30.476862 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:17:30.476862 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 22:17:30.476862 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:17:30.476862 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 626/1239] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:17:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:17:30.482272 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b9507-b71e-4663-a02b-fa24bebf8f2b None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:30.603679 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b9507-b71e-4663-a02b-fa24bebf8f2b None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:30.645400 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa0c4a6-10c3-4d43-8034-eb62af7c2f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:30.646025 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0c4a6-10c3-4d43-8034-eb62af7c2f4c None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:30.646310 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0c4a6-10c3-4d43-8034-eb62af7c2f4c None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:30.646585 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0c4a6-10c3-4d43-8034-eb62af7c2f4c None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:30.647322 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa0c4a6-10c3-4d43-8034-eb62af7c2f4c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:17:30.647631 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa0c4a6-10c3-4d43-8034-eb62af7c2f4c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:30.649120 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa0c4a6-10c3-4d43-8034-eb62af7c2f4c None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:30.671178 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 614/1240] 10.222.0.36 () {56 vars in 1143 bytes} [Mon Aug 29 22:17:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:17:30.677579 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c5064-1aff-4114-99a5-da205c6a970f None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:30.793606 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c5064-1aff-4114-99a5-da205c6a970f None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:30.834600 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af8007-0ef7-401d-9364-5c82a2283b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:30.835413 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af8007-0ef7-401d-9364-5c82a2283b76 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:30.835886 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af8007-0ef7-401d-9364-5c82a2283b76 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:30.836257 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af8007-0ef7-401d-9364-5c82a2283b76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:30.913863 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:30.921706 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78af8007-0ef7-401d-9364-5c82a2283b76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:30.923287 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78af8007-0ef7-401d-9364-5c82a2283b76 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:31.043113 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 627/1241] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:17:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:17:31.049462 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa0c4a6-10c3-4d43-8034-eb62af7c2f4c None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:31.084574 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:31.173371 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa0c4a6-10c3-4d43-8034-eb62af7c2f4c None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:31.208240 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba6363-8334-453a-a5ec-8ddd4c04ebc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:31.208910 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba6363-8334-453a-a5ec-8ddd4c04ebc6 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:31.209190 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba6363-8334-453a-a5ec-8ddd4c04ebc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:31.209462 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba6363-8334-453a-a5ec-8ddd4c04ebc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:31.220052 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cba6363-8334-453a-a5ec-8ddd4c04ebc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:31.221578 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cba6363-8334-453a-a5ec-8ddd4c04ebc6 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:31.236443 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-5cba6363-8334-453a-a5ec-8ddd4c04ebc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:17:31.236443 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:17:31.236443 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:17:31.236443 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:17:31.236443 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:17:31.236443 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:17:31.236443 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:17:31.236443 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:17:31.236443 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:17:31.236443 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:17:31.236443 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:17:31.236443 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:17:31.236443 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:17:31.236443 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:17:31.236443 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:17:31.236443 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:17:31.238269 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:17:31.238269 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:17:31.238269 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:17:31.238269 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:17:31.238269 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:17:31.238269 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:17:31.238269 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:17:31.238269 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:17:31.238269 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:17:31.238269 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:17:31.238269 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:17:31.238269 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:17:31.238269 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:17:31.238269 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:17:31.238269 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:17:31.238269 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:17:31.238269 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:17:31.239212 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:17:31.239212 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:17:31.239212 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:17:31.239212 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 615/1242] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:17:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:17:31.243654 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af8007-0ef7-401d-9364-5c82a2283b76 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:31.347123 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:31.355133 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af8007-0ef7-401d-9364-5c82a2283b76 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:31.392685 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721fe712-814e-45f2-9db9-f1f10e18a6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:31.393322 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721fe712-814e-45f2-9db9-f1f10e18a6a4 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:31.393603 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721fe712-814e-45f2-9db9-f1f10e18a6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:31.393875 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721fe712-814e-45f2-9db9-f1f10e18a6a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:31.394564 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721fe712-814e-45f2-9db9-f1f10e18a6a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:17:31.394850 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721fe712-814e-45f2-9db9-f1f10e18a6a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:31.396427 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721fe712-814e-45f2-9db9-f1f10e18a6a4 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:31.408979 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 628/1243] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:17:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:17:31.415065 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba6363-8334-453a-a5ec-8ddd4c04ebc6 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:31.502723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:31.529262 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba6363-8334-453a-a5ec-8ddd4c04ebc6 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:31.569972 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1a324-0024-446a-ab28-bc8d2a9fcaec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:31.570744 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1a324-0024-446a-ab28-bc8d2a9fcaec None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:31.571015 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1a324-0024-446a-ab28-bc8d2a9fcaec None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:31.571320 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1a324-0024-446a-ab28-bc8d2a9fcaec None admin] PATH_INFO: `/v3/projects/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:31.579536 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a1a324-0024-446a-ab28-bc8d2a9fcaec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:31.581087 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a1a324-0024-446a-ab28-bc8d2a9fcaec None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:31.594402 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-e6a1a324-0024-446a-ab28-bc8d2a9fcaec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:17:31.594402 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:17:31.594402 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:17:31.594402 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:17:31.594402 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:17:31.594402 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:17:31.594402 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:17:31.594402 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:17:31.594402 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:17:31.594402 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:17:31.594402 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:17:31.594402 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:17:31.594402 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:17:31.594402 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:17:31.594402 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:17:31.595513 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:17:31.595513 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:17:31.595513 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:17:31.595513 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:17:31.595513 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:17:31.595513 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:17:31.595513 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:17:31.595513 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:17:31.595513 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:17:31.595513 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:17:31.595513 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:17:31.595513 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:17:31.595513 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:17:31.595513 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:17:31.595513 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:17:31.595513 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:17:31.595513 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:17:31.596801 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:17:31.596801 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:17:31.596801 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:17:31.596801 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:17:31.596801 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:17:31.596801 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:17:31.596801 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:17:31.596801 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:17:31.600863 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 616/1244] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Aug 29 22:17:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:17:31.602065 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721fe712-814e-45f2-9db9-f1f10e18a6a4 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:31.728499 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721fe712-814e-45f2-9db9-f1f10e18a6a4 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:31.777033 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab454f7-c7f8-431a-a7a3-e41b8c148763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:31.777592 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab454f7-c7f8-431a-a7a3-e41b8c148763 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:31.778002 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab454f7-c7f8-431a-a7a3-e41b8c148763 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:31.778395 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab454f7-c7f8-431a-a7a3-e41b8c148763 None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:31.779350 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab454f7-c7f8-431a-a7a3-e41b8c148763 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:17:31.779711 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab454f7-c7f8-431a-a7a3-e41b8c148763 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:31.781387 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab454f7-c7f8-431a-a7a3-e41b8c148763 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:31.795891 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 629/1245] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Aug 29 22:17:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:17:31.802783 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1a324-0024-446a-ab28-bc8d2a9fcaec None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:31.926371 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1a324-0024-446a-ab28-bc8d2a9fcaec None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:31.967589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa80081-ec1d-4554-9392-ec82b1c2e9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:31.968338 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa80081-ec1d-4554-9392-ec82b1c2e9f9 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:31.968611 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa80081-ec1d-4554-9392-ec82b1c2e9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:31.968893 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa80081-ec1d-4554-9392-ec82b1c2e9f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:31.969686 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa80081-ec1d-4554-9392-ec82b1c2e9f9 None admin] RBAC: Adding query filter params (role.id=bc7b902c0870483ba03c139d941f78ac, scope.project.id=696ed25cc0cb43fab4bfaf762a90da54, user.id=bce3d9397cca4ae58e14c8a5ae844f8e) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:17:31.970027 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa80081-ec1d-4554-9392-ec82b1c2e9f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:31.971661 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa80081-ec1d-4554-9392-ec82b1c2e9f9 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:31.992476 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 617/1246] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Aug 29 22:17:31 2022] GET /identity/v3/role_assignments?user.id=bce3d9397cca4ae58e14c8a5ae844f8e&scope.project.id=696ed25cc0cb43fab4bfaf762a90da54&role.id=bc7b902c0870483ba03c139d941f78ac => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:17:34.250717 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf71ff-1cda-45cd-bdb5-03fdb2aa7b03 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:34.251309 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf71ff-1cda-45cd-bdb5-03fdb2aa7b03 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:34.251309 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf71ff-1cda-45cd-bdb5-03fdb2aa7b03 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:34.252610 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 630/1247] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:17:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:17:34.258362 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5921623-9336-4e4b-897d-2242ea3a193c None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:34.258776 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5921623-9336-4e4b-897d-2242ea3a193c None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:34.258916 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5921623-9336-4e4b-897d-2242ea3a193c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:34.266882 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:34.282404 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-e5921623-9336-4e4b-897d-2242ea3a193c None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:17:34.283671 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e5921623-9336-4e4b-897d-2242ea3a193c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:17:34.365758 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 618/1248] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:17:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:17:34.634356 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf71ff-1cda-45cd-bdb5-03fdb2aa7b03 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:34.656503 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:34.753818 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf71ff-1cda-45cd-bdb5-03fdb2aa7b03 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:34.796424 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3512a16a-f0dc-4c1d-bda7-4443a7175f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:34.797256 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512a16a-f0dc-4c1d-bda7-4443a7175f6b None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:34.797645 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512a16a-f0dc-4c1d-bda7-4443a7175f6b None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:34.797985 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512a16a-f0dc-4c1d-bda7-4443a7175f6b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:34.809542 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3512a16a-f0dc-4c1d-bda7-4443a7175f6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:17:34.814597 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-3512a16a-f0dc-4c1d-bda7-4443a7175f6b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:17:34.814597 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:17:34.814597 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:17:34.814597 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:17:34.814597 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:17:34.814597 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:17:34.814597 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:17:34.814597 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:17:34.814597 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:17:34.814597 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:17:34.814597 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:17:34.814597 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:17:34.814597 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:17:34.814597 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:17:34.814597 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:17:34.814597 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:17:34.816034 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:17:34.816034 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:17:34.816034 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:17:34.816034 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:17:34.816034 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:17:34.816034 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:17:34.816034 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:17:34.816034 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:17:34.816034 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:17:34.816034 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:17:34.816034 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:17:34.816034 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:17:34.816034 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:17:34.816034 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:17:34.816034 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:17:34.816034 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:17:34.817392 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:17:34.817392 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:17:34.817392 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:17:34.817392 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:17:34.817392 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:17:34.817392 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:17:34.817392 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:17:34.817392 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:17:34.817392 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:17:34.817392 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:17:34.817392 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:17:34.817392 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:17:34.817392 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 631/1249] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Aug 29 22:17:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:17:34.823574 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5921623-9336-4e4b-897d-2242ea3a193c None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:34.947837 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5921623-9336-4e4b-897d-2242ea3a193c None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:34.984274 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:34.990471 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e7dac-f195-42f9-960c-27b8b78eda1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:34.991097 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e7dac-f195-42f9-960c-27b8b78eda1c None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:34.991384 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e7dac-f195-42f9-960c-27b8b78eda1c None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:34.991686 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e7dac-f195-42f9-960c-27b8b78eda1c None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:34.992317 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e7dac-f195-42f9-960c-27b8b78eda1c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:17:34.992702 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e7dac-f195-42f9-960c-27b8b78eda1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:34.994044 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e7dac-f195-42f9-960c-27b8b78eda1c None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:35.003036 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 619/1250] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:17:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:17:35.008803 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3512a16a-f0dc-4c1d-bda7-4443a7175f6b None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:35.106697 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:35.135006 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3512a16a-f0dc-4c1d-bda7-4443a7175f6b None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:35.176796 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac81163-5537-4c40-9987-bd13cebb6a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:35.177559 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac81163-5537-4c40-9987-bd13cebb6a9c None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:35.177823 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac81163-5537-4c40-9987-bd13cebb6a9c None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:35.178132 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac81163-5537-4c40-9987-bd13cebb6a9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:35.192345 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac81163-5537-4c40-9987-bd13cebb6a9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:35.194129 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac81163-5537-4c40-9987-bd13cebb6a9c None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:35.211961 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-5ac81163-5537-4c40-9987-bd13cebb6a9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:17:35.211961 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:17:35.211961 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:17:35.211961 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:17:35.211961 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:17:35.211961 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:17:35.211961 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:17:35.211961 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:17:35.211961 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:17:35.211961 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:17:35.211961 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:17:35.211961 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:17:35.211961 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:17:35.211961 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:17:35.211961 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:17:35.211961 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:17:35.213286 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:17:35.213286 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:17:35.213286 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:17:35.213286 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:17:35.213286 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:17:35.213286 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:17:35.213286 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:17:35.213286 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:17:35.213286 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:17:35.213286 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:17:35.213286 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:17:35.213286 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:17:35.213286 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:17:35.213286 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:17:35.213286 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:17:35.213286 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:17:35.213286 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:17:35.214211 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:17:35.214211 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:17:35.214211 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:17:35.214211 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 632/1251] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:17:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:17:35.220184 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e7dac-f195-42f9-960c-27b8b78eda1c None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:35.344546 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e7dac-f195-42f9-960c-27b8b78eda1c None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:35.388596 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74244e9-6b17-49e4-ac61-e8e7308f6292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:35.389230 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74244e9-6b17-49e4-ac61-e8e7308f6292 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:35.389521 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74244e9-6b17-49e4-ac61-e8e7308f6292 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:35.389774 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74244e9-6b17-49e4-ac61-e8e7308f6292 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:35.390405 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74244e9-6b17-49e4-ac61-e8e7308f6292 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:17:35.390709 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74244e9-6b17-49e4-ac61-e8e7308f6292 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:35.392472 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74244e9-6b17-49e4-ac61-e8e7308f6292 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:35.405854 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 620/1252] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:17:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:17:35.411908 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac81163-5537-4c40-9987-bd13cebb6a9c None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:35.530173 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac81163-5537-4c40-9987-bd13cebb6a9c None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:35.561801 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:35.574007 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578703e-02bd-4fc4-ab7e-1f18667fcec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:35.574664 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578703e-02bd-4fc4-ab7e-1f18667fcec8 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:35.574949 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578703e-02bd-4fc4-ab7e-1f18667fcec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:35.575231 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578703e-02bd-4fc4-ab7e-1f18667fcec8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:35.583498 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5578703e-02bd-4fc4-ab7e-1f18667fcec8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:35.584983 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5578703e-02bd-4fc4-ab7e-1f18667fcec8 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:35.597159 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-5578703e-02bd-4fc4-ab7e-1f18667fcec8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 22:17:35.597159 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:17:35.597159 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:17:35.597159 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:17:35.597159 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:17:35.597159 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:17:35.597159 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:17:35.597159 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:17:35.597159 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:17:35.597159 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:17:35.597159 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:17:35.597159 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:17:35.597159 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:17:35.597159 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:17:35.597159 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:17:35.597159 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:17:35.598120 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:17:35.598120 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:17:35.598120 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:17:35.598120 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:17:35.598120 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:17:35.598120 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:17:35.598120 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:17:35.598120 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:17:35.598120 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:17:35.598120 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:17:35.598120 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:17:35.598120 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:17:35.598120 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:17:35.598120 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:17:35.598120 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:17:35.598120 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:17:35.598120 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:17:35.598120 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:17:35.599131 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:17:35.599131 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:17:35.599131 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:17:35.599131 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:17:35.599131 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:17:35.599131 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:17:35.599131 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:17:35.599131 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:17:35.599131 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 22:17:35.599131 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:17:35.599131 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 633/1253] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:17:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:17:35.604980 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74244e9-6b17-49e4-ac61-e8e7308f6292 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:35.666933 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:35.720381 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74244e9-6b17-49e4-ac61-e8e7308f6292 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:35.757122 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a58e1-3245-4b2b-8fd9-c502d7621404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:35.757740 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a58e1-3245-4b2b-8fd9-c502d7621404 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:35.758023 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a58e1-3245-4b2b-8fd9-c502d7621404 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:35.758320 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a58e1-3245-4b2b-8fd9-c502d7621404 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:35.759031 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75a58e1-3245-4b2b-8fd9-c502d7621404 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:17:35.759373 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75a58e1-3245-4b2b-8fd9-c502d7621404 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:35.760915 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75a58e1-3245-4b2b-8fd9-c502d7621404 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:35.783559 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 621/1254] 10.222.0.36 () {56 vars in 1143 bytes} [Mon Aug 29 22:17:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:17:35.790127 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578703e-02bd-4fc4-ab7e-1f18667fcec8 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:35.913094 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578703e-02bd-4fc4-ab7e-1f18667fcec8 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:35.950346 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73eeb7-7ad3-4d07-b20b-e9d892a802cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:35.950995 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73eeb7-7ad3-4d07-b20b-e9d892a802cb None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:35.951279 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73eeb7-7ad3-4d07-b20b-e9d892a802cb None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:35.951627 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73eeb7-7ad3-4d07-b20b-e9d892a802cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:36.016914 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:36.031247 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b73eeb7-7ad3-4d07-b20b-e9d892a802cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:36.033015 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b73eeb7-7ad3-4d07-b20b-e9d892a802cb None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:36.143846 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 634/1255] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:17:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:17:36.150730 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a58e1-3245-4b2b-8fd9-c502d7621404 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:36.264417 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a58e1-3245-4b2b-8fd9-c502d7621404 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:36.282534 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:36.309191 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deae0c7-9d62-402a-b63c-074de324db4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:36.309992 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deae0c7-9d62-402a-b63c-074de324db4b None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:36.310270 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deae0c7-9d62-402a-b63c-074de324db4b None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:36.310542 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deae0c7-9d62-402a-b63c-074de324db4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:36.323708 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deae0c7-9d62-402a-b63c-074de324db4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:36.326025 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deae0c7-9d62-402a-b63c-074de324db4b None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:36.345046 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-0deae0c7-9d62-402a-b63c-074de324db4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:17:36.345046 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:17:36.345046 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:17:36.345046 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:17:36.345046 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:17:36.345046 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:17:36.345046 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:17:36.345046 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:17:36.345046 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:17:36.345046 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:17:36.345046 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:17:36.345046 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:17:36.345046 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:17:36.345046 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:17:36.345046 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:17:36.345046 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:17:36.346831 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:17:36.346831 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:17:36.346831 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:17:36.346831 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:17:36.346831 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:17:36.346831 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:17:36.346831 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:17:36.346831 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:17:36.346831 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:17:36.346831 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:17:36.346831 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:17:36.346831 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:17:36.346831 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:17:36.346831 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:17:36.346831 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:17:36.346831 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:17:36.346831 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:17:36.348001 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:17:36.348001 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:17:36.348001 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:17:36.348001 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 622/1256] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:17:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:17:36.352888 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73eeb7-7ad3-4d07-b20b-e9d892a802cb None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:36.453879 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:36.467143 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73eeb7-7ad3-4d07-b20b-e9d892a802cb None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:36.508136 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b428a60-d107-4862-a260-00e9ea8fc027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:36.508867 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b428a60-d107-4862-a260-00e9ea8fc027 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:36.509185 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b428a60-d107-4862-a260-00e9ea8fc027 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:36.509494 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b428a60-d107-4862-a260-00e9ea8fc027 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:36.510244 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b428a60-d107-4862-a260-00e9ea8fc027 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:17:36.510610 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b428a60-d107-4862-a260-00e9ea8fc027 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:36.512589 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b428a60-d107-4862-a260-00e9ea8fc027 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:36.526499 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 635/1257] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:17:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:17:36.533263 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deae0c7-9d62-402a-b63c-074de324db4b None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:36.642311 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deae0c7-9d62-402a-b63c-074de324db4b None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:36.681606 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef8904-6b2d-4507-b873-e2def89a0460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:36.682490 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef8904-6b2d-4507-b873-e2def89a0460 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:36.682928 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef8904-6b2d-4507-b873-e2def89a0460 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:36.683195 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef8904-6b2d-4507-b873-e2def89a0460 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:36.691271 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fef8904-6b2d-4507-b873-e2def89a0460 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:36.692952 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fef8904-6b2d-4507-b873-e2def89a0460 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:36.706302 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-7fef8904-6b2d-4507-b873-e2def89a0460 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:17:36.706302 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:17:36.706302 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:17:36.706302 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:17:36.706302 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:17:36.706302 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:17:36.706302 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:17:36.706302 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:17:36.706302 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:17:36.706302 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:17:36.706302 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:17:36.706302 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:17:36.706302 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:17:36.706302 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:17:36.706302 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:17:36.707413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:17:36.707413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:17:36.707413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:17:36.707413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:17:36.707413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:17:36.707413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:17:36.707413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:17:36.707413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:17:36.707413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:17:36.707413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:17:36.707413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:17:36.707413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:17:36.707413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:17:36.707413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:17:36.707413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:17:36.707413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:17:36.707413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:17:36.709035 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:17:36.709035 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:17:36.709035 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:17:36.709035 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:17:36.709035 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:17:36.709035 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:17:36.709035 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:17:36.709035 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:17:36.709035 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 623/1258] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Aug 29 22:17:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:17:36.714531 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b428a60-d107-4862-a260-00e9ea8fc027 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:36.829819 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b428a60-d107-4862-a260-00e9ea8fc027 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:36.873448 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744ea72-40f7-456f-85d8-631a172134cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:36.874334 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744ea72-40f7-456f-85d8-631a172134cf None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:36.874753 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744ea72-40f7-456f-85d8-631a172134cf None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:36.875153 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744ea72-40f7-456f-85d8-631a172134cf None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:36.876229 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2744ea72-40f7-456f-85d8-631a172134cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:17:36.876754 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2744ea72-40f7-456f-85d8-631a172134cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:36.879293 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2744ea72-40f7-456f-85d8-631a172134cf None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:36.904622 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 636/1259] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Aug 29 22:17:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:17:36.909598 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef8904-6b2d-4507-b873-e2def89a0460 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:36.938979 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:37.027169 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef8904-6b2d-4507-b873-e2def89a0460 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:37.065226 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d21d6-c9a2-49ae-b2e0-a5e488968d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:37.067638 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d21d6-c9a2-49ae-b2e0-a5e488968d23 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:37.067920 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d21d6-c9a2-49ae-b2e0-a5e488968d23 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:37.068227 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d21d6-c9a2-49ae-b2e0-a5e488968d23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:37.068975 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63d21d6-c9a2-49ae-b2e0-a5e488968d23 None admin] RBAC: Adding query filter params (role.id=ff59a239a50b4bd899a83bf3c3fd1f63, scope.project.id=696ed25cc0cb43fab4bfaf762a90da54, user.id=bce3d9397cca4ae58e14c8a5ae844f8e) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:17:37.069435 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63d21d6-c9a2-49ae-b2e0-a5e488968d23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:37.071109 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63d21d6-c9a2-49ae-b2e0-a5e488968d23 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:37.077443 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 624/1260] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Aug 29 22:17:36 2022] GET /identity/v3/role_assignments?user.id=bce3d9397cca4ae58e14c8a5ae844f8e&scope.project.id=696ed25cc0cb43fab4bfaf762a90da54&role.id=ff59a239a50b4bd899a83bf3c3fd1f63 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:17:38.974526 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffdb898-31cc-4627-98c8-46fb5b4d5430 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:38.975107 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffdb898-31cc-4627-98c8-46fb5b4d5430 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:38.975107 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffdb898-31cc-4627-98c8-46fb5b4d5430 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:38.976423 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 637/1261] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:17:38.982815 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92db1d2-3c09-4c5b-83fd-e4e44cc97f8f None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:38.983570 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92db1d2-3c09-4c5b-83fd-e4e44cc97f8f None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:38.983728 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92db1d2-3c09-4c5b-83fd-e4e44cc97f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:39.005961 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-f92db1d2-3c09-4c5b-83fd-e4e44cc97f8f None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:17:39.007147 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f92db1d2-3c09-4c5b-83fd-e4e44cc97f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:17:39.084228 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 625/1262] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:17:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:17:39.380765 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffdb898-31cc-4627-98c8-46fb5b4d5430 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:39.395111 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:39.500405 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffdb898-31cc-4627-98c8-46fb5b4d5430 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:39.537837 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64597bd-3a91-44ee-b5ff-b0bcac011b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:39.538462 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64597bd-3a91-44ee-b5ff-b0bcac011b23 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:39.538739 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64597bd-3a91-44ee-b5ff-b0bcac011b23 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:39.539004 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64597bd-3a91-44ee-b5ff-b0bcac011b23 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:39.550962 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64597bd-3a91-44ee-b5ff-b0bcac011b23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:17:39.555796 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-a64597bd-3a91-44ee-b5ff-b0bcac011b23 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:17:39.555796 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:17:39.555796 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:17:39.555796 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:17:39.555796 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:17:39.555796 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:17:39.555796 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:17:39.555796 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:17:39.555796 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:17:39.555796 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:17:39.555796 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:17:39.555796 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:17:39.555796 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:17:39.555796 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:17:39.555796 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:17:39.555796 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:17:39.556960 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:17:39.556960 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:17:39.556960 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:17:39.556960 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:17:39.556960 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:17:39.556960 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:17:39.556960 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:17:39.556960 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:17:39.556960 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:17:39.556960 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:17:39.556960 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:17:39.556960 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:17:39.556960 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:17:39.556960 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:17:39.556960 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:17:39.556960 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:17:39.558106 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:17:39.558106 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:17:39.558106 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:17:39.558106 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:17:39.558106 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:17:39.558106 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:17:39.558106 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:17:39.558106 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:17:39.558106 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:17:39.558106 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:17:39.558106 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:17:39.558106 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:17:39.558106 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 638/1263] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Aug 29 22:17:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:17:39.563389 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92db1d2-3c09-4c5b-83fd-e4e44cc97f8f None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:39.584758 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:39.669905 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92db1d2-3c09-4c5b-83fd-e4e44cc97f8f None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:39.704653 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498838d9-3149-4d3b-909c-468e51618c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:39.705260 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498838d9-3149-4d3b-909c-468e51618c94 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:39.705533 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498838d9-3149-4d3b-909c-468e51618c94 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:39.705806 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498838d9-3149-4d3b-909c-468e51618c94 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:39.706474 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498838d9-3149-4d3b-909c-468e51618c94 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:17:39.706777 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498838d9-3149-4d3b-909c-468e51618c94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:39.708123 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498838d9-3149-4d3b-909c-468e51618c94 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:39.716369 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 626/1264] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:17:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:17:39.723090 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64597bd-3a91-44ee-b5ff-b0bcac011b23 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:39.802784 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:39.846472 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64597bd-3a91-44ee-b5ff-b0bcac011b23 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:39.884652 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af721c5a-ac68-4ca7-a6e3-cbccdc9bd66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:39.885274 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af721c5a-ac68-4ca7-a6e3-cbccdc9bd66d None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:39.885574 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af721c5a-ac68-4ca7-a6e3-cbccdc9bd66d None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:39.886256 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af721c5a-ac68-4ca7-a6e3-cbccdc9bd66d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:39.896643 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af721c5a-ac68-4ca7-a6e3-cbccdc9bd66d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:39.898155 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af721c5a-ac68-4ca7-a6e3-cbccdc9bd66d None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:39.913953 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-af721c5a-ac68-4ca7-a6e3-cbccdc9bd66d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:17:39.913953 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:17:39.913953 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:17:39.913953 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:17:39.913953 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:17:39.913953 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:17:39.913953 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:17:39.913953 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:17:39.913953 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:17:39.913953 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:17:39.913953 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:17:39.913953 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:17:39.913953 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:17:39.913953 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:17:39.913953 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:17:39.913953 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:17:39.915144 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:17:39.915144 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:17:39.915144 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:17:39.915144 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:17:39.915144 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:17:39.915144 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:17:39.915144 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:17:39.915144 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:17:39.915144 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:17:39.915144 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:17:39.915144 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:17:39.915144 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:17:39.915144 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:17:39.915144 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:17:39.915144 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:17:39.915144 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:17:39.915144 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:17:39.916131 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:17:39.916131 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:17:39.916131 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:17:39.916131 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 639/1265] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:17:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:17:39.922483 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498838d9-3149-4d3b-909c-468e51618c94 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:40.013742 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:40.034181 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498838d9-3149-4d3b-909c-468e51618c94 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:40.072334 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba34fac-307a-4881-bb0d-ccfaabf8e9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:40.072974 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba34fac-307a-4881-bb0d-ccfaabf8e9b2 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:40.073323 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba34fac-307a-4881-bb0d-ccfaabf8e9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:40.073590 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba34fac-307a-4881-bb0d-ccfaabf8e9b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:40.074245 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba34fac-307a-4881-bb0d-ccfaabf8e9b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:17:40.074549 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba34fac-307a-4881-bb0d-ccfaabf8e9b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:40.075929 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba34fac-307a-4881-bb0d-ccfaabf8e9b2 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:40.089085 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 627/1266] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:17:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:17:40.098736 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af721c5a-ac68-4ca7-a6e3-cbccdc9bd66d None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:40.209338 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af721c5a-ac68-4ca7-a6e3-cbccdc9bd66d None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:40.230014 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:40.252964 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e4d6f-480e-4b30-809e-401a9832e14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:40.253619 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e4d6f-480e-4b30-809e-401a9832e14f None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:40.253894 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e4d6f-480e-4b30-809e-401a9832e14f None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:40.254176 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e4d6f-480e-4b30-809e-401a9832e14f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:40.263024 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e4d6f-480e-4b30-809e-401a9832e14f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:40.264540 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e4d6f-480e-4b30-809e-401a9832e14f None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:40.277484 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-d00e4d6f-480e-4b30-809e-401a9832e14f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 22:17:40.277484 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:17:40.277484 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:17:40.277484 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:17:40.277484 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:17:40.277484 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:17:40.277484 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:17:40.277484 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:17:40.277484 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:17:40.277484 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:17:40.277484 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:17:40.277484 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:17:40.277484 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:17:40.277484 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:17:40.277484 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:17:40.277484 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:17:40.278851 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:17:40.278851 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:17:40.278851 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:17:40.278851 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:17:40.278851 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:17:40.278851 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:17:40.278851 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:17:40.278851 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:17:40.278851 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:17:40.278851 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:17:40.278851 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:17:40.278851 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:17:40.278851 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:17:40.278851 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:17:40.278851 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:17:40.278851 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:17:40.278851 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:17:40.278851 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:17:40.279969 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:17:40.279969 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:17:40.279969 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:17:40.279969 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:17:40.279969 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:17:40.279969 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:17:40.279969 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:17:40.279969 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:17:40.279969 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 22:17:40.279969 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:17:40.279969 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 640/1267] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:17:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:17:40.284756 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba34fac-307a-4881-bb0d-ccfaabf8e9b2 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:40.400022 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba34fac-307a-4881-bb0d-ccfaabf8e9b2 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:40.442623 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b718bc-1dea-4745-a710-5f74ab88318d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:40.443246 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b718bc-1dea-4745-a710-5f74ab88318d None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:40.443594 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b718bc-1dea-4745-a710-5f74ab88318d None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:40.443774 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b718bc-1dea-4745-a710-5f74ab88318d None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:40.444563 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b718bc-1dea-4745-a710-5f74ab88318d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:17:40.444845 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b718bc-1dea-4745-a710-5f74ab88318d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:40.446311 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b718bc-1dea-4745-a710-5f74ab88318d None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:40.456389 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:40.466252 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 628/1268] 10.222.0.36 () {56 vars in 1143 bytes} [Mon Aug 29 22:17:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:17:40.473521 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e4d6f-480e-4b30-809e-401a9832e14f None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:40.596522 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e4d6f-480e-4b30-809e-401a9832e14f None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:40.632250 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb15f0b-2ef3-4603-87b4-df5147f4ebb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:40.632930 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb15f0b-2ef3-4603-87b4-df5147f4ebb7 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:40.633211 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb15f0b-2ef3-4603-87b4-df5147f4ebb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:40.633482 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb15f0b-2ef3-4603-87b4-df5147f4ebb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:40.644841 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb15f0b-2ef3-4603-87b4-df5147f4ebb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:40.646306 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb15f0b-2ef3-4603-87b4-df5147f4ebb7 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:40.661216 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-6cb15f0b-2ef3-4603-87b4-df5147f4ebb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:17:40.661216 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:17:40.661216 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:17:40.661216 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:17:40.661216 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:17:40.661216 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:17:40.661216 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:17:40.661216 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:17:40.661216 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:17:40.661216 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:17:40.661216 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:17:40.661216 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:17:40.661216 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:17:40.661216 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:17:40.661216 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:17:40.661216 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:17:40.662392 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:17:40.662392 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:17:40.662392 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:17:40.662392 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:17:40.662392 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:17:40.662392 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:17:40.662392 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:17:40.662392 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:17:40.662392 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:17:40.662392 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:17:40.662392 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:17:40.662392 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:17:40.662392 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:17:40.662392 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:17:40.662392 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:17:40.662392 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:17:40.662392 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:17:40.663308 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:17:40.663308 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:17:40.663308 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:17:40.663308 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 641/1269] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:17:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:17:40.668622 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b718bc-1dea-4745-a710-5f74ab88318d None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:40.781779 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b718bc-1dea-4745-a710-5f74ab88318d None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:40.820476 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a833f8b1-cc57-4d18-90d9-88ef17562737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:40.821075 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833f8b1-cc57-4d18-90d9-88ef17562737 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:40.821349 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833f8b1-cc57-4d18-90d9-88ef17562737 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:40.821615 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833f8b1-cc57-4d18-90d9-88ef17562737 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:40.822245 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a833f8b1-cc57-4d18-90d9-88ef17562737 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:17:40.822543 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a833f8b1-cc57-4d18-90d9-88ef17562737 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:40.823962 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a833f8b1-cc57-4d18-90d9-88ef17562737 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:40.836663 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 629/1270] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:17:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:17:40.843684 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb15f0b-2ef3-4603-87b4-df5147f4ebb7 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:40.881278 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:40.958910 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb15f0b-2ef3-4603-87b4-df5147f4ebb7 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:40.997019 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef2783-8fb6-46b3-8715-224ca94c3d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:40.997663 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef2783-8fb6-46b3-8715-224ca94c3d29 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:40.997938 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef2783-8fb6-46b3-8715-224ca94c3d29 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:40.998206 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef2783-8fb6-46b3-8715-224ca94c3d29 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:41.005373 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef2783-8fb6-46b3-8715-224ca94c3d29 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:41.006830 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef2783-8fb6-46b3-8715-224ca94c3d29 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:41.018964 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-12ef2783-8fb6-46b3-8715-224ca94c3d29 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:17:41.018964 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:17:41.018964 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:17:41.018964 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:17:41.018964 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:17:41.018964 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:17:41.018964 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:17:41.018964 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:17:41.018964 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:17:41.018964 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:17:41.018964 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:17:41.018964 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:17:41.018964 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:17:41.018964 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:17:41.018964 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:17:41.020138 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:17:41.020138 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:17:41.020138 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:17:41.020138 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:17:41.020138 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:17:41.020138 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:17:41.020138 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:17:41.020138 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:17:41.020138 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:17:41.020138 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:17:41.020138 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:17:41.020138 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:17:41.020138 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:17:41.020138 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:17:41.020138 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:17:41.020138 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:17:41.020138 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:17:41.021270 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:17:41.021270 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:17:41.021270 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:17:41.021270 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:17:41.021270 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:17:41.021270 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:17:41.021270 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:17:41.021270 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:17:41.021270 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 642/1271] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Aug 29 22:17:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:17:41.026468 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a833f8b1-cc57-4d18-90d9-88ef17562737 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:41.095401 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:41.153178 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a833f8b1-cc57-4d18-90d9-88ef17562737 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:41.189090 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dbdb25-235d-44f8-9af9-0e73c2c58ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:41.189705 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dbdb25-235d-44f8-9af9-0e73c2c58ece None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:41.189987 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dbdb25-235d-44f8-9af9-0e73c2c58ece None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:41.190262 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dbdb25-235d-44f8-9af9-0e73c2c58ece None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:41.190957 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dbdb25-235d-44f8-9af9-0e73c2c58ece None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:17:41.191266 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dbdb25-235d-44f8-9af9-0e73c2c58ece None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:41.192737 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dbdb25-235d-44f8-9af9-0e73c2c58ece None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:41.204838 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 630/1272] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Aug 29 22:17:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:17:41.213878 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef2783-8fb6-46b3-8715-224ca94c3d29 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:41.326654 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:41.338264 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef2783-8fb6-46b3-8715-224ca94c3d29 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:41.373681 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e723cc8b-aea4-4bdb-b151-39ede55c27fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:41.374285 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723cc8b-aea4-4bdb-b151-39ede55c27fd None admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:41.374560 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723cc8b-aea4-4bdb-b151-39ede55c27fd None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:41.374828 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723cc8b-aea4-4bdb-b151-39ede55c27fd None admin] PATH_INFO: `/v3/projects/696ed25cc0cb43fab4bfaf762a90da54/users/bce3d9397cca4ae58e14c8a5ae844f8e/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:41.376868 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e723cc8b-aea4-4bdb-b151-39ede55c27fd None admin] RBAC: Authorizing `identity:create_grant(project_id=696ed25cc0cb43fab4bfaf762a90da54, user_id=bce3d9397cca4ae58e14c8a5ae844f8e, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:41.378418 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e723cc8b-aea4-4bdb-b151-39ede55c27fd None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:41.394668 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 643/1273] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Aug 29 22:17:41 2022] PUT /identity/v3/projects/696ed25cc0cb43fab4bfaf762a90da54/users/bce3d9397cca4ae58e14c8a5ae844f8e/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:17:43.309400 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d193c5f-9eff-47c0-926b-5df39b131c90 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:43.310106 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d193c5f-9eff-47c0-926b-5df39b131c90 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:43.310106 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d193c5f-9eff-47c0-926b-5df39b131c90 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:43.311446 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 631/1274] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:17:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:17:43.318127 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88cb96a-5f38-49d8-b2a8-7a4006a4720d None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:43.318772 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88cb96a-5f38-49d8-b2a8-7a4006a4720d None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:43.318935 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88cb96a-5f38-49d8-b2a8-7a4006a4720d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:43.343832 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-f88cb96a-5f38-49d8-b2a8-7a4006a4720d None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:17:43.345097 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f88cb96a-5f38-49d8-b2a8-7a4006a4720d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:17:43.432616 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 644/1275] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:17:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:17:43.695021 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d193c5f-9eff-47c0-926b-5df39b131c90 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:43.804637 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d193c5f-9eff-47c0-926b-5df39b131c90 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:43.822143 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:43.841351 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b008be9d-854c-400c-9b10-5cca9604c743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:43.841976 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008be9d-854c-400c-9b10-5cca9604c743 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:43.842248 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008be9d-854c-400c-9b10-5cca9604c743 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:43.842516 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008be9d-854c-400c-9b10-5cca9604c743 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:43.852944 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b008be9d-854c-400c-9b10-5cca9604c743 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:17:43.857882 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-b008be9d-854c-400c-9b10-5cca9604c743 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:17:43.857882 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:17:43.857882 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:17:43.857882 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:17:43.857882 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:17:43.857882 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:17:43.857882 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:17:43.857882 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:17:43.857882 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:17:43.857882 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:17:43.857882 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:17:43.857882 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:17:43.857882 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:17:43.857882 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:17:43.857882 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:17:43.857882 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:17:43.858894 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:17:43.858894 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:17:43.858894 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:17:43.858894 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:17:43.858894 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:17:43.858894 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:17:43.858894 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:17:43.858894 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:17:43.858894 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:17:43.858894 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:17:43.858894 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:17:43.858894 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:17:43.858894 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:17:43.858894 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:17:43.858894 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:17:43.858894 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:17:43.859762 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:17:43.859762 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:17:43.859762 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:17:43.859762 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:17:43.859762 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:17:43.859762 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:17:43.859762 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:17:43.859762 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:17:43.859762 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:17:43.859762 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:17:43.859762 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:17:43.859762 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:17:43.859762 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 632/1276] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Aug 29 22:17:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:17:43.865528 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88cb96a-5f38-49d8-b2a8-7a4006a4720d None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:43.950364 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:43.970620 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88cb96a-5f38-49d8-b2a8-7a4006a4720d None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:44.011433 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c1b031-0a5f-4ea7-bffa-be784f43c797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:44.012165 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1b031-0a5f-4ea7-bffa-be784f43c797 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:44.012485 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1b031-0a5f-4ea7-bffa-be784f43c797 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:44.012758 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1b031-0a5f-4ea7-bffa-be784f43c797 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:44.013421 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c1b031-0a5f-4ea7-bffa-be784f43c797 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:17:44.013717 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c1b031-0a5f-4ea7-bffa-be784f43c797 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:44.015097 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c1b031-0a5f-4ea7-bffa-be784f43c797 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:44.023841 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 645/1277] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Aug 29 22:17:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:17:44.030642 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b008be9d-854c-400c-9b10-5cca9604c743 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:44.141798 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b008be9d-854c-400c-9b10-5cca9604c743 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:44.179894 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be7cd78-f1b5-406a-a0c0-6283d86b57e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:44.180561 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7cd78-f1b5-406a-a0c0-6283d86b57e7 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:44.180831 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7cd78-f1b5-406a-a0c0-6283d86b57e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:44.181105 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7cd78-f1b5-406a-a0c0-6283d86b57e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:44.191974 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be7cd78-f1b5-406a-a0c0-6283d86b57e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:44.193473 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be7cd78-f1b5-406a-a0c0-6283d86b57e7 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:44.209547 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-9be7cd78-f1b5-406a-a0c0-6283d86b57e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:17:44.209547 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:17:44.209547 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:17:44.209547 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:17:44.209547 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:17:44.209547 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:17:44.209547 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:17:44.209547 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:17:44.209547 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:17:44.209547 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:17:44.209547 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:17:44.209547 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:17:44.209547 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:17:44.209547 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:17:44.209547 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:17:44.209547 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:17:44.210658 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:17:44.210658 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:17:44.210658 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:17:44.210658 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:17:44.210658 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:17:44.210658 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:17:44.210658 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:17:44.210658 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:17:44.210658 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:17:44.210658 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:17:44.210658 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:17:44.210658 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:17:44.210658 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:17:44.210658 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:17:44.210658 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:17:44.210658 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:17:44.210658 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:17:44.211897 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:17:44.211897 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:17:44.211897 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:17:44.211897 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 633/1278] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:17:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:17:44.217717 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c1b031-0a5f-4ea7-bffa-be784f43c797 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:44.333489 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c1b031-0a5f-4ea7-bffa-be784f43c797 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:44.374488 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75cc5f-c063-455e-9107-af4f722ab37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:44.375115 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75cc5f-c063-455e-9107-af4f722ab37a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:44.375403 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75cc5f-c063-455e-9107-af4f722ab37a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:44.375677 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75cc5f-c063-455e-9107-af4f722ab37a None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:44.376333 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e75cc5f-c063-455e-9107-af4f722ab37a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:17:44.376670 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e75cc5f-c063-455e-9107-af4f722ab37a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:44.378054 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e75cc5f-c063-455e-9107-af4f722ab37a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:44.390924 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 646/1279] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:17:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:17:44.397232 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be7cd78-f1b5-406a-a0c0-6283d86b57e7 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:44.429943 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:44.503679 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be7cd78-f1b5-406a-a0c0-6283d86b57e7 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:44.542573 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a35623f-4f09-4600-93f9-e5bd073332fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:44.543234 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a35623f-4f09-4600-93f9-e5bd073332fb None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:44.543514 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a35623f-4f09-4600-93f9-e5bd073332fb None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:44.543789 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a35623f-4f09-4600-93f9-e5bd073332fb None admin] PATH_INFO: `/v3/users/placement` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:44.551082 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a35623f-4f09-4600-93f9-e5bd073332fb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:44.552552 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a35623f-4f09-4600-93f9-e5bd073332fb None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:44.563593 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-4a35623f-4f09-4600-93f9-e5bd073332fb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 22:17:44.563593 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:17:44.563593 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:17:44.563593 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:17:44.563593 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:17:44.563593 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:17:44.563593 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:17:44.563593 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:17:44.563593 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:17:44.563593 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:17:44.563593 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:17:44.563593 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:17:44.563593 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:17:44.563593 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:17:44.563593 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:17:44.563593 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:17:44.564731 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:17:44.564731 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:17:44.564731 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:17:44.564731 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:17:44.564731 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:17:44.564731 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:17:44.564731 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:17:44.564731 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:17:44.564731 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:17:44.564731 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:17:44.564731 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:17:44.564731 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:17:44.564731 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:17:44.564731 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:17:44.564731 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:17:44.564731 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:17:44.564731 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:17:44.564731 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:17:44.565946 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:17:44.565946 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:17:44.565946 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:17:44.565946 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:17:44.565946 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:17:44.565946 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:17:44.565946 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:17:44.565946 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:17:44.565946 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 22:17:44.565946 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:17:44.568653 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 634/1280] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:17:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:17:44.571396 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75cc5f-c063-455e-9107-af4f722ab37a None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:44.576770 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:44.688215 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75cc5f-c063-455e-9107-af4f722ab37a None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:44.731208 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06dfe88-be1b-434d-b1f8-999b44a1330f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:44.732227 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06dfe88-be1b-434d-b1f8-999b44a1330f None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:44.732732 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06dfe88-be1b-434d-b1f8-999b44a1330f None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:44.733238 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06dfe88-be1b-434d-b1f8-999b44a1330f None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:44.734296 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06dfe88-be1b-434d-b1f8-999b44a1330f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:17:44.734739 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06dfe88-be1b-434d-b1f8-999b44a1330f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:44.737082 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06dfe88-be1b-434d-b1f8-999b44a1330f None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:44.758706 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 647/1281] 10.222.0.36 () {56 vars in 1143 bytes} [Mon Aug 29 22:17:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:17:44.765501 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a35623f-4f09-4600-93f9-e5bd073332fb None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:44.866205 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:44.877519 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a35623f-4f09-4600-93f9-e5bd073332fb None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:44.915943 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae83f55-2b52-4645-bd75-2e8668443a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:44.916594 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae83f55-2b52-4645-bd75-2e8668443a3f None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:44.916875 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae83f55-2b52-4645-bd75-2e8668443a3f None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:44.917151 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae83f55-2b52-4645-bd75-2e8668443a3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:44.989981 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae83f55-2b52-4645-bd75-2e8668443a3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:44.991436 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae83f55-2b52-4645-bd75-2e8668443a3f None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:45.089239 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:45.101486 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 635/1282] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Aug 29 22:17:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 22:17:45.108420 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06dfe88-be1b-434d-b1f8-999b44a1330f None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:45.187089 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:45.225824 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06dfe88-be1b-434d-b1f8-999b44a1330f None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:45.262816 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b6eb3-079e-4b96-ad39-fffde5e0306a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:45.263449 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b6eb3-079e-4b96-ad39-fffde5e0306a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:45.263724 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b6eb3-079e-4b96-ad39-fffde5e0306a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:45.263994 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b6eb3-079e-4b96-ad39-fffde5e0306a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:45.275295 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b6eb3-079e-4b96-ad39-fffde5e0306a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:45.276764 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b6eb3-079e-4b96-ad39-fffde5e0306a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:45.291943 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-661b6eb3-079e-4b96-ad39-fffde5e0306a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:17:45.291943 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:17:45.291943 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:17:45.291943 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:17:45.291943 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:17:45.291943 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:17:45.291943 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:17:45.291943 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:17:45.291943 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:17:45.291943 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:17:45.291943 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:17:45.291943 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:17:45.291943 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:17:45.291943 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:17:45.291943 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:17:45.291943 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:17:45.293446 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:17:45.293446 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:17:45.293446 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:17:45.293446 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:17:45.293446 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:17:45.293446 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:17:45.293446 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:17:45.293446 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:17:45.293446 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:17:45.293446 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:17:45.293446 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:17:45.293446 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:17:45.293446 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:17:45.293446 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:17:45.293446 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:17:45.293446 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:17:45.293446 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:17:45.294634 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:17:45.294634 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:17:45.294634 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:17:45.294634 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 648/1283] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:17:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:17:45.299807 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae83f55-2b52-4645-bd75-2e8668443a3f None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:45.424280 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae83f55-2b52-4645-bd75-2e8668443a3f None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:45.461305 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4d226-6e49-417f-a02e-a9eee465fb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:45.461910 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4d226-6e49-417f-a02e-a9eee465fb6d None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:45.462193 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4d226-6e49-417f-a02e-a9eee465fb6d None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:45.462466 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4d226-6e49-417f-a02e-a9eee465fb6d None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:45.463105 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde4d226-6e49-417f-a02e-a9eee465fb6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:17:45.463407 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde4d226-6e49-417f-a02e-a9eee465fb6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:45.465031 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde4d226-6e49-417f-a02e-a9eee465fb6d None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:45.476709 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 636/1284] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Aug 29 22:17:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:17:45.486300 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b6eb3-079e-4b96-ad39-fffde5e0306a None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:45.610052 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b6eb3-079e-4b96-ad39-fffde5e0306a None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:45.625512 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:45.658069 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f70d03-e72b-41bd-a0ea-d156c95810e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:45.658706 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f70d03-e72b-41bd-a0ea-d156c95810e3 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:45.658990 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f70d03-e72b-41bd-a0ea-d156c95810e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:45.659263 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f70d03-e72b-41bd-a0ea-d156c95810e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:45.666458 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f70d03-e72b-41bd-a0ea-d156c95810e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:45.668051 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f70d03-e72b-41bd-a0ea-d156c95810e3 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:45.681714 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-29f70d03-e72b-41bd-a0ea-d156c95810e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:17:45.681714 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:17:45.681714 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:17:45.681714 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:17:45.681714 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:17:45.681714 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:17:45.681714 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:17:45.681714 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:17:45.681714 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:17:45.681714 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:17:45.681714 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:17:45.681714 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:17:45.681714 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:17:45.681714 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:17:45.681714 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:17:45.682789 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:17:45.682789 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:17:45.682789 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:17:45.682789 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:17:45.682789 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:17:45.682789 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:17:45.682789 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:17:45.682789 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:17:45.682789 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 29 22:17:45.682789 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:17:45.682789 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:17:45.682789 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:17:45.682789 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:17:45.682789 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:17:45.682789 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:17:45.682789 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:17:45.682789 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:17:45.689574 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:17:45.689574 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:17:45.689574 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:17:45.689574 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:17:45.689574 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:17:45.689574 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:17:45.689574 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:17:45.689574 dv-cinder-854268-3-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 29 22:17:45.689574 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 649/1285] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Aug 29 22:17:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:17:45.691465 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4d226-6e49-417f-a02e-a9eee465fb6d None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:45.747646 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:45.801995 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4d226-6e49-417f-a02e-a9eee465fb6d None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:45.837507 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683640c-5fba-4bd7-beb8-8634eb2efb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:45.838113 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683640c-5fba-4bd7-beb8-8634eb2efb60 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:45.838389 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683640c-5fba-4bd7-beb8-8634eb2efb60 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:45.838628 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683640c-5fba-4bd7-beb8-8634eb2efb60 None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:45.839332 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4683640c-5fba-4bd7-beb8-8634eb2efb60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:17:45.839627 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4683640c-5fba-4bd7-beb8-8634eb2efb60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:45.841267 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4683640c-5fba-4bd7-beb8-8634eb2efb60 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:45.853431 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 637/1286] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Aug 29 22:17:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:17:45.860147 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f70d03-e72b-41bd-a0ea-d156c95810e3 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:45.976186 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f70d03-e72b-41bd-a0ea-d156c95810e3 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:46.016918 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8454490e-1197-4d3a-ba93-0346e5c85eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:46.017527 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454490e-1197-4d3a-ba93-0346e5c85eae None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:46.017808 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454490e-1197-4d3a-ba93-0346e5c85eae None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:46.018079 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454490e-1197-4d3a-ba93-0346e5c85eae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:46.018815 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8454490e-1197-4d3a-ba93-0346e5c85eae None admin] RBAC: Adding query filter params (role.id=ff59a239a50b4bd899a83bf3c3fd1f63, scope.project.id=696ed25cc0cb43fab4bfaf762a90da54, user.id=bce3d9397cca4ae58e14c8a5ae844f8e) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:17:46.019132 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8454490e-1197-4d3a-ba93-0346e5c85eae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:46.020634 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8454490e-1197-4d3a-ba93-0346e5c85eae None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:46.026945 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 650/1287] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Aug 29 22:17:45 2022] GET /identity/v3/role_assignments?user.id=bce3d9397cca4ae58e14c8a5ae844f8e&scope.project.id=696ed25cc0cb43fab4bfaf762a90da54&role.id=ff59a239a50b4bd899a83bf3c3fd1f63 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:17:47.949640 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ffaaa-7096-493c-a0f8-46fac6655f93 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:47.950170 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ffaaa-7096-493c-a0f8-46fac6655f93 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:47.950170 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ffaaa-7096-493c-a0f8-46fac6655f93 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:47.952052 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 638/1288] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:17:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:17:47.961414 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6100f4de-0485-4de9-b225-2aa9e57325dc None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:47.962132 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6100f4de-0485-4de9-b225-2aa9e57325dc None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:47.962288 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6100f4de-0485-4de9-b225-2aa9e57325dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:47.983628 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-6100f4de-0485-4de9-b225-2aa9e57325dc None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:17:47.984921 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-6100f4de-0485-4de9-b225-2aa9e57325dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:17:48.019198 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:48.064949 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 651/1289] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:17:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:17:48.341507 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ffaaa-7096-493c-a0f8-46fac6655f93 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:48.455855 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ffaaa-7096-493c-a0f8-46fac6655f93 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:48.466409 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:48.491841 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca99e25-b72e-46f9-bc10-e2c8d46e0ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:48.492488 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca99e25-b72e-46f9-bc10-e2c8d46e0ac2 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:48.492776 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca99e25-b72e-46f9-bc10-e2c8d46e0ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:48.493050 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca99e25-b72e-46f9-bc10-e2c8d46e0ac2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:48.493631 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca99e25-b72e-46f9-bc10-e2c8d46e0ac2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:48.495002 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca99e25-b72e-46f9-bc10-e2c8d46e0ac2 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:48.504271 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-aca99e25-b72e-46f9-bc10-e2c8d46e0ac2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 22:17:48.504271 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:17:48.504271 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:17:48.504271 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:17:48.504271 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:17:48.504271 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:17:48.504271 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:17:48.504271 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:17:48.504271 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 22:17:48.504271 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:17:48.504271 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:17:48.504271 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:17:48.504271 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:17:48.504271 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:17:48.504271 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:17:48.504271 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:17:48.504271 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:17:48.505482 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:17:48.505482 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:17:48.505482 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:17:48.505482 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:17:48.505482 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:17:48.505482 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:17:48.505482 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:17:48.505482 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:17:48.505482 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:17:48.505482 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:17:48.505482 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:17:48.505482 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:17:48.505482 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:17:48.505482 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:17:48.505482 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:17:48.505482 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:17:48.506544 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:17:48.506544 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:17:48.506544 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:17:48.506544 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:17:48.506544 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:17:48.506544 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:17:48.506544 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:17:48.506544 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:17:48.506544 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:17:48.506544 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:17:48.506544 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:17:48.506544 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:17:48.506544 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 22:17:48.506544 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:17:48.506544 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 639/1290] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Aug 29 22:17:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:17:48.511666 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6100f4de-0485-4de9-b225-2aa9e57325dc None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:48.615939 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6100f4de-0485-4de9-b225-2aa9e57325dc None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:48.650721 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4abb885-bce2-4bc8-9e0d-429f7eb65a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:48.651327 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4abb885-bce2-4bc8-9e0d-429f7eb65a79 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:48.651603 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4abb885-bce2-4bc8-9e0d-429f7eb65a79 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:48.651873 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4abb885-bce2-4bc8-9e0d-429f7eb65a79 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:48.652558 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4abb885-bce2-4bc8-9e0d-429f7eb65a79 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:17:48.652885 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4abb885-bce2-4bc8-9e0d-429f7eb65a79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:48.654245 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4abb885-bce2-4bc8-9e0d-429f7eb65a79 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:48.659126 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 652/1291] 10.222.0.36 () {56 vars in 1116 bytes} [Mon Aug 29 22:17:48 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:17:48.665149 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca99e25-b72e-46f9-bc10-e2c8d46e0ac2 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:48.773217 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca99e25-b72e-46f9-bc10-e2c8d46e0ac2 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:48.808469 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db19a9-761b-4afe-b0f1-c9d5ecbd3076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:48.809373 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db19a9-761b-4afe-b0f1-c9d5ecbd3076 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:48.809645 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db19a9-761b-4afe-b0f1-c9d5ecbd3076 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:48.809921 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db19a9-761b-4afe-b0f1-c9d5ecbd3076 None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:48.810545 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44db19a9-761b-4afe-b0f1-c9d5ecbd3076 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:17:48.810935 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44db19a9-761b-4afe-b0f1-c9d5ecbd3076 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:48.812323 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44db19a9-761b-4afe-b0f1-c9d5ecbd3076 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:48.817326 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 640/1292] 10.222.0.36 () {56 vars in 1116 bytes} [Mon Aug 29 22:17:48 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:17:50.754531 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d222fde-2e7d-4ff0-9023-d7f2fae43b75 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:50.755347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d222fde-2e7d-4ff0-9023-d7f2fae43b75 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:50.755347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d222fde-2e7d-4ff0-9023-d7f2fae43b75 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:50.757415 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 653/1293] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:17:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:17:50.766818 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f8a70-e76f-48a0-9b69-9f0e65f98a37 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:50.767255 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f8a70-e76f-48a0-9b69-9f0e65f98a37 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:50.767389 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f8a70-e76f-48a0-9b69-9f0e65f98a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:50.790581 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-109f8a70-e76f-48a0-9b69-9f0e65f98a37 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:17:50.791770 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-109f8a70-e76f-48a0-9b69-9f0e65f98a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:17:50.825074 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:50.873273 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 641/1294] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:17:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:17:51.137342 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d222fde-2e7d-4ff0-9023-d7f2fae43b75 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:51.180903 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:51.262252 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d222fde-2e7d-4ff0-9023-d7f2fae43b75 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:51.298950 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b104930e-9e84-4847-9d1a-16805bf0ad32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:51.299696 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104930e-9e84-4847-9d1a-16805bf0ad32 None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:51.299977 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104930e-9e84-4847-9d1a-16805bf0ad32 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:51.300280 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104930e-9e84-4847-9d1a-16805bf0ad32 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:51.301093 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b104930e-9e84-4847-9d1a-16805bf0ad32 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:51.302699 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b104930e-9e84-4847-9d1a-16805bf0ad32 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:51.324793 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 654/1295] 10.222.0.36 () {60 vars in 1141 bytes} [Mon Aug 29 22:17:51 2022] POST /identity/v3/services => generated 246 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:17:53.226379 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13510e5-49a7-4b3a-81f1-201738d7a14d None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:53.227207 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13510e5-49a7-4b3a-81f1-201738d7a14d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:53.227207 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13510e5-49a7-4b3a-81f1-201738d7a14d None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:53.229300 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 642/1296] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:17:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:17:53.238082 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64209f-5968-4ce9-a72b-842d57f4c16e None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:53.238831 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64209f-5968-4ce9-a72b-842d57f4c16e None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:53.238997 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64209f-5968-4ce9-a72b-842d57f4c16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:53.261623 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-3b64209f-5968-4ce9-a72b-842d57f4c16e None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:17:53.263039 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-3b64209f-5968-4ce9-a72b-842d57f4c16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:17:53.346578 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 655/1297] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:17:53 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:17:53.617445 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13510e5-49a7-4b3a-81f1-201738d7a14d None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:53.734672 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13510e5-49a7-4b3a-81f1-201738d7a14d None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:53.774239 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9daaa53-2893-4d18-81b3-71d4717be8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:53.774861 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9daaa53-2893-4d18-81b3-71d4717be8b5 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:53.775137 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9daaa53-2893-4d18-81b3-71d4717be8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:53.775407 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9daaa53-2893-4d18-81b3-71d4717be8b5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:53.775986 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9daaa53-2893-4d18-81b3-71d4717be8b5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:53.777424 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9daaa53-2893-4d18-81b3-71d4717be8b5 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:53.786509 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-a9daaa53-2893-4d18-81b3-71d4717be8b5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 22:17:53.786509 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:17:53.786509 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:17:53.786509 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:17:53.786509 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:17:53.786509 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:17:53.786509 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:17:53.786509 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:17:53.786509 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 22:17:53.786509 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:17:53.786509 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:17:53.786509 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:17:53.786509 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:17:53.786509 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:17:53.786509 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:17:53.786509 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:17:53.786509 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:17:53.787587 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:17:53.787587 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:17:53.787587 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:17:53.787587 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:17:53.787587 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:17:53.787587 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:17:53.787587 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:17:53.787587 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:17:53.787587 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:17:53.787587 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:17:53.787587 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:17:53.787587 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:17:53.787587 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:17:53.787587 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:17:53.787587 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:17:53.787587 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:17:53.788488 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:17:53.788488 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:17:53.788488 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:17:53.788488 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:17:53.788488 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:17:53.788488 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:17:53.788488 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:17:53.788488 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:17:53.788488 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:17:53.788488 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:17:53.788488 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:17:53.788488 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:17:53.788488 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 22:17:53.788488 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:17:53.788488 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 643/1298] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Aug 29 22:17:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:17:53.794272 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b64209f-5968-4ce9-a72b-842d57f4c16e None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:53.819286 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:53.907103 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b64209f-5968-4ce9-a72b-842d57f4c16e None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:53.945654 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71486ddd-820e-413f-9a3e-288ecf35e574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:53.946254 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71486ddd-820e-413f-9a3e-288ecf35e574 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:53.946530 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71486ddd-820e-413f-9a3e-288ecf35e574 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:53.946802 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71486ddd-820e-413f-9a3e-288ecf35e574 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:53.947435 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71486ddd-820e-413f-9a3e-288ecf35e574 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:17:53.947743 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71486ddd-820e-413f-9a3e-288ecf35e574 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:53.949329 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71486ddd-820e-413f-9a3e-288ecf35e574 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:53.955079 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 656/1299] 10.222.0.36 () {56 vars in 1116 bytes} [Mon Aug 29 22:17:53 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:17:53.965352 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9daaa53-2893-4d18-81b3-71d4717be8b5 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:53.999986 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:54.078232 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9daaa53-2893-4d18-81b3-71d4717be8b5 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:54.114827 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195764e2-1ffd-42ad-ae8c-4c1b07c70be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:54.115432 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195764e2-1ffd-42ad-ae8c-4c1b07c70be2 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:54.115713 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195764e2-1ffd-42ad-ae8c-4c1b07c70be2 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:54.115985 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195764e2-1ffd-42ad-ae8c-4c1b07c70be2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:54.116720 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195764e2-1ffd-42ad-ae8c-4c1b07c70be2 None admin] RBAC: Adding query filter params (interface=public, service_id=34f646c6d5b046a7b71d838f86799f6c, region_id=RegionOne) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:17:54.117038 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195764e2-1ffd-42ad-ae8c-4c1b07c70be2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:54.118431 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195764e2-1ffd-42ad-ae8c-4c1b07c70be2 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:54.123794 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 644/1300] 10.222.0.36 () {56 vars in 1251 bytes} [Mon Aug 29 22:17:53 2022] GET /identity/v3/endpoints?service_id=34f646c6d5b046a7b71d838f86799f6c&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:17:54.129935 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71486ddd-820e-413f-9a3e-288ecf35e574 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:54.217951 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:54.241329 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71486ddd-820e-413f-9a3e-288ecf35e574 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:54.279596 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f276b49e-7e1d-4b05-9d7f-0014c70c2c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:54.280221 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f276b49e-7e1d-4b05-9d7f-0014c70c2c6b None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:54.280495 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f276b49e-7e1d-4b05-9d7f-0014c70c2c6b None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:54.280804 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f276b49e-7e1d-4b05-9d7f-0014c70c2c6b None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:54.281420 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f276b49e-7e1d-4b05-9d7f-0014c70c2c6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:54.282831 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f276b49e-7e1d-4b05-9d7f-0014c70c2c6b None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:54.290419 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 657/1301] 10.222.0.36 () {56 vars in 1087 bytes} [Mon Aug 29 22:17:54 2022] GET /identity/v3/services => generated 2191 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:17:56.202453 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef4b59-17eb-4d14-8ee9-21693ee64082 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:56.202980 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef4b59-17eb-4d14-8ee9-21693ee64082 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:56.202980 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef4b59-17eb-4d14-8ee9-21693ee64082 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:56.204243 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 645/1302] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:17:56.212962 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cccfeab-d45c-424b-baf1-1652e9850d64 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:56.213387 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cccfeab-d45c-424b-baf1-1652e9850d64 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:56.213523 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cccfeab-d45c-424b-baf1-1652e9850d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:56.233537 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-9cccfeab-d45c-424b-baf1-1652e9850d64 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:17:56.234731 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-9cccfeab-d45c-424b-baf1-1652e9850d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:17:56.307342 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 658/1303] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:17:56 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:17:56.581096 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef4b59-17eb-4d14-8ee9-21693ee64082 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:56.698262 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:56.706379 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef4b59-17eb-4d14-8ee9-21693ee64082 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:56.746292 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e0266-5cd4-4a1c-aeb2-1507ee6e5ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:56.747080 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e0266-5cd4-4a1c-aeb2-1507ee6e5ce8 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:56.747365 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e0266-5cd4-4a1c-aeb2-1507ee6e5ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:56.747666 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e0266-5cd4-4a1c-aeb2-1507ee6e5ce8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:56.748243 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72e0266-5cd4-4a1c-aeb2-1507ee6e5ce8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:56.749667 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72e0266-5cd4-4a1c-aeb2-1507ee6e5ce8 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:56.758846 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-d72e0266-5cd4-4a1c-aeb2-1507ee6e5ce8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 22:17:56.758846 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:17:56.758846 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:17:56.758846 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:17:56.758846 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:17:56.758846 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:17:56.758846 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:17:56.758846 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:17:56.758846 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 22:17:56.758846 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:17:56.758846 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:17:56.758846 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:17:56.758846 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:17:56.758846 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:17:56.758846 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:17:56.758846 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:17:56.758846 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:17:56.759990 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:17:56.759990 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:17:56.759990 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:17:56.759990 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:17:56.759990 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:17:56.759990 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:17:56.759990 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:17:56.759990 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:17:56.759990 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:17:56.759990 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:17:56.759990 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:17:56.759990 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:17:56.759990 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:17:56.759990 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:17:56.759990 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:17:56.759990 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:17:56.761089 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:17:56.761089 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 29 22:17:56.761089 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:17:56.761089 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:17:56.761089 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:17:56.761089 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:17:56.761089 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:17:56.761089 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:17:56.761089 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:17:56.761089 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:17:56.761089 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:17:56.761089 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:17:56.761089 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 22:17:56.761089 dv-cinder-854268-3-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 29 22:17:56.761089 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 646/1304] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Aug 29 22:17:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:17:56.767610 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cccfeab-d45c-424b-baf1-1652e9850d64 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:56.857771 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:17:56.891153 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cccfeab-d45c-424b-baf1-1652e9850d64 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:56.928386 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48258ba6-5e7b-47c1-b4c7-5922b8a9dc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:56.929049 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48258ba6-5e7b-47c1-b4c7-5922b8a9dc59 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:56.929325 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48258ba6-5e7b-47c1-b4c7-5922b8a9dc59 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:56.929593 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48258ba6-5e7b-47c1-b4c7-5922b8a9dc59 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:56.930220 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48258ba6-5e7b-47c1-b4c7-5922b8a9dc59 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:17:56.930517 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48258ba6-5e7b-47c1-b4c7-5922b8a9dc59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:56.931880 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48258ba6-5e7b-47c1-b4c7-5922b8a9dc59 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:56.937660 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 659/1305] 10.222.0.36 () {56 vars in 1116 bytes} [Mon Aug 29 22:17:56 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:17:56.943968 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e0266-5cd4-4a1c-aeb2-1507ee6e5ce8 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:17:57.059640 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e0266-5cd4-4a1c-aeb2-1507ee6e5ce8 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:17:57.099937 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c257522c-45ff-4d82-9169-7d1198c7efec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:17:57.100569 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257522c-45ff-4d82-9169-7d1198c7efec None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:17:57.100847 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257522c-45ff-4d82-9169-7d1198c7efec None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:17:57.101117 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257522c-45ff-4d82-9169-7d1198c7efec None admin] PATH_INFO: `/v3/endpoints` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:17:57.101776 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c257522c-45ff-4d82-9169-7d1198c7efec None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:17:57.103146 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c257522c-45ff-4d82-9169-7d1198c7efec None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:17:57.125862 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 647/1306] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:17:56 2022] POST /identity/v3/endpoints => generated 331 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:18:06.934471 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=30 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:18:07.121612 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:19:02.587357 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2871ebc6-9cd8-43c4-ae21-7f24fba65ba4 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:19:02.587857 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2871ebc6-9cd8-43c4-ae21-7f24fba65ba4 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:19:02.588181 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2871ebc6-9cd8-43c4-ae21-7f24fba65ba4 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:19:02.605630 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 660/1307] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:19:02 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:19:02.606310 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e6ed0-77c8-46df-b0a1-877ee95fa018 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:19:02.606310 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e6ed0-77c8-46df-b0a1-877ee95fa018 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:19:02.606310 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e6ed0-77c8-46df-b0a1-877ee95fa018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:19:02.733048 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-9c0e6ed0-77c8-46df-b0a1-877ee95fa018 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:19:02.734574 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-9c0e6ed0-77c8-46df-b0a1-877ee95fa018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:19:02.863499 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 648/1308] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:19:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:19:03.165123 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e37892-4a8c-4bc3-8060-c76de5a6cf18 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:19:03.165405 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e37892-4a8c-4bc3-8060-c76de5a6cf18 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:19:03.165937 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e37892-4a8c-4bc3-8060-c76de5a6cf18 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:19:03.167344 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 661/1309] 10.222.0.36 () {54 vars in 965 bytes} [Mon Aug 29 22:19:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:19:03.174458 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918a4d6-b273-49c3-a030-b34994b799f7 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:19:03.174728 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918a4d6-b273-49c3-a030-b34994b799f7 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:19:03.175005 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918a4d6-b273-49c3-a030-b34994b799f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:19:03.272008 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-3918a4d6-b273-49c3-a030-b34994b799f7 None None] MFA Rules not processed for user `204c597d751c420796bd972f10a3d149`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:19:03.273283 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3918a4d6-b273-49c3-a030-b34994b799f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:19:03.297505 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:19:03.364408 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 649/1310] 10.222.0.36 () {58 vars in 1062 bytes} [Mon Aug 29 22:19:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:19:03.373643 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e37892-4a8c-4bc3-8060-c76de5a6cf18 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:19:03.375606 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-39e37892-4a8c-4bc3-8060-c76de5a6cf18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:19:03.513495 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e37892-4a8c-4bc3-8060-c76de5a6cf18 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:19:03.597729 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0fcb0c-1277-4a6c-a497-fadc9b2b3ab4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:19:03.598501 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fcb0c-1277-4a6c-a497-fadc9b2b3ab4 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:19:03.598895 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fcb0c-1277-4a6c-a497-fadc9b2b3ab4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:19:03.599277 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fcb0c-1277-4a6c-a497-fadc9b2b3ab4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:19:03.601062 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-2e0fcb0c-1277-4a6c-a497-fadc9b2b3ab4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:19:03.661263 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:19:03.719758 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0fcb0c-1277-4a6c-a497-fadc9b2b3ab4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:19:03.721361 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0fcb0c-1277-4a6c-a497-fadc9b2b3ab4 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:19:03.742012 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 662/1311] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:19:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:19:05.989486 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4fe2a-e310-4b7b-9f27-79b028da18ca None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:19:05.990072 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4fe2a-e310-4b7b-9f27-79b028da18ca None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:19:05.990072 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4fe2a-e310-4b7b-9f27-79b028da18ca None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:19:05.991415 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 650/1312] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:19:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:19:05.997899 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacfa957-d4a1-4afd-ac70-af1eac23af22 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:19:05.997899 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacfa957-d4a1-4afd-ac70-af1eac23af22 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:19:05.998365 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacfa957-d4a1-4afd-ac70-af1eac23af22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:19:06.097394 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-dacfa957-d4a1-4afd-ac70-af1eac23af22 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:19:06.098711 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-dacfa957-d4a1-4afd-ac70-af1eac23af22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:19:06.201518 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 663/1313] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:19:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:19:06.489807 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da4fe2a-e310-4b7b-9f27-79b028da18ca None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:19:06.491430 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-7da4fe2a-e310-4b7b-9f27-79b028da18ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:19:06.603836 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da4fe2a-e310-4b7b-9f27-79b028da18ca None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:19:06.683109 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:19:06.686262 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451280ce-0180-4086-98f8-a10d9fffcd9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:19:06.686970 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451280ce-0180-4086-98f8-a10d9fffcd9d service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:19:06.687297 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451280ce-0180-4086-98f8-a10d9fffcd9d service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:19:06.687536 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451280ce-0180-4086-98f8-a10d9fffcd9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:19:06.689741 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-451280ce-0180-4086-98f8-a10d9fffcd9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:19:06.814806 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451280ce-0180-4086-98f8-a10d9fffcd9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:19:06.816250 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451280ce-0180-4086-98f8-a10d9fffcd9d service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:19:06.836218 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 651/1314] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:19:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:19:09.122688 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f072f-0fba-4989-a9b0-5565696f34cc None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:19:09.123385 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f072f-0fba-4989-a9b0-5565696f34cc None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:19:09.123385 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f072f-0fba-4989-a9b0-5565696f34cc None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:19:09.124977 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 664/1315] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:19:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:19:09.132172 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445269a-4177-4157-8171-a6909980ae32 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:19:09.132801 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445269a-4177-4157-8171-a6909980ae32 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:19:09.132801 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445269a-4177-4157-8171-a6909980ae32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:19:09.208337 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-b445269a-4177-4157-8171-a6909980ae32 None None] MFA Rules not processed for user `a107bc03b1f041ceb3d4a7e34f3699ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:19:09.209481 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b445269a-4177-4157-8171-a6909980ae32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:19:09.263433 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:19:09.315967 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 652/1316] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:19:09 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:19:09.601492 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f072f-0fba-4989-a9b0-5565696f34cc None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:19:09.603174 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-853f072f-0fba-4989-a9b0-5565696f34cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:19:09.614380 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:19:09.723968 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f072f-0fba-4989-a9b0-5565696f34cc None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:19:09.801804 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f1dfd8-ec38-4c36-a7aa-9e573e55e362 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:19:09.802419 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1dfd8-ec38-4c36-a7aa-9e573e55e362 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:19:09.802694 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1dfd8-ec38-4c36-a7aa-9e573e55e362 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:19:09.802966 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1dfd8-ec38-4c36-a7aa-9e573e55e362 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:19:09.804731 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c3f1dfd8-ec38-4c36-a7aa-9e573e55e362 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:19:09.869030 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:19:09.933447 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f1dfd8-ec38-4c36-a7aa-9e573e55e362 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:19:09.934918 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f1dfd8-ec38-4c36-a7aa-9e573e55e362 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:19:09.955430 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 665/1317] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:19:09 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:19:12.463712 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6acf7-4478-43e5-bab6-f6f0ba5d8761 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:19:12.464628 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6acf7-4478-43e5-bab6-f6f0ba5d8761 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:19:12.464628 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6acf7-4478-43e5-bab6-f6f0ba5d8761 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:19:12.466761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 653/1318] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:19:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:19:12.472286 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d612bf1-ee28-41a9-93fa-d997269ad00c None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:19:12.472785 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d612bf1-ee28-41a9-93fa-d997269ad00c None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:19:12.472878 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d612bf1-ee28-41a9-93fa-d997269ad00c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:19:12.547175 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-2d612bf1-ee28-41a9-93fa-d997269ad00c None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:19:12.549079 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-2d612bf1-ee28-41a9-93fa-d997269ad00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:19:12.654830 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 666/1319] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:19:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:19:12.947384 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6acf7-4478-43e5-bab6-f6f0ba5d8761 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:19:12.949005 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-4cc6acf7-4478-43e5-bab6-f6f0ba5d8761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:19:13.060560 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6acf7-4478-43e5-bab6-f6f0ba5d8761 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:19:13.135634 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47530d8e-9c17-467d-afc2-688b13ffc564 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:19:13.136236 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47530d8e-9c17-467d-afc2-688b13ffc564 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:19:13.136595 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47530d8e-9c17-467d-afc2-688b13ffc564 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:19:13.136865 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47530d8e-9c17-467d-afc2-688b13ffc564 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:19:13.138463 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-47530d8e-9c17-467d-afc2-688b13ffc564 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:19:13.147025 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:19:13.280710 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47530d8e-9c17-467d-afc2-688b13ffc564 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:19:13.282228 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47530d8e-9c17-467d-afc2-688b13ffc564 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:19:13.301975 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 654/1320] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:19:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:19:15.942075 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831a52a-1aac-479a-a799-6eee3f3e62a2 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:19:15.942915 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831a52a-1aac-479a-a799-6eee3f3e62a2 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:19:15.942915 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831a52a-1aac-479a-a799-6eee3f3e62a2 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:19:15.944315 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 667/1321] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:19:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:19:15.950021 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72870539-94f4-4e3e-84b1-4c08770cc913 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:19:15.950503 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72870539-94f4-4e3e-84b1-4c08770cc913 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:19:15.950608 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72870539-94f4-4e3e-84b1-4c08770cc913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:19:16.020476 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-72870539-94f4-4e3e-84b1-4c08770cc913 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:19:16.021692 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-72870539-94f4-4e3e-84b1-4c08770cc913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:19:16.083671 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:19:16.126052 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 655/1322] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:19:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:19:16.420818 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d2311-3034-4247-b47e-cc04c19f5cc0 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:19:16.421088 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d2311-3034-4247-b47e-cc04c19f5cc0 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:19:16.421368 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d2311-3034-4247-b47e-cc04c19f5cc0 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:19:16.423016 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 668/1323] 10.222.0.36 () {54 vars in 965 bytes} [Mon Aug 29 22:19:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:19:16.429374 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63586708-ceb7-4215-a7ce-5c2f13fd4fdf None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:19:16.429730 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63586708-ceb7-4215-a7ce-5c2f13fd4fdf None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:19:16.430112 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63586708-ceb7-4215-a7ce-5c2f13fd4fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:19:16.510574 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-63586708-ceb7-4215-a7ce-5c2f13fd4fdf None None] MFA Rules not processed for user `204c597d751c420796bd972f10a3d149`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:19:16.512051 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-63586708-ceb7-4215-a7ce-5c2f13fd4fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:19:16.595648 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 656/1324] 10.222.0.36 () {58 vars in 1062 bytes} [Mon Aug 29 22:19:16 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:19:16.606428 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d2311-3034-4247-b47e-cc04c19f5cc0 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:19:16.607936 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d75d2311-3034-4247-b47e-cc04c19f5cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:19:16.629291 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:19:16.719266 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d2311-3034-4247-b47e-cc04c19f5cc0 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:19:16.799906 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f904254-e707-4268-b67a-f2aec2ccefe7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:19:16.800558 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f904254-e707-4268-b67a-f2aec2ccefe7 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:19:16.800848 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f904254-e707-4268-b67a-f2aec2ccefe7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:19:16.801098 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f904254-e707-4268-b67a-f2aec2ccefe7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:19:16.802765 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-9f904254-e707-4268-b67a-f2aec2ccefe7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:19:16.886373 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:19:16.950654 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f904254-e707-4268-b67a-f2aec2ccefe7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:19:16.952946 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f904254-e707-4268-b67a-f2aec2ccefe7 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:19:16.972320 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 669/1325] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:19:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:19:19.265241 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e191817-2c36-4879-be87-ba5665a46899 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:19:19.265884 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e191817-2c36-4879-be87-ba5665a46899 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:19:19.265884 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e191817-2c36-4879-be87-ba5665a46899 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:19:19.267342 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 657/1326] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:19:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:19:19.273256 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f140fb-020d-450a-9170-75e8117d1e6d None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:19:19.273740 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f140fb-020d-450a-9170-75e8117d1e6d None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:19:19.273955 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f140fb-020d-450a-9170-75e8117d1e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:19:19.347189 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-84f140fb-020d-450a-9170-75e8117d1e6d None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:19:19.348419 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-84f140fb-020d-450a-9170-75e8117d1e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:19:19.459581 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 670/1327] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:19:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:19:19.740300 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e191817-2c36-4879-be87-ba5665a46899 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:19:19.741972 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3e191817-2c36-4879-be87-ba5665a46899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:19:19.805831 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:19:19.849859 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e191817-2c36-4879-be87-ba5665a46899 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:19:19.926531 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b26536-679c-40ef-9692-e09be6e65fe7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:19:19.927161 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b26536-679c-40ef-9692-e09be6e65fe7 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:19:19.927438 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b26536-679c-40ef-9692-e09be6e65fe7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:19:19.927706 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b26536-679c-40ef-9692-e09be6e65fe7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:19:19.929347 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-35b26536-679c-40ef-9692-e09be6e65fe7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:19:20.045405 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:19:20.048629 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b26536-679c-40ef-9692-e09be6e65fe7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:19:20.050679 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b26536-679c-40ef-9692-e09be6e65fe7 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:19:20.071141 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 658/1328] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:19:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:19:22.029552 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea0cb06-427e-4bb0-83e8-2d20bb1b6dcb None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:19:22.029929 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea0cb06-427e-4bb0-83e8-2d20bb1b6dcb None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:19:22.029929 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea0cb06-427e-4bb0-83e8-2d20bb1b6dcb None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:19:22.035571 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 671/1329] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:19:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:19:22.039166 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49dc1f-8ad3-478c-94ba-eaea29224453 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:19:22.039604 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49dc1f-8ad3-478c-94ba-eaea29224453 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:19:22.039707 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49dc1f-8ad3-478c-94ba-eaea29224453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:19:22.123765 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-5a49dc1f-8ad3-478c-94ba-eaea29224453 None None] MFA Rules not processed for user `a107bc03b1f041ceb3d4a7e34f3699ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:19:22.125018 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-5a49dc1f-8ad3-478c-94ba-eaea29224453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:19:22.240478 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 659/1330] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:19:22 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:19:22.518416 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea0cb06-427e-4bb0-83e8-2d20bb1b6dcb None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:19:22.520301 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-eea0cb06-427e-4bb0-83e8-2d20bb1b6dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:19:22.552169 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:19:22.634217 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea0cb06-427e-4bb0-83e8-2d20bb1b6dcb None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:19:22.715812 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ce943-60e6-4eb7-bfb6-76c96237dbd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:19:22.716436 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ce943-60e6-4eb7-bfb6-76c96237dbd4 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:19:22.716752 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ce943-60e6-4eb7-bfb6-76c96237dbd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:19:22.717026 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ce943-60e6-4eb7-bfb6-76c96237dbd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:19:22.718651 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-431ce943-60e6-4eb7-bfb6-76c96237dbd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:19:22.816086 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:19:22.852746 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431ce943-60e6-4eb7-bfb6-76c96237dbd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:19:22.854299 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431ce943-60e6-4eb7-bfb6-76c96237dbd4 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:19:22.874166 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 672/1331] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:19:22 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:19:25.052913 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2e9ff-fa6b-45ff-814e-5496ddc63d36 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:19:25.053553 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2e9ff-fa6b-45ff-814e-5496ddc63d36 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:19:25.053553 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2e9ff-fa6b-45ff-814e-5496ddc63d36 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:19:25.054839 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 660/1332] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:19:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:19:25.061252 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372bc35-e049-491f-99f2-73646f11c84a None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:19:25.061976 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372bc35-e049-491f-99f2-73646f11c84a None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:19:25.062139 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372bc35-e049-491f-99f2-73646f11c84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:19:25.133395 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-a372bc35-e049-491f-99f2-73646f11c84a None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:19:25.134610 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-a372bc35-e049-491f-99f2-73646f11c84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:19:25.253240 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 673/1333] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:19:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:19:25.534300 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2e9ff-fa6b-45ff-814e-5496ddc63d36 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:19:25.536736 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-dca2e9ff-fa6b-45ff-814e-5496ddc63d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:19:25.620746 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:19:25.660291 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2e9ff-fa6b-45ff-814e-5496ddc63d36 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:19:25.740079 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b223e7-95bd-44f2-bc89-550bcbc6a0dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:19:25.740720 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b223e7-95bd-44f2-bc89-550bcbc6a0dc service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:19:25.740999 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b223e7-95bd-44f2-bc89-550bcbc6a0dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:19:25.741274 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b223e7-95bd-44f2-bc89-550bcbc6a0dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:19:25.742876 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e0b223e7-95bd-44f2-bc89-550bcbc6a0dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:19:25.868199 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b223e7-95bd-44f2-bc89-550bcbc6a0dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:19:25.869775 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b223e7-95bd-44f2-bc89-550bcbc6a0dc service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:19:25.881040 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:19:25.890243 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 661/1334] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:19:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:19:27.845888 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e47ae-cf19-432a-b4d9-7461e6483db2 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:19:27.846852 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e47ae-cf19-432a-b4d9-7461e6483db2 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:19:27.846852 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e47ae-cf19-432a-b4d9-7461e6483db2 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:19:27.849123 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 674/1335] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:19:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:19:27.858149 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e773ea6-60f4-4309-b404-917288c06b99 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:19:27.858910 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e773ea6-60f4-4309-b404-917288c06b99 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:19:27.859045 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e773ea6-60f4-4309-b404-917288c06b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:19:27.937652 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-8e773ea6-60f4-4309-b404-917288c06b99 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:19:27.938985 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-8e773ea6-60f4-4309-b404-917288c06b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:19:28.043032 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 662/1336] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:19:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:19:28.333086 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e47ae-cf19-432a-b4d9-7461e6483db2 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:19:28.335415 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-1e5e47ae-cf19-432a-b4d9-7461e6483db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:19:28.388246 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:19:28.468650 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e47ae-cf19-432a-b4d9-7461e6483db2 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:19:28.549383 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f4c43-24e1-4de0-b01a-183c064944cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:19:28.549995 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f4c43-24e1-4de0-b01a-183c064944cb service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:19:28.550277 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f4c43-24e1-4de0-b01a-183c064944cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:19:28.550548 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f4c43-24e1-4de0-b01a-183c064944cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:19:28.552168 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-e51f4c43-24e1-4de0-b01a-183c064944cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:19:28.647936 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:19:28.674863 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f4c43-24e1-4de0-b01a-183c064944cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:19:28.676334 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f4c43-24e1-4de0-b01a-183c064944cb service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:19:28.695181 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 675/1337] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:19:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:19:31.311191 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc145979-9ded-4bae-9579-b4016217910f None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:19:31.311766 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc145979-9ded-4bae-9579-b4016217910f None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:19:31.311766 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc145979-9ded-4bae-9579-b4016217910f None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:19:31.313199 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 663/1338] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:19:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:19:31.319874 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc47b9c-c747-4f84-83ce-4dcb96fa2624 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:19:31.320561 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc47b9c-c747-4f84-83ce-4dcb96fa2624 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:19:31.320933 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc47b9c-c747-4f84-83ce-4dcb96fa2624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:19:31.398186 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-3fc47b9c-c747-4f84-83ce-4dcb96fa2624 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:19:31.399430 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-3fc47b9c-c747-4f84-83ce-4dcb96fa2624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:19:31.505079 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 676/1339] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:19:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:19:31.798777 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc145979-9ded-4bae-9579-b4016217910f None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:19:31.801377 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-bc145979-9ded-4bae-9579-b4016217910f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:19:31.886375 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:19:31.916213 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc145979-9ded-4bae-9579-b4016217910f None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:19:32.001399 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c6c79-5402-4759-974e-c9b50782e1e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:19:32.001939 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c6c79-5402-4759-974e-c9b50782e1e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:19:32.002221 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c6c79-5402-4759-974e-c9b50782e1e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:19:32.002494 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c6c79-5402-4759-974e-c9b50782e1e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:19:32.004123 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-028c6c79-5402-4759-974e-c9b50782e1e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:19:32.136548 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028c6c79-5402-4759-974e-c9b50782e1e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:19:32.138031 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028c6c79-5402-4759-974e-c9b50782e1e1 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:19:32.158420 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 664/1340] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:19:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:19:36.336915 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443babc-732e-4dbd-be66-417abcef1623 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:19:36.337430 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443babc-732e-4dbd-be66-417abcef1623 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:19:36.337430 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443babc-732e-4dbd-be66-417abcef1623 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:19:36.339114 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 677/1341] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:19:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:19:36.344729 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3bd73c-5444-43df-af00-f8e169ab7eea None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:19:36.345236 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3bd73c-5444-43df-af00-f8e169ab7eea None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:19:36.345319 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3bd73c-5444-43df-af00-f8e169ab7eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:19:36.351035 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:19:36.417157 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-da3bd73c-5444-43df-af00-f8e169ab7eea None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:19:36.418370 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-da3bd73c-5444-43df-af00-f8e169ab7eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:19:36.525641 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 665/1342] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:19:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:19:36.801989 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5443babc-732e-4dbd-be66-417abcef1623 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:19:36.803572 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-5443babc-732e-4dbd-be66-417abcef1623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:19:36.859513 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:19:36.916614 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5443babc-732e-4dbd-be66-417abcef1623 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:19:36.991243 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22871368-ba70-4ff6-814f-fde00998a785 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:19:36.991992 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22871368-ba70-4ff6-814f-fde00998a785 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:19:36.992279 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22871368-ba70-4ff6-814f-fde00998a785 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:19:36.992592 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22871368-ba70-4ff6-814f-fde00998a785 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:19:36.994214 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-22871368-ba70-4ff6-814f-fde00998a785 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:19:37.090426 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:19:37.107204 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22871368-ba70-4ff6-814f-fde00998a785 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:19:37.108682 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22871368-ba70-4ff6-814f-fde00998a785 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:19:37.132810 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 678/1343] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:19:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:19:39.688389 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cbcb35-4ea7-46de-8f9e-691ad4fcd5da None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:19:39.689510 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cbcb35-4ea7-46de-8f9e-691ad4fcd5da None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:19:39.689510 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cbcb35-4ea7-46de-8f9e-691ad4fcd5da None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:19:39.690357 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 666/1344] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:19:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:19:39.696118 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67636258-c986-4c01-89c2-af71b7112509 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:19:39.696681 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67636258-c986-4c01-89c2-af71b7112509 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:19:39.696681 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67636258-c986-4c01-89c2-af71b7112509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:19:39.767620 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-67636258-c986-4c01-89c2-af71b7112509 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:19:39.768880 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-67636258-c986-4c01-89c2-af71b7112509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:19:39.870592 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 679/1345] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:19:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:19:40.149898 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cbcb35-4ea7-46de-8f9e-691ad4fcd5da None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:19:40.151531 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-02cbcb35-4ea7-46de-8f9e-691ad4fcd5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:19:40.242902 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:19:40.262053 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cbcb35-4ea7-46de-8f9e-691ad4fcd5da None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:19:40.349149 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460fcd16-1575-4173-ae7b-85ca2ac548bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:19:40.349687 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460fcd16-1575-4173-ae7b-85ca2ac548bd service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:19:40.349960 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460fcd16-1575-4173-ae7b-85ca2ac548bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:19:40.350232 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460fcd16-1575-4173-ae7b-85ca2ac548bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:19:40.351911 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-460fcd16-1575-4173-ae7b-85ca2ac548bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:19:40.478190 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460fcd16-1575-4173-ae7b-85ca2ac548bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:19:40.479865 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460fcd16-1575-4173-ae7b-85ca2ac548bd service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:19:40.502235 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 667/1346] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:19:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:19:44.714498 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b65f53-53dc-49e5-94a2-8b8f6984eb64 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:19:44.715044 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b65f53-53dc-49e5-94a2-8b8f6984eb64 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:19:44.715044 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b65f53-53dc-49e5-94a2-8b8f6984eb64 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:19:44.716761 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 680/1347] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:19:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:19:44.722704 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d94f05-7f61-4b12-9c3e-37567df40e90 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:19:44.723204 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d94f05-7f61-4b12-9c3e-37567df40e90 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:19:44.723204 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d94f05-7f61-4b12-9c3e-37567df40e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:19:44.740633 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:19:44.800058 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-19d94f05-7f61-4b12-9c3e-37567df40e90 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:19:44.801342 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-19d94f05-7f61-4b12-9c3e-37567df40e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:19:44.916661 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 668/1348] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:19:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:19:45.197000 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b65f53-53dc-49e5-94a2-8b8f6984eb64 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:19:45.198655 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-47b65f53-53dc-49e5-94a2-8b8f6984eb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:19:45.259932 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:19:45.311423 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b65f53-53dc-49e5-94a2-8b8f6984eb64 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:19:45.393022 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55beb953-a367-40dc-9df9-700f833d1e0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:19:45.393627 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55beb953-a367-40dc-9df9-700f833d1e0e service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:19:45.393940 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55beb953-a367-40dc-9df9-700f833d1e0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:19:45.394515 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55beb953-a367-40dc-9df9-700f833d1e0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:19:45.396121 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-55beb953-a367-40dc-9df9-700f833d1e0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:19:45.509964 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:19:45.514747 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55beb953-a367-40dc-9df9-700f833d1e0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:19:45.516279 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55beb953-a367-40dc-9df9-700f833d1e0e service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:19:45.535587 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 681/1349] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:19:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:19:50.554129 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4152f-5e33-4088-a4b6-53f6eadce455 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:19:50.554608 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4152f-5e33-4088-a4b6-53f6eadce455 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:19:50.554689 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4152f-5e33-4088-a4b6-53f6eadce455 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:19:50.556606 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 669/1350] 10.222.0.36 () {54 vars in 921 bytes} [Mon Aug 29 22:19:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:19:50.568478 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a707d-7bb9-4103-bbb1-687d8b750e11 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:19:50.568478 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a707d-7bb9-4103-bbb1-687d8b750e11 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:19:50.568478 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a707d-7bb9-4103-bbb1-687d8b750e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:19:50.659921 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-de0a707d-7bb9-4103-bbb1-687d8b750e11 None None] MFA Rules not processed for user `bce3d9397cca4ae58e14c8a5ae844f8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:19:50.661664 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-de0a707d-7bb9-4103-bbb1-687d8b750e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:19:50.849977 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 682/1351] 10.222.0.36 () {58 vars in 1018 bytes} [Mon Aug 29 22:19:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:19:54.914521 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=59 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:19:55.009089 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391572a-2fc2-41d9-92b8-bbe7b80aa906 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:19:55.009461 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391572a-2fc2-41d9-92b8-bbe7b80aa906 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:19:55.009639 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391572a-2fc2-41d9-92b8-bbe7b80aa906 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:19:55.011143 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 670/1352] 10.222.0.36 () {54 vars in 921 bytes} [Mon Aug 29 22:19:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:19:55.016361 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451b8fd-0b61-458c-b8d5-c1bec9d51a77 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:19:55.017441 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451b8fd-0b61-458c-b8d5-c1bec9d51a77 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:19:55.017933 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451b8fd-0b61-458c-b8d5-c1bec9d51a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:19:55.074911 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:19:55.100338 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-f451b8fd-0b61-458c-b8d5-c1bec9d51a77 None None] MFA Rules not processed for user `bce3d9397cca4ae58e14c8a5ae844f8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:19:55.101964 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f451b8fd-0b61-458c-b8d5-c1bec9d51a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:19:55.216988 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 683/1353] 10.222.0.36 () {58 vars in 1018 bytes} [Mon Aug 29 22:19:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:19:56.630534 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b6eba-e96a-47c2-be8e-b580f99be8fd None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:19:56.631153 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b6eba-e96a-47c2-be8e-b580f99be8fd None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:19:56.631153 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b6eba-e96a-47c2-be8e-b580f99be8fd None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:19:56.632521 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 671/1354] 10.222.0.36 () {54 vars in 921 bytes} [Mon Aug 29 22:19:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:19:56.637681 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a2adf-bda2-429a-a1ea-cffb2484905d None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:19:56.638125 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a2adf-bda2-429a-a1ea-cffb2484905d None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:19:56.638405 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a2adf-bda2-429a-a1ea-cffb2484905d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:19:56.718916 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-026a2adf-bda2-429a-a1ea-cffb2484905d None None] MFA Rules not processed for user `bce3d9397cca4ae58e14c8a5ae844f8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:19:56.720438 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-026a2adf-bda2-429a-a1ea-cffb2484905d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:19:56.762234 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:19:56.833253 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 684/1355] 10.222.0.36 () {58 vars in 1018 bytes} [Mon Aug 29 22:19:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:20:00.102595 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1252b32-1f18-451d-97c3-1ed399db5356 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:00.103194 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1252b32-1f18-451d-97c3-1ed399db5356 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:00.103194 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1252b32-1f18-451d-97c3-1ed399db5356 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:00.104500 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 672/1356] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:20:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:20:00.110122 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ff01e-84f1-4e6a-b8fd-8a35a58a168a None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:00.110564 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ff01e-84f1-4e6a-b8fd-8a35a58a168a None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:00.111096 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ff01e-84f1-4e6a-b8fd-8a35a58a168a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:00.192894 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-a87ff01e-84f1-4e6a-b8fd-8a35a58a168a None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:20:00.194089 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-a87ff01e-84f1-4e6a-b8fd-8a35a58a168a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:00.320995 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 685/1357] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:20:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:20:00.629647 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b18143-b5b8-4865-aead-6c11d9a1bbc2 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:00.630778 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b18143-b5b8-4865-aead-6c11d9a1bbc2 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:00.631294 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b18143-b5b8-4865-aead-6c11d9a1bbc2 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:00.632948 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 673/1358] 10.222.0.36 () {54 vars in 962 bytes} [Mon Aug 29 22:20:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:20:00.641213 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acaad82-3662-41e0-9f58-d53cb09fb19b None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:00.641507 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acaad82-3662-41e0-9f58-d53cb09fb19b None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:00.641891 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acaad82-3662-41e0-9f58-d53cb09fb19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:00.659751 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:20:00.727313 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-1acaad82-3662-41e0-9f58-d53cb09fb19b None None] MFA Rules not processed for user `90b7213b7111456a93e294ce40b95b21`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:20:00.728929 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-1acaad82-3662-41e0-9f58-d53cb09fb19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:00.889921 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 686/1359] 10.222.0.36 () {58 vars in 1059 bytes} [Mon Aug 29 22:20:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:20:00.900467 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b18143-b5b8-4865-aead-6c11d9a1bbc2 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:20:00.902061 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-87b18143-b5b8-4865-aead-6c11d9a1bbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:01.062708 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b18143-b5b8-4865-aead-6c11d9a1bbc2 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:20:01.159767 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:20:01.203359 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ead598-0600-4158-8c84-85ed14c4f2c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b7213b7111456a93e294ce40b95b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:20:01.204080 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ead598-0600-4158-8c84-85ed14c4f2c9 service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:01.204579 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ead598-0600-4158-8c84-85ed14c4f2c9 service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:01.204914 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ead598-0600-4158-8c84-85ed14c4f2c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:01.206538 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a0ead598-0600-4158-8c84-85ed14c4f2c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:01.311080 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ead598-0600-4158-8c84-85ed14c4f2c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:20:01.312745 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ead598-0600-4158-8c84-85ed14c4f2c9 service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:20:01.331420 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 674/1360] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:20:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:20:03.467221 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f052cd-d32f-459a-b077-4157f2c4ca78 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:03.467221 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f052cd-d32f-459a-b077-4157f2c4ca78 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:03.467721 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f052cd-d32f-459a-b077-4157f2c4ca78 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:03.469039 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 687/1361] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:20:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:20:03.474425 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd1433-cd58-4f76-9c0d-7f418f349f83 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:03.474832 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd1433-cd58-4f76-9c0d-7f418f349f83 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:03.474964 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd1433-cd58-4f76-9c0d-7f418f349f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:03.548039 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-9cbd1433-cd58-4f76-9c0d-7f418f349f83 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:20:03.549579 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-9cbd1433-cd58-4f76-9c0d-7f418f349f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:03.591266 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:20:03.657978 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 675/1362] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:20:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:20:03.953310 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f052cd-d32f-459a-b077-4157f2c4ca78 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:20:03.954877 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-80f052cd-d32f-459a-b077-4157f2c4ca78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:04.026625 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:20:04.137664 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f052cd-d32f-459a-b077-4157f2c4ca78 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:20:04.264325 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43209e35-ea91-4ceb-9d0e-e76d7b1f8d2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b7213b7111456a93e294ce40b95b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:20:04.264947 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43209e35-ea91-4ceb-9d0e-e76d7b1f8d2e service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:04.265225 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43209e35-ea91-4ceb-9d0e-e76d7b1f8d2e service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:04.265529 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43209e35-ea91-4ceb-9d0e-e76d7b1f8d2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:04.267230 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-43209e35-ea91-4ceb-9d0e-e76d7b1f8d2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:04.292550 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:20:04.373303 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43209e35-ea91-4ceb-9d0e-e76d7b1f8d2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:20:04.375143 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43209e35-ea91-4ceb-9d0e-e76d7b1f8d2e service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:20:04.397076 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 688/1363] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:20:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:20:06.653814 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c95a5b-f35f-44f7-940a-2a45908647bb None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:06.654409 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c95a5b-f35f-44f7-940a-2a45908647bb None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:06.654409 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c95a5b-f35f-44f7-940a-2a45908647bb None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:06.655732 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 676/1364] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:20:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:20:06.661487 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd646770-3a0f-4df6-b849-9ec19d35d61f None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:06.662008 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd646770-3a0f-4df6-b849-9ec19d35d61f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:06.662008 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd646770-3a0f-4df6-b849-9ec19d35d61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:06.734001 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-fd646770-3a0f-4df6-b849-9ec19d35d61f None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:20:06.735230 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-fd646770-3a0f-4df6-b849-9ec19d35d61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:06.841670 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:20:06.856812 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 689/1365] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:20:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:20:07.131151 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f8164-627a-4aa3-8633-f1a2b82e3952 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:07.131403 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f8164-627a-4aa3-8633-f1a2b82e3952 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:07.131911 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f8164-627a-4aa3-8633-f1a2b82e3952 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:07.133301 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 677/1366] 10.222.0.36 () {54 vars in 962 bytes} [Mon Aug 29 22:20:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:20:07.139181 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e13ba-ac16-4c5c-b08b-d0deeb3e7a24 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:07.139533 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e13ba-ac16-4c5c-b08b-d0deeb3e7a24 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:07.139857 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e13ba-ac16-4c5c-b08b-d0deeb3e7a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:07.234046 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-078e13ba-ac16-4c5c-b08b-d0deeb3e7a24 None None] MFA Rules not processed for user `90b7213b7111456a93e294ce40b95b21`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:20:07.235416 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-078e13ba-ac16-4c5c-b08b-d0deeb3e7a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:07.360396 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 690/1367] 10.222.0.36 () {58 vars in 1059 bytes} [Mon Aug 29 22:20:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:20:07.368683 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f8164-627a-4aa3-8633-f1a2b82e3952 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:20:07.370204 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-090f8164-627a-4aa3-8633-f1a2b82e3952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:07.533225 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f8164-627a-4aa3-8633-f1a2b82e3952 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:20:07.556760 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:20:07.656703 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477ff54-0047-4e20-9447-5db300a392b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b7213b7111456a93e294ce40b95b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:20:07.657402 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477ff54-0047-4e20-9447-5db300a392b3 service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:07.657765 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477ff54-0047-4e20-9447-5db300a392b3 service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:07.658035 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477ff54-0047-4e20-9447-5db300a392b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:07.659698 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-8477ff54-0047-4e20-9447-5db300a392b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:07.753765 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8477ff54-0047-4e20-9447-5db300a392b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:20:07.755961 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8477ff54-0047-4e20-9447-5db300a392b3 service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:20:07.777092 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 678/1368] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:20:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:20:08.357236 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d968e-36e1-4edd-966c-d44343fba7d5 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:08.357806 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d968e-36e1-4edd-966c-d44343fba7d5 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:08.357806 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d968e-36e1-4edd-966c-d44343fba7d5 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:08.359275 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 691/1369] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:20:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:20:08.364633 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17612083-cfc8-4a95-bfa1-aa9a8d2373a2 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:08.365161 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17612083-cfc8-4a95-bfa1-aa9a8d2373a2 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:08.365532 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17612083-cfc8-4a95-bfa1-aa9a8d2373a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:08.403726 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:20:08.445173 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-17612083-cfc8-4a95-bfa1-aa9a8d2373a2 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:20:08.446722 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-17612083-cfc8-4a95-bfa1-aa9a8d2373a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:08.560580 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 679/1370] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:20:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:20:09.168653 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ded49d-31e9-4df1-8ee5-947dce858f20 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:09.168929 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ded49d-31e9-4df1-8ee5-947dce858f20 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:09.169203 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ded49d-31e9-4df1-8ee5-947dce858f20 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:09.170744 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 692/1371] 10.222.0.36 () {54 vars in 964 bytes} [Mon Aug 29 22:20:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:20:09.175950 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38bd2f-5925-4057-b2fa-9b6fe724111d None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:09.176478 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38bd2f-5925-4057-b2fa-9b6fe724111d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:09.176761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38bd2f-5925-4057-b2fa-9b6fe724111d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:09.275907 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-9c38bd2f-5925-4057-b2fa-9b6fe724111d None None] MFA Rules not processed for user `d14db90aa108495e9c48584cdc2f7206`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:20:09.277282 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-9c38bd2f-5925-4057-b2fa-9b6fe724111d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:09.331049 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:20:09.363521 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 680/1372] 10.222.0.36 () {58 vars in 1061 bytes} [Mon Aug 29 22:20:09 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:20:09.371139 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ded49d-31e9-4df1-8ee5-947dce858f20 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:20:09.373368 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-50ded49d-31e9-4df1-8ee5-947dce858f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:09.429597 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:20:09.484983 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ded49d-31e9-4df1-8ee5-947dce858f20 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:20:09.568417 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dbd3cd-6767-4c92-b814-bc30f0869e82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:20:09.569254 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dbd3cd-6767-4c92-b814-bc30f0869e82 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:09.569529 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dbd3cd-6767-4c92-b814-bc30f0869e82 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:09.569899 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dbd3cd-6767-4c92-b814-bc30f0869e82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:09.571890 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-75dbd3cd-6767-4c92-b814-bc30f0869e82 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:09.692251 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:20:09.711862 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dbd3cd-6767-4c92-b814-bc30f0869e82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:20:09.713847 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dbd3cd-6767-4c92-b814-bc30f0869e82 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:20:09.739287 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 693/1373] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:20:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:20:09.797918 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ca7dc-bd4f-4add-8ad6-b599be008716 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:09.798262 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ca7dc-bd4f-4add-8ad6-b599be008716 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:09.798423 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ca7dc-bd4f-4add-8ad6-b599be008716 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:09.801215 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 681/1374] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:20:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:20:09.810497 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5f8a9-2c40-416f-96db-25dee0b5449f None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:09.811889 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5f8a9-2c40-416f-96db-25dee0b5449f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:09.813118 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5f8a9-2c40-416f-96db-25dee0b5449f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:09.932641 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-a1b5f8a9-2c40-416f-96db-25dee0b5449f None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:20:09.933973 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-a1b5f8a9-2c40-416f-96db-25dee0b5449f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:10.030280 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 694/1375] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:20:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:20:10.314331 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ca7dc-bd4f-4add-8ad6-b599be008716 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:20:10.315955 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-8b0ca7dc-bd4f-4add-8ad6-b599be008716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:10.474145 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ca7dc-bd4f-4add-8ad6-b599be008716 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:20:10.529052 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:20:10.597555 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa51a35c-38df-48f4-84d3-f46a5228002a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b7213b7111456a93e294ce40b95b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:20:10.598083 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51a35c-38df-48f4-84d3-f46a5228002a service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:10.598367 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51a35c-38df-48f4-84d3-f46a5228002a service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:10.598642 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51a35c-38df-48f4-84d3-f46a5228002a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:10.600325 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-aa51a35c-38df-48f4-84d3-f46a5228002a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:10.694929 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa51a35c-38df-48f4-84d3-f46a5228002a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:20:10.696611 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa51a35c-38df-48f4-84d3-f46a5228002a service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:20:10.715046 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 682/1376] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:20:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:20:12.648119 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fac35-f305-4812-9485-362ae570d5d0 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:12.648696 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fac35-f305-4812-9485-362ae570d5d0 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:12.648696 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fac35-f305-4812-9485-362ae570d5d0 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:12.650231 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 695/1377] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:20:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:20:12.655305 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90bfcaa-ec5f-4ebe-b44d-a8a1ffa7c68f None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:12.655751 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90bfcaa-ec5f-4ebe-b44d-a8a1ffa7c68f None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:12.655867 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90bfcaa-ec5f-4ebe-b44d-a8a1ffa7c68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:12.728704 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-e90bfcaa-ec5f-4ebe-b44d-a8a1ffa7c68f None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:20:12.729943 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e90bfcaa-ec5f-4ebe-b44d-a8a1ffa7c68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:12.737361 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:20:12.859754 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 683/1378] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:20:13.155307 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9fac35-f305-4812-9485-362ae570d5d0 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:20:13.156928 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-af9fac35-f305-4812-9485-362ae570d5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:13.239011 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:20:13.357432 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9fac35-f305-4812-9485-362ae570d5d0 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:20:13.493541 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19603070-7b86-4965-a2cf-ad47e55d4c25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b7213b7111456a93e294ce40b95b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:20:13.494072 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19603070-7b86-4965-a2cf-ad47e55d4c25 service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:13.494353 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19603070-7b86-4965-a2cf-ad47e55d4c25 service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:13.494652 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19603070-7b86-4965-a2cf-ad47e55d4c25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:13.496263 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-19603070-7b86-4965-a2cf-ad47e55d4c25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:13.516057 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:20:13.592596 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19603070-7b86-4965-a2cf-ad47e55d4c25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:20:13.594260 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19603070-7b86-4965-a2cf-ad47e55d4c25 service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:20:13.614138 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 696/1379] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:20:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:20:15.626048 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ecba6f-91ae-42f6-bcbb-69cadafe3d09 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:15.626651 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ecba6f-91ae-42f6-bcbb-69cadafe3d09 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:15.626651 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ecba6f-91ae-42f6-bcbb-69cadafe3d09 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:15.628826 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 684/1380] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:20:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:20:15.634099 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f93d40-cf8e-461a-8ea2-3feb286cecc2 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:15.634555 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f93d40-cf8e-461a-8ea2-3feb286cecc2 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:15.634644 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f93d40-cf8e-461a-8ea2-3feb286cecc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:15.713788 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-a0f93d40-cf8e-461a-8ea2-3feb286cecc2 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:20:15.715537 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-a0f93d40-cf8e-461a-8ea2-3feb286cecc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:15.817249 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:20:15.829801 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 697/1381] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:20:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:20:16.110024 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ecba6f-91ae-42f6-bcbb-69cadafe3d09 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:20:16.111617 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-d2ecba6f-91ae-42f6-bcbb-69cadafe3d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:16.272953 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:20:16.285096 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ecba6f-91ae-42f6-bcbb-69cadafe3d09 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:20:16.410425 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83de6c-8c4d-4105-b92f-8f7c624a93ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b7213b7111456a93e294ce40b95b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:20:16.411145 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83de6c-8c4d-4105-b92f-8f7c624a93ad service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:16.411494 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83de6c-8c4d-4105-b92f-8f7c624a93ad service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:16.411799 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83de6c-8c4d-4105-b92f-8f7c624a93ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:16.413608 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-7d83de6c-8c4d-4105-b92f-8f7c624a93ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:16.510958 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d83de6c-8c4d-4105-b92f-8f7c624a93ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:20:16.512597 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d83de6c-8c4d-4105-b92f-8f7c624a93ad service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:20:16.524043 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:20:16.533149 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 685/1382] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:20:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:20:18.542597 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d35414d-d77e-4811-9c16-f1236a15c187 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:18.543319 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d35414d-d77e-4811-9c16-f1236a15c187 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:18.543319 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d35414d-d77e-4811-9c16-f1236a15c187 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:18.544743 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 698/1383] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:20:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:20:18.551212 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e78df-43e0-4a1b-8f18-55e23c885b8c None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:18.551777 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e78df-43e0-4a1b-8f18-55e23c885b8c None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:18.551777 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e78df-43e0-4a1b-8f18-55e23c885b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:18.621432 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-915e78df-43e0-4a1b-8f18-55e23c885b8c None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:20:18.622678 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-915e78df-43e0-4a1b-8f18-55e23c885b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:18.721485 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 686/1384] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:20:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:20:19.013193 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d35414d-d77e-4811-9c16-f1236a15c187 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:20:19.014799 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-4d35414d-d77e-4811-9c16-f1236a15c187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:19.196682 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d35414d-d77e-4811-9c16-f1236a15c187 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:20:19.277001 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:20:19.332212 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ac320-637e-49b9-8341-4c0c7d251aaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b7213b7111456a93e294ce40b95b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:20:19.333046 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ac320-637e-49b9-8341-4c0c7d251aaa service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:19.333346 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ac320-637e-49b9-8341-4c0c7d251aaa service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:19.333632 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ac320-637e-49b9-8341-4c0c7d251aaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:19.335411 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-602ac320-637e-49b9-8341-4c0c7d251aaa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:19.448099 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ac320-637e-49b9-8341-4c0c7d251aaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:20:19.450223 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ac320-637e-49b9-8341-4c0c7d251aaa service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:20:19.474986 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 699/1385] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:20:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:20:21.549264 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c0d2b-7d27-4ce3-abf6-52bec6c47f75 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:21.549833 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c0d2b-7d27-4ce3-abf6-52bec6c47f75 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:21.549833 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c0d2b-7d27-4ce3-abf6-52bec6c47f75 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:21.551439 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 687/1386] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:20:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:20:21.557737 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d41ba-44ce-45f8-84bf-dfca319c0774 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:21.558516 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d41ba-44ce-45f8-84bf-dfca319c0774 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:21.558516 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d41ba-44ce-45f8-84bf-dfca319c0774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:21.634663 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-872d41ba-44ce-45f8-84bf-dfca319c0774 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:20:21.636005 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-872d41ba-44ce-45f8-84bf-dfca319c0774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:21.670849 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:20:21.748534 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 700/1387] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:20:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:20:22.087800 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c0d2b-7d27-4ce3-abf6-52bec6c47f75 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:20:22.089939 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b79c0d2b-7d27-4ce3-abf6-52bec6c47f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:22.184440 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:20:22.265648 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c0d2b-7d27-4ce3-abf6-52bec6c47f75 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:20:22.402002 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f11b45-64db-4c35-bffa-c0eaad49791f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b7213b7111456a93e294ce40b95b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:20:22.402663 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f11b45-64db-4c35-bffa-c0eaad49791f service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:22.402943 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f11b45-64db-4c35-bffa-c0eaad49791f service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:22.403238 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f11b45-64db-4c35-bffa-c0eaad49791f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:22.404966 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-52f11b45-64db-4c35-bffa-c0eaad49791f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:22.446551 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:20:22.514884 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f11b45-64db-4c35-bffa-c0eaad49791f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:20:22.516971 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f11b45-64db-4c35-bffa-c0eaad49791f service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:20:22.541312 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 688/1388] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:20:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:20:24.600270 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b8a452-5629-4ea7-96a9-ca7406365bea None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:24.600842 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b8a452-5629-4ea7-96a9-ca7406365bea None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:24.600954 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b8a452-5629-4ea7-96a9-ca7406365bea None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:24.602262 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 701/1389] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:20:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:20:24.608127 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6dd72-f24f-487a-90b6-5952adfa8e84 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:24.608699 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6dd72-f24f-487a-90b6-5952adfa8e84 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:24.608699 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6dd72-f24f-487a-90b6-5952adfa8e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:24.683246 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-bce6dd72-f24f-487a-90b6-5952adfa8e84 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:20:24.684475 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-bce6dd72-f24f-487a-90b6-5952adfa8e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:24.808383 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 689/1390] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:20:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:20:25.117113 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b8a452-5629-4ea7-96a9-ca7406365bea None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:20:25.118717 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f8b8a452-5629-4ea7-96a9-ca7406365bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:25.246616 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c719a6-fb02-49d7-b8ee-e3984f761fbb None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:25.246865 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c719a6-fb02-49d7-b8ee-e3984f761fbb None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:25.247123 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c719a6-fb02-49d7-b8ee-e3984f761fbb None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:25.248590 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 690/1391] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:20:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:20:25.254296 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2452c3-a705-438a-81c4-fa742d414725 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:25.254671 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2452c3-a705-438a-81c4-fa742d414725 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:25.254955 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2452c3-a705-438a-81c4-fa742d414725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:25.272426 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:20:25.276188 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b8a452-5629-4ea7-96a9-ca7406365bea None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:20:25.295001 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:20:25.325619 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-2f2452c3-a705-438a-81c4-fa742d414725 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:20:25.326843 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-2f2452c3-a705-438a-81c4-fa742d414725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:25.401830 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9109d271-52d4-4d31-9125-39f0b81f132c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b7213b7111456a93e294ce40b95b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:20:25.402357 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109d271-52d4-4d31-9125-39f0b81f132c service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:25.402926 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109d271-52d4-4d31-9125-39f0b81f132c service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:25.403359 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109d271-52d4-4d31-9125-39f0b81f132c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:25.405287 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-9109d271-52d4-4d31-9125-39f0b81f132c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:25.429124 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 691/1392] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:20:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:20:25.505265 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9109d271-52d4-4d31-9125-39f0b81f132c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:20:25.506870 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9109d271-52d4-4d31-9125-39f0b81f132c service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:20:25.526455 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 702/1393] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:20:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:20:25.747686 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1734e95-4d48-470d-90a2-5ab366268170 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:25.748553 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1734e95-4d48-470d-90a2-5ab366268170 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:25.748553 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1734e95-4d48-470d-90a2-5ab366268170 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:25.750538 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 692/1394] 10.222.0.36 () {54 vars in 967 bytes} [Mon Aug 29 22:20:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:20:25.761435 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7379b15-c883-479b-9541-b04b6fe17f34 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:25.762360 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7379b15-c883-479b-9541-b04b6fe17f34 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:25.762360 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7379b15-c883-479b-9541-b04b6fe17f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:25.793840 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:20:25.850025 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-f7379b15-c883-479b-9541-b04b6fe17f34 None None] MFA Rules not processed for user `e7a399ee5db44100a88a4ffb451512aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:20:25.851239 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f7379b15-c883-479b-9541-b04b6fe17f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:25.945866 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 703/1395] 10.222.0.36 () {58 vars in 1064 bytes} [Mon Aug 29 22:20:25 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:20:25.953996 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1734e95-4d48-470d-90a2-5ab366268170 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:20:25.956027 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f1734e95-4d48-470d-90a2-5ab366268170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:26.062508 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:20:26.070871 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1734e95-4d48-470d-90a2-5ab366268170 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:20:26.155840 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f4af97-dff6-4f92-97c0-93e15e4387ba service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a399ee5db44100a88a4ffb451512aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:20:26.156493 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4af97-dff6-4f92-97c0-93e15e4387ba service glance] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:26.156770 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4af97-dff6-4f92-97c0-93e15e4387ba service glance] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:26.157041 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4af97-dff6-4f92-97c0-93e15e4387ba service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:26.158943 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f0f4af97-dff6-4f92-97c0-93e15e4387ba service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:26.285059 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f4af97-dff6-4f92-97c0-93e15e4387ba service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:20:26.286645 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f4af97-dff6-4f92-97c0-93e15e4387ba service glance] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:20:26.306160 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 693/1396] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:20:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:20:27.090834 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55e381-ec43-4726-bee4-02247f0b8e96 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:27.091353 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55e381-ec43-4726-bee4-02247f0b8e96 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:27.091353 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55e381-ec43-4726-bee4-02247f0b8e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:27.175950 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-fc55e381-ec43-4726-bee4-02247f0b8e96 None None] MFA Rules not processed for user `b32922d090564162810dd8b28c3a322b`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:20:27.178028 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-fc55e381-ec43-4726-bee4-02247f0b8e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:27.254517 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:20:27.288729 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 704/1397] 10.222.0.36 () {58 vars in 1009 bytes} [Mon Aug 29 22:20:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:20:27.340038 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a5d94-6d23-466c-97e3-ff72075a948a None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:27.340636 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a5d94-6d23-466c-97e3-ff72075a948a None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:27.340729 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a5d94-6d23-466c-97e3-ff72075a948a None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:27.342166 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 694/1398] 10.222.0.36 () {54 vars in 943 bytes} [Mon Aug 29 22:20:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:20:27.349631 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc93b3-e0c3-46f8-a9d2-ba03236ace75 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:27.349921 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc93b3-e0c3-46f8-a9d2-ba03236ace75 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:27.350374 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc93b3-e0c3-46f8-a9d2-ba03236ace75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:27.441909 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-8bbc93b3-e0c3-46f8-a9d2-ba03236ace75 None None] MFA Rules not processed for user `5f3472d8ffa748d8828c6a2d89ee7ac7`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:20:27.443114 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-8bbc93b3-e0c3-46f8-a9d2-ba03236ace75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:27.516924 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b779f46-c168-4b4a-885d-7fd07b81158a None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:27.517317 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b779f46-c168-4b4a-885d-7fd07b81158a None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:27.517509 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b779f46-c168-4b4a-885d-7fd07b81158a None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:27.519182 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 695/1399] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:20:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:20:27.525017 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e367fb3-11db-43a2-ad5f-9377cfd948f8 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:27.525307 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e367fb3-11db-43a2-ad5f-9377cfd948f8 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:27.525598 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e367fb3-11db-43a2-ad5f-9377cfd948f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:27.553338 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:20:27.555598 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 705/1400] 10.222.0.36 () {58 vars in 1040 bytes} [Mon Aug 29 22:20:27 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:20:27.565477 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc93b3-e0c3-46f8-a9d2-ba03236ace75 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:20:27.575066 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc93b3-e0c3-46f8-a9d2-ba03236ace75 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:20:27.595940 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-0e367fb3-11db-43a2-ad5f-9377cfd948f8 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:20:27.597224 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-0e367fb3-11db-43a2-ad5f-9377cfd948f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:27.607888 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:20:27.681259 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd2b71-386a-436a-a5f6-e3c573ceffd4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3472d8ffa748d8828c6a2d89ee7ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:20:27.681886 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd2b71-386a-436a-a5f6-e3c573ceffd4 service swift] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:27.682191 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd2b71-386a-436a-a5f6-e3c573ceffd4 service swift] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:27.682465 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd2b71-386a-436a-a5f6-e3c573ceffd4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:27.684237 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d6dd2b71-386a-436a-a5f6-e3c573ceffd4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:27.782540 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dd2b71-386a-436a-a5f6-e3c573ceffd4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:20:27.784365 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dd2b71-386a-436a-a5f6-e3c573ceffd4 service swift] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:20:27.793577 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 706/1401] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Aug 29 22:20:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 22:20:27.823734 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 696/1402] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:20:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:20:28.113463 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd2b71-386a-436a-a5f6-e3c573ceffd4 service swift] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:20:28.114805 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d6dd2b71-386a-436a-a5f6-e3c573ceffd4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:28.185756 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:20:28.221462 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd2b71-386a-436a-a5f6-e3c573ceffd4 service swift] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:20:28.343449 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c24ba-1d58-4734-9804-6468a1b8b8a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b7213b7111456a93e294ce40b95b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:20:28.344060 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c24ba-1d58-4734-9804-6468a1b8b8a1 service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:28.344395 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c24ba-1d58-4734-9804-6468a1b8b8a1 service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:28.344694 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c24ba-1d58-4734-9804-6468a1b8b8a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:28.348256 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-fa5c24ba-1d58-4734-9804-6468a1b8b8a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:28.434689 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:20:28.448310 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5c24ba-1d58-4734-9804-6468a1b8b8a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:20:28.449944 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5c24ba-1d58-4734-9804-6468a1b8b8a1 service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:20:28.469519 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 707/1403] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:20:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:20:30.426324 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58819c27-d117-425f-8fbd-ea67bd3cfaaa None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:30.427009 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58819c27-d117-425f-8fbd-ea67bd3cfaaa None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:30.427009 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58819c27-d117-425f-8fbd-ea67bd3cfaaa None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:30.428180 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 697/1404] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:20:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:20:30.433485 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183d040-14a0-41b2-a17c-e89439c18ac6 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:30.433943 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183d040-14a0-41b2-a17c-e89439c18ac6 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:30.434052 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183d040-14a0-41b2-a17c-e89439c18ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:30.504461 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-f183d040-14a0-41b2-a17c-e89439c18ac6 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:20:30.507630 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f183d040-14a0-41b2-a17c-e89439c18ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:30.614733 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 708/1405] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:20:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:20:30.914110 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58819c27-d117-425f-8fbd-ea67bd3cfaaa None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:20:30.915913 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-58819c27-d117-425f-8fbd-ea67bd3cfaaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:31.042212 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:20:31.099166 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58819c27-d117-425f-8fbd-ea67bd3cfaaa None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:20:31.247755 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b4cd6-95c3-41fd-a193-671feed23c13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b7213b7111456a93e294ce40b95b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:20:31.248365 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b4cd6-95c3-41fd-a193-671feed23c13 service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:31.248686 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b4cd6-95c3-41fd-a193-671feed23c13 service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:31.249072 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b4cd6-95c3-41fd-a193-671feed23c13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:31.251747 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-5c9b4cd6-95c3-41fd-a193-671feed23c13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:31.329079 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:20:31.366126 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9b4cd6-95c3-41fd-a193-671feed23c13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:20:31.367628 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9b4cd6-95c3-41fd-a193-671feed23c13 service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:20:31.387105 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 698/1406] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:20:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:20:33.394830 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b413c9-30a2-4564-9528-f110bb3c8a93 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:33.395416 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b413c9-30a2-4564-9528-f110bb3c8a93 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:33.395416 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b413c9-30a2-4564-9528-f110bb3c8a93 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:33.397337 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 709/1407] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:20:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:20:33.402930 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9cc081-ec42-46a2-b757-930f47aac2f6 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:33.403414 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9cc081-ec42-46a2-b757-930f47aac2f6 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:33.403519 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9cc081-ec42-46a2-b757-930f47aac2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:33.481729 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-9c9cc081-ec42-46a2-b757-930f47aac2f6 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:20:33.482946 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-9c9cc081-ec42-46a2-b757-930f47aac2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:33.608430 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 699/1408] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:20:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:20:33.896483 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b413c9-30a2-4564-9528-f110bb3c8a93 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:20:33.898189 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b6b413c9-30a2-4564-9528-f110bb3c8a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:33.988934 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:20:34.100543 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b413c9-30a2-4564-9528-f110bb3c8a93 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:20:34.298175 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e7de9e-c13b-40fb-98d2-f98f157b4134 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b7213b7111456a93e294ce40b95b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:20:34.299395 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7de9e-c13b-40fb-98d2-f98f157b4134 service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:34.299996 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7de9e-c13b-40fb-98d2-f98f157b4134 service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:34.300500 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7de9e-c13b-40fb-98d2-f98f157b4134 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:34.303035 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-00e7de9e-c13b-40fb-98d2-f98f157b4134 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:34.368791 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:20:34.492794 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e7de9e-c13b-40fb-98d2-f98f157b4134 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:20:34.494517 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e7de9e-c13b-40fb-98d2-f98f157b4134 service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:20:34.521329 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 710/1409] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:20:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 624 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:20:43.602351 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=82 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:20:44.515492 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=36 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:20:49.949951 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e749f-ff96-4d0f-a1a8-715dede7389d None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:49.950560 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e749f-ff96-4d0f-a1a8-715dede7389d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:49.950560 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e749f-ff96-4d0f-a1a8-715dede7389d None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:49.951822 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 700/1410] 10.222.0.36 () {54 vars in 918 bytes} [Mon Aug 29 22:20:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:20:49.957342 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf805f64-5035-4166-ba60-bfce982e7f1a None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:49.957794 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf805f64-5035-4166-ba60-bfce982e7f1a None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:49.957903 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf805f64-5035-4166-ba60-bfce982e7f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:50.035893 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-cf805f64-5035-4166-ba60-bfce982e7f1a None None] MFA Rules not processed for user `bce3d9397cca4ae58e14c8a5ae844f8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:20:50.037132 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-cf805f64-5035-4166-ba60-bfce982e7f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:50.145708 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 711/1411] 10.222.0.36 () {58 vars in 1015 bytes} [Mon Aug 29 22:20:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:20:50.165474 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69fb5a7-bbe5-4d88-8ed9-3ff6ee226ec3 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:50.165762 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69fb5a7-bbe5-4d88-8ed9-3ff6ee226ec3 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:50.166031 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69fb5a7-bbe5-4d88-8ed9-3ff6ee226ec3 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:50.167348 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 701/1412] 10.222.0.36 () {54 vars in 918 bytes} [Mon Aug 29 22:20:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:20:50.173034 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab47aa-8452-4856-87de-7ad9464040a6 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:50.173386 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab47aa-8452-4856-87de-7ad9464040a6 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:50.173716 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab47aa-8452-4856-87de-7ad9464040a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:50.258580 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:20:50.262549 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-27ab47aa-8452-4856-87de-7ad9464040a6 None None] MFA Rules not processed for user `90b7213b7111456a93e294ce40b95b21`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:20:50.265598 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-27ab47aa-8452-4856-87de-7ad9464040a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:50.415566 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 712/1413] 10.222.0.36 () {58 vars in 1015 bytes} [Mon Aug 29 22:20:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:20:52.838339 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526f08d-c0c4-4baf-be5d-5ec23cb3d7a5 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:52.838913 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526f08d-c0c4-4baf-be5d-5ec23cb3d7a5 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:52.838913 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526f08d-c0c4-4baf-be5d-5ec23cb3d7a5 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:52.840219 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 702/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 22:20:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:20:52.845646 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52982ff5-c8d0-4e65-bf73-b3e4c4fa9442 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:52.846099 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52982ff5-c8d0-4e65-bf73-b3e4c4fa9442 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:52.846263 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52982ff5-c8d0-4e65-bf73-b3e4c4fa9442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:52.919378 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-52982ff5-c8d0-4e65-bf73-b3e4c4fa9442 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:20:52.920655 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-52982ff5-c8d0-4e65-bf73-b3e4c4fa9442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:52.978856 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:20:53.023463 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 713/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 22:20:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:20:53.306794 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526f08d-c0c4-4baf-be5d-5ec23cb3d7a5 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:20:53.308359 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c526f08d-c0c4-4baf-be5d-5ec23cb3d7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:53.477963 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526f08d-c0c4-4baf-be5d-5ec23cb3d7a5 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:20:53.560854 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:20:53.613641 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf79aa7-2ce1-439b-a736-2df9f0744388 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b7213b7111456a93e294ce40b95b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:20:53.614411 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf79aa7-2ce1-439b-a736-2df9f0744388 service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:53.614700 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf79aa7-2ce1-439b-a736-2df9f0744388 service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:53.614972 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf79aa7-2ce1-439b-a736-2df9f0744388 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:53.617005 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-4cf79aa7-2ce1-439b-a736-2df9f0744388 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:53.716228 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf79aa7-2ce1-439b-a736-2df9f0744388 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:20:53.717914 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf79aa7-2ce1-439b-a736-2df9f0744388 service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:20:53.739504 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 703/1416] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:20:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:20:54.638987 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f5f8f8-b307-4cfe-8856-bea4dd4a756a None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:54.639590 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f5f8f8-b307-4cfe-8856-bea4dd4a756a None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:54.639590 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f5f8f8-b307-4cfe-8856-bea4dd4a756a None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:54.640971 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 714/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 22:20:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:20:54.647198 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930acc1e-9fa0-4241-a8bc-c9cdda6a8686 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:54.647681 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930acc1e-9fa0-4241-a8bc-c9cdda6a8686 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:54.647774 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930acc1e-9fa0-4241-a8bc-c9cdda6a8686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:54.740168 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-930acc1e-9fa0-4241-a8bc-c9cdda6a8686 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:20:54.741486 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-930acc1e-9fa0-4241-a8bc-c9cdda6a8686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:54.771966 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:20:54.849689 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 704/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 22:20:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:20:55.002511 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f5f8f8-b307-4cfe-8856-bea4dd4a756a None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:20:55.004227 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-50f5f8f8-b307-4cfe-8856-bea4dd4a756a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:55.178506 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f5f8f8-b307-4cfe-8856-bea4dd4a756a None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:20:55.228767 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:20:55.320123 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c192a-448f-4dae-80a3-123e45a3c60b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b7213b7111456a93e294ce40b95b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:20:55.320939 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c192a-448f-4dae-80a3-123e45a3c60b service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:55.321164 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c192a-448f-4dae-80a3-123e45a3c60b service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:55.321434 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c192a-448f-4dae-80a3-123e45a3c60b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:55.323076 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-273c192a-448f-4dae-80a3-123e45a3c60b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:55.427527 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c192a-448f-4dae-80a3-123e45a3c60b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:20:55.429323 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c192a-448f-4dae-80a3-123e45a3c60b service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:20:55.449819 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 715/1419] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:20:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:20:56.356043 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804cd2f6-278c-4865-adf5-683c715650fe None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:56.356666 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804cd2f6-278c-4865-adf5-683c715650fe None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:56.356666 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804cd2f6-278c-4865-adf5-683c715650fe None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:56.357996 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 705/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 22:20:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:20:56.364148 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56b97f-e08b-4528-9935-f1dcab20414e None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:56.364658 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56b97f-e08b-4528-9935-f1dcab20414e None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:56.364750 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56b97f-e08b-4528-9935-f1dcab20414e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:56.427881 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:20:56.454125 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-6c56b97f-e08b-4528-9935-f1dcab20414e None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:20:56.455361 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-6c56b97f-e08b-4528-9935-f1dcab20414e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:56.576386 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 716/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 22:20:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:20:56.728108 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804cd2f6-278c-4865-adf5-683c715650fe None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:20:56.729591 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-804cd2f6-278c-4865-adf5-683c715650fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:56.897964 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804cd2f6-278c-4865-adf5-683c715650fe None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:20:56.911652 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:20:57.027075 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b4a53-9443-4084-a948-c73f3aace99b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b7213b7111456a93e294ce40b95b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:20:57.027629 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b4a53-9443-4084-a948-c73f3aace99b service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:57.027906 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b4a53-9443-4084-a948-c73f3aace99b service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:57.028173 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b4a53-9443-4084-a948-c73f3aace99b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:57.029850 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-ce8b4a53-9443-4084-a948-c73f3aace99b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:57.129834 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b4a53-9443-4084-a948-c73f3aace99b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:20:57.131454 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b4a53-9443-4084-a948-c73f3aace99b service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:20:57.150904 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 706/1422] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:20:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:20:58.075343 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e457f-df9c-4d07-8397-162c7b931b6f None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:58.075950 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e457f-df9c-4d07-8397-162c7b931b6f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:58.075950 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e457f-df9c-4d07-8397-162c7b931b6f None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:58.077326 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 717/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 22:20:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:20:58.083082 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf2593-95de-4b45-b966-ec252be6454a None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:58.083548 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf2593-95de-4b45-b966-ec252be6454a None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:58.083647 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf2593-95de-4b45-b966-ec252be6454a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:58.111416 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:20:58.175769 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-74cf2593-95de-4b45-b966-ec252be6454a None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:20:58.176923 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-74cf2593-95de-4b45-b966-ec252be6454a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:58.297517 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 707/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 22:20:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:20:58.460297 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648e457f-df9c-4d07-8397-162c7b931b6f None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:20:58.461790 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-648e457f-df9c-4d07-8397-162c7b931b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:58.590612 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:20:58.627406 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648e457f-df9c-4d07-8397-162c7b931b6f None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:20:58.751735 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7daae73-7b5a-4dd7-8653-dc7f4ce4b2a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b7213b7111456a93e294ce40b95b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:20:58.752300 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7daae73-7b5a-4dd7-8653-dc7f4ce4b2a7 service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:58.752590 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7daae73-7b5a-4dd7-8653-dc7f4ce4b2a7 service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:58.753048 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7daae73-7b5a-4dd7-8653-dc7f4ce4b2a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:58.755090 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c7daae73-7b5a-4dd7-8653-dc7f4ce4b2a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:20:58.853765 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:20:58.870476 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7daae73-7b5a-4dd7-8653-dc7f4ce4b2a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:20:58.872202 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7daae73-7b5a-4dd7-8653-dc7f4ce4b2a7 service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:20:58.892978 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 718/1425] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:20:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:20:59.827352 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1c9a9-3514-461a-b875-809ac5dbabf5 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:59.827963 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1c9a9-3514-461a-b875-809ac5dbabf5 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:59.827963 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1c9a9-3514-461a-b875-809ac5dbabf5 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:59.829265 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 708/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 22:20:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:20:59.835572 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3167f6a-c0b0-4bf9-8519-3798f25a7866 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:20:59.836085 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3167f6a-c0b0-4bf9-8519-3798f25a7866 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:20:59.836085 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3167f6a-c0b0-4bf9-8519-3798f25a7866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:20:59.920437 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-d3167f6a-c0b0-4bf9-8519-3798f25a7866 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:20:59.921738 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d3167f6a-c0b0-4bf9-8519-3798f25a7866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:21:00.028672 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 719/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 22:20:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:21:00.181827 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e1c9a9-3514-461a-b875-809ac5dbabf5 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:21:00.183371 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e6e1c9a9-3514-461a-b875-809ac5dbabf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:21:00.271936 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:21:00.336251 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e1c9a9-3514-461a-b875-809ac5dbabf5 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:21:00.461063 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf343431-4f1f-4665-9811-da3d632e367a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b7213b7111456a93e294ce40b95b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:21:00.461587 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf343431-4f1f-4665-9811-da3d632e367a service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:21:00.461866 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf343431-4f1f-4665-9811-da3d632e367a service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:21:00.462142 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf343431-4f1f-4665-9811-da3d632e367a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:21:00.463782 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-bf343431-4f1f-4665-9811-da3d632e367a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:21:00.515997 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:21:00.563010 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf343431-4f1f-4665-9811-da3d632e367a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:21:00.564647 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf343431-4f1f-4665-9811-da3d632e367a service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:21:00.584414 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 709/1428] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:21:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:21:01.494186 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8d72c-91c0-48a0-a20c-6f947e1fe9fe None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:21:01.494892 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8d72c-91c0-48a0-a20c-6f947e1fe9fe None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:21:01.494892 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8d72c-91c0-48a0-a20c-6f947e1fe9fe None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:21:01.496148 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 720/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 22:21:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:21:01.502994 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279d519-3a5e-4afe-9aa5-6f658a8e9026 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:21:01.503531 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279d519-3a5e-4afe-9aa5-6f658a8e9026 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:21:01.503531 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279d519-3a5e-4afe-9aa5-6f658a8e9026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:21:01.594437 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-c279d519-3a5e-4afe-9aa5-6f658a8e9026 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:21:01.595571 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c279d519-3a5e-4afe-9aa5-6f658a8e9026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:21:01.709184 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 710/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 22:21:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:21:01.860942 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e8d72c-91c0-48a0-a20c-6f947e1fe9fe None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:21:01.862538 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-10e8d72c-91c0-48a0-a20c-6f947e1fe9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:21:01.915564 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:21:02.027811 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e8d72c-91c0-48a0-a20c-6f947e1fe9fe None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:21:02.156067 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c0c18b-1333-4166-84f3-8e827317bebf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b7213b7111456a93e294ce40b95b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:21:02.156796 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0c18b-1333-4166-84f3-8e827317bebf service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:21:02.157095 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0c18b-1333-4166-84f3-8e827317bebf service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:21:02.157369 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0c18b-1333-4166-84f3-8e827317bebf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:21:02.159178 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-25c0c18b-1333-4166-84f3-8e827317bebf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:21:02.168322 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:21:02.267679 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c0c18b-1333-4166-84f3-8e827317bebf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:21:02.269408 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c0c18b-1333-4166-84f3-8e827317bebf service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:21:02.289298 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 721/1431] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:21:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:21:03.131277 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e67b42-5dbf-4227-8206-d94614c07f8e None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:21:03.131988 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e67b42-5dbf-4227-8206-d94614c07f8e None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:21:03.131988 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e67b42-5dbf-4227-8206-d94614c07f8e None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:21:03.133238 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 711/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 22:21:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:21:03.139709 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c77fdb-fd87-44e3-8207-d86dc912ed57 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:21:03.140414 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c77fdb-fd87-44e3-8207-d86dc912ed57 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:21:03.140615 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c77fdb-fd87-44e3-8207-d86dc912ed57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:21:03.224866 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-c0c77fdb-fd87-44e3-8207-d86dc912ed57 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:21:03.226001 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c0c77fdb-fd87-44e3-8207-d86dc912ed57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:21:03.304201 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:21:03.342948 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 722/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 22:21:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:21:03.493515 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e67b42-5dbf-4227-8206-d94614c07f8e None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:21:03.495047 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a0e67b42-5dbf-4227-8206-d94614c07f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:21:03.513888 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:21:03.667484 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e67b42-5dbf-4227-8206-d94614c07f8e None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:21:03.775023 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:21:03.811636 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1ec68-f744-4ac0-bd90-67cd15141de2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b7213b7111456a93e294ce40b95b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:21:03.812619 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1ec68-f744-4ac0-bd90-67cd15141de2 service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:21:03.812909 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1ec68-f744-4ac0-bd90-67cd15141de2 service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:21:03.813256 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1ec68-f744-4ac0-bd90-67cd15141de2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:21:03.815213 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-48f1ec68-f744-4ac0-bd90-67cd15141de2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:21:03.919026 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f1ec68-f744-4ac0-bd90-67cd15141de2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:21:03.920724 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f1ec68-f744-4ac0-bd90-67cd15141de2 service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:21:03.941033 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 712/1434] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:21:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:21:04.750519 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed87d9-bc77-4734-8e81-a50a88017d72 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:21:04.751083 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed87d9-bc77-4734-8e81-a50a88017d72 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:21:04.751083 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed87d9-bc77-4734-8e81-a50a88017d72 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:21:04.752337 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 723/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 22:21:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:21:04.758069 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d59e0f-8cd5-4dff-963e-740ccbb9cc2c None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:21:04.758571 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d59e0f-8cd5-4dff-963e-740ccbb9cc2c None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:21:04.758571 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d59e0f-8cd5-4dff-963e-740ccbb9cc2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:21:04.843422 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-97d59e0f-8cd5-4dff-963e-740ccbb9cc2c None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:21:04.844683 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-97d59e0f-8cd5-4dff-963e-740ccbb9cc2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:21:04.891487 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:21:04.953509 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 713/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 22:21:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:21:05.118186 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed87d9-bc77-4734-8e81-a50a88017d72 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:21:05.119690 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-1aed87d9-bc77-4734-8e81-a50a88017d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:21:05.276321 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed87d9-bc77-4734-8e81-a50a88017d72 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:21:05.336439 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:21:05.405249 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99e3f0-eb02-417a-a3fb-57d81de0f2f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b7213b7111456a93e294ce40b95b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:21:05.406073 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99e3f0-eb02-417a-a3fb-57d81de0f2f2 service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:21:05.406551 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99e3f0-eb02-417a-a3fb-57d81de0f2f2 service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:21:05.407037 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99e3f0-eb02-417a-a3fb-57d81de0f2f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:21:05.409512 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-9e99e3f0-eb02-417a-a3fb-57d81de0f2f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:21:05.522509 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e99e3f0-eb02-417a-a3fb-57d81de0f2f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:21:05.524193 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e99e3f0-eb02-417a-a3fb-57d81de0f2f2 service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:21:05.543550 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 724/1437] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:21:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:21:06.356969 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ead771-cded-4cb7-8aac-ff4062d70723 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:21:06.357560 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ead771-cded-4cb7-8aac-ff4062d70723 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:21:06.357760 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ead771-cded-4cb7-8aac-ff4062d70723 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:21:06.359269 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 714/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 22:21:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:21:06.364627 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4493a99-0f78-490d-a74a-844a44a84701 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:21:06.365209 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4493a99-0f78-490d-a74a-844a44a84701 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:21:06.365209 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4493a99-0f78-490d-a74a-844a44a84701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:21:06.467926 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-c4493a99-0f78-490d-a74a-844a44a84701 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:21:06.469589 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c4493a99-0f78-490d-a74a-844a44a84701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:21:06.472309 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:21:06.591281 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 725/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 22:21:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:21:06.744657 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ead771-cded-4cb7-8aac-ff4062d70723 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:21:06.746411 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-69ead771-cded-4cb7-8aac-ff4062d70723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:21:06.921900 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ead771-cded-4cb7-8aac-ff4062d70723 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:21:06.951267 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:21:07.065954 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e07ca-b82b-422d-81b3-9f49162cd0c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b7213b7111456a93e294ce40b95b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:21:07.066699 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e07ca-b82b-422d-81b3-9f49162cd0c9 service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:21:07.067011 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e07ca-b82b-422d-81b3-9f49162cd0c9 service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:21:07.067280 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e07ca-b82b-422d-81b3-9f49162cd0c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:21:07.068962 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-4a9e07ca-b82b-422d-81b3-9f49162cd0c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:21:07.174843 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9e07ca-b82b-422d-81b3-9f49162cd0c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:21:07.176586 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9e07ca-b82b-422d-81b3-9f49162cd0c9 service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:21:07.195396 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 715/1440] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:21:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:21:09.055581 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6074e58-e4f9-43bb-b4e7-02bf8729dd57 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:21:09.056294 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6074e58-e4f9-43bb-b4e7-02bf8729dd57 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:21:09.056662 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6074e58-e4f9-43bb-b4e7-02bf8729dd57 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:21:09.058947 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 726/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 22:21:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:21:09.064648 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d2ec85-a33f-4ab1-b363-9e9a256addb8 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:21:09.065098 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d2ec85-a33f-4ab1-b363-9e9a256addb8 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:21:09.065200 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d2ec85-a33f-4ab1-b363-9e9a256addb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:21:09.110058 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:21:09.149084 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-68d2ec85-a33f-4ab1-b363-9e9a256addb8 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:21:09.150250 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-68d2ec85-a33f-4ab1-b363-9e9a256addb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:21:09.274030 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 716/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 22:21:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:21:09.572942 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6074e58-e4f9-43bb-b4e7-02bf8729dd57 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:21:09.574576 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b6074e58-e4f9-43bb-b4e7-02bf8729dd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:21:09.692352 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6074e58-e4f9-43bb-b4e7-02bf8729dd57 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:21:09.725961 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:21:09.779896 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e9e45-ffa6-469d-b2fe-c8226a9dc6d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:21:09.780718 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e9e45-ffa6-469d-b2fe-c8226a9dc6d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:21:09.781151 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e9e45-ffa6-469d-b2fe-c8226a9dc6d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:21:09.781605 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e9e45-ffa6-469d-b2fe-c8226a9dc6d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:21:09.784131 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-880e9e45-ffa6-469d-b2fe-c8226a9dc6d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:21:09.916224 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880e9e45-ffa6-469d-b2fe-c8226a9dc6d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:21:09.917877 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880e9e45-ffa6-469d-b2fe-c8226a9dc6d4 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:21:09.937371 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 727/1443] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:21:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:21:12.107702 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb657db-5704-4a66-ab88-099cdb322c2b None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:21:12.108266 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb657db-5704-4a66-ab88-099cdb322c2b None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:21:12.108266 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb657db-5704-4a66-ab88-099cdb322c2b None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:21:12.109662 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 717/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 22:21:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:21:12.118271 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd9917-f3b2-4590-96ef-884ae4387e90 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:21:12.118782 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd9917-f3b2-4590-96ef-884ae4387e90 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:21:12.118897 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd9917-f3b2-4590-96ef-884ae4387e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:21:12.207670 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-6ecd9917-f3b2-4590-96ef-884ae4387e90 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:21:12.209087 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-6ecd9917-f3b2-4590-96ef-884ae4387e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:21:12.227753 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:21:12.320796 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 728/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 22:21:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:21:12.600943 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb657db-5704-4a66-ab88-099cdb322c2b None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:21:12.602798 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-cdb657db-5704-4a66-ab88-099cdb322c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:21:12.745335 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb657db-5704-4a66-ab88-099cdb322c2b None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:21:12.759464 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:21:12.834061 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b05d84-ef3e-435d-823e-cce7087ccad3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:21:12.834689 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b05d84-ef3e-435d-823e-cce7087ccad3 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:21:12.834967 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b05d84-ef3e-435d-823e-cce7087ccad3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:21:12.835244 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b05d84-ef3e-435d-823e-cce7087ccad3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:21:12.836994 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-76b05d84-ef3e-435d-823e-cce7087ccad3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:21:12.964592 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b05d84-ef3e-435d-823e-cce7087ccad3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:21:12.966049 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b05d84-ef3e-435d-823e-cce7087ccad3 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:21:12.986216 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 718/1446] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:21:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:21:15.230007 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666835a-4d35-400c-b06e-83805fe2d49e None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:21:15.230548 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666835a-4d35-400c-b06e-83805fe2d49e None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:21:15.230548 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666835a-4d35-400c-b06e-83805fe2d49e None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:21:15.232614 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 729/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 22:21:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:21:15.240866 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f2d1b-4301-4641-a1c5-065070870c1c None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:21:15.241356 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f2d1b-4301-4641-a1c5-065070870c1c None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:21:15.241466 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f2d1b-4301-4641-a1c5-065070870c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:21:15.291034 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:21:15.311207 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-869f2d1b-4301-4641-a1c5-065070870c1c None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:21:15.312405 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-869f2d1b-4301-4641-a1c5-065070870c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:21:15.416729 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 719/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 22:21:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:21:15.704177 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666835a-4d35-400c-b06e-83805fe2d49e None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:21:15.706736 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-0666835a-4d35-400c-b06e-83805fe2d49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:21:15.836650 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666835a-4d35-400c-b06e-83805fe2d49e None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:21:15.880957 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:21:15.918287 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d73357-d2ca-4c96-ad0f-f63f8d46c31c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:21:15.918942 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d73357-d2ca-4c96-ad0f-f63f8d46c31c service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:21:15.919208 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d73357-d2ca-4c96-ad0f-f63f8d46c31c service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:21:15.919482 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d73357-d2ca-4c96-ad0f-f63f8d46c31c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:21:15.921171 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-e5d73357-d2ca-4c96-ad0f-f63f8d46c31c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:21:16.037883 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d73357-d2ca-4c96-ad0f-f63f8d46c31c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:21:16.039366 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d73357-d2ca-4c96-ad0f-f63f8d46c31c service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:21:16.060240 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 730/1449] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:21:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:21:18.191755 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac420d-8bb6-412d-9f7b-1f96e856c541 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:21:18.192630 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac420d-8bb6-412d-9f7b-1f96e856c541 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:21:18.192630 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac420d-8bb6-412d-9f7b-1f96e856c541 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:21:18.194819 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 720/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 22:21:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:21:18.201088 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e548e3-d5ad-4614-b15f-063bd0ffa531 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:21:18.201750 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e548e3-d5ad-4614-b15f-063bd0ffa531 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:21:18.201912 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e548e3-d5ad-4614-b15f-063bd0ffa531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:21:18.276948 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-e2e548e3-d5ad-4614-b15f-063bd0ffa531 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:21:18.278196 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-e2e548e3-d5ad-4614-b15f-063bd0ffa531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:21:18.299512 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:21:18.383771 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 731/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 22:21:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:21:18.673567 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac420d-8bb6-412d-9f7b-1f96e856c541 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:21:18.676396 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-caac420d-8bb6-412d-9f7b-1f96e856c541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:21:18.802748 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac420d-8bb6-412d-9f7b-1f96e856c541 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:21:18.829809 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:21:18.899468 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee40919-9bb1-456f-b287-2e8e718392dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:21:18.900129 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee40919-9bb1-456f-b287-2e8e718392dc service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:21:18.900415 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee40919-9bb1-456f-b287-2e8e718392dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:21:18.900718 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee40919-9bb1-456f-b287-2e8e718392dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:21:18.902367 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-cee40919-9bb1-456f-b287-2e8e718392dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:21:19.019512 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee40919-9bb1-456f-b287-2e8e718392dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:21:19.020964 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee40919-9bb1-456f-b287-2e8e718392dc service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:21:19.041193 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 721/1452] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:21:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:21:21.079913 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2b9d7-6a8e-48e5-8309-3e8233c9a210 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:21:21.080511 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2b9d7-6a8e-48e5-8309-3e8233c9a210 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:21:21.080511 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2b9d7-6a8e-48e5-8309-3e8233c9a210 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:21:21.081902 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 732/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 22:21:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:21:21.088977 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3876a4-4935-4b4c-a537-c5242d215fb3 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:21:21.089738 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3876a4-4935-4b4c-a537-c5242d215fb3 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:21:21.089847 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3876a4-4935-4b4c-a537-c5242d215fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:21:21.177718 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:21:21.181032 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-3a3876a4-4935-4b4c-a537-c5242d215fb3 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:21:21.183323 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3a3876a4-4935-4b4c-a537-c5242d215fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:21:21.301771 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 722/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 22:21:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:21:21.592135 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c2b9d7-6a8e-48e5-8309-3e8233c9a210 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:21:21.594690 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-36c2b9d7-6a8e-48e5-8309-3e8233c9a210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:21:21.710238 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c2b9d7-6a8e-48e5-8309-3e8233c9a210 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:21:21.762425 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:21:21.789175 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99075c33-8d2f-45aa-98ce-c47823ca1c26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:21:21.789789 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99075c33-8d2f-45aa-98ce-c47823ca1c26 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:21:21.790065 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99075c33-8d2f-45aa-98ce-c47823ca1c26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:21:21.790337 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99075c33-8d2f-45aa-98ce-c47823ca1c26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:21:21.791975 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-99075c33-8d2f-45aa-98ce-c47823ca1c26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:21:21.912833 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99075c33-8d2f-45aa-98ce-c47823ca1c26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:21:21.914288 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99075c33-8d2f-45aa-98ce-c47823ca1c26 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:21:21.933955 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 733/1455] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:21:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:21:23.891472 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6acccb-3ac1-4d6c-b4d8-1c7d8b51bad5 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:21:23.892047 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6acccb-3ac1-4d6c-b4d8-1c7d8b51bad5 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:21:23.892047 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6acccb-3ac1-4d6c-b4d8-1c7d8b51bad5 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:21:23.894120 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 723/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 22:21:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:21:23.900486 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726483a8-571e-471d-9c63-e70af12ab8c1 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:21:23.900965 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726483a8-571e-471d-9c63-e70af12ab8c1 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:21:23.901077 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726483a8-571e-471d-9c63-e70af12ab8c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:21:23.992973 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-726483a8-571e-471d-9c63-e70af12ab8c1 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:21:23.994400 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-726483a8-571e-471d-9c63-e70af12ab8c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:21:24.031692 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:21:24.111724 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 734/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 22:21:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:21:24.392338 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6acccb-3ac1-4d6c-b4d8-1c7d8b51bad5 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:21:24.393912 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-ff6acccb-3ac1-4d6c-b4d8-1c7d8b51bad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:21:24.508849 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6acccb-3ac1-4d6c-b4d8-1c7d8b51bad5 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:21:24.539846 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:21:24.588599 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fa29de-238f-48a7-b6f4-072cca2cfcd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:21:24.589216 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fa29de-238f-48a7-b6f4-072cca2cfcd5 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:21:24.589497 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fa29de-238f-48a7-b6f4-072cca2cfcd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:21:24.589775 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fa29de-238f-48a7-b6f4-072cca2cfcd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:21:24.591386 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-64fa29de-238f-48a7-b6f4-072cca2cfcd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:21:24.711656 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fa29de-238f-48a7-b6f4-072cca2cfcd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:21:24.713066 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fa29de-238f-48a7-b6f4-072cca2cfcd5 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:21:24.733548 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 724/1458] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:21:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:21:26.709718 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278dda7-e941-45c6-9b5a-8d34919c81ae None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:21:26.711114 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278dda7-e941-45c6-9b5a-8d34919c81ae None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:21:26.711114 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278dda7-e941-45c6-9b5a-8d34919c81ae None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:21:26.714023 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 735/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 22:21:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:21:26.723304 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0f8ce-3854-41dc-a560-0fb462aa3d2d None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:21:26.724257 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0f8ce-3854-41dc-a560-0fb462aa3d2d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:21:26.724257 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0f8ce-3854-41dc-a560-0fb462aa3d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:21:26.804869 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-24c0f8ce-3854-41dc-a560-0fb462aa3d2d None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:21:26.806119 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-24c0f8ce-3854-41dc-a560-0fb462aa3d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:21:26.815003 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:21:26.923363 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 725/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 22:21:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:21:27.226767 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d278dda7-e941-45c6-9b5a-8d34919c81ae None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:21:27.229401 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d278dda7-e941-45c6-9b5a-8d34919c81ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:21:27.359234 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d278dda7-e941-45c6-9b5a-8d34919c81ae None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:21:27.430537 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:21:27.456986 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb1021-80d3-4a97-96b2-3d96cc368bad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:21:27.457817 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb1021-80d3-4a97-96b2-3d96cc368bad service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:21:27.458232 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb1021-80d3-4a97-96b2-3d96cc368bad service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:21:27.458509 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb1021-80d3-4a97-96b2-3d96cc368bad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:21:27.460149 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-a0cb1021-80d3-4a97-96b2-3d96cc368bad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:21:27.590204 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cb1021-80d3-4a97-96b2-3d96cc368bad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:21:27.591656 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cb1021-80d3-4a97-96b2-3d96cc368bad service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:21:27.615573 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 736/1461] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:21:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:21:29.673207 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8bd709-61cc-4e57-b5ab-f7d920edf5cc None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:21:29.674041 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8bd709-61cc-4e57-b5ab-f7d920edf5cc None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:21:29.674041 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8bd709-61cc-4e57-b5ab-f7d920edf5cc None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:21:29.676204 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 726/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 22:21:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:21:29.682681 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8008b-7a81-43b9-9799-0aa004f5e9bd None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:21:29.683150 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8008b-7a81-43b9-9799-0aa004f5e9bd None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:21:29.683257 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8008b-7a81-43b9-9799-0aa004f5e9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:21:29.764811 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-f8f8008b-7a81-43b9-9799-0aa004f5e9bd None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:21:29.765976 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f8f8008b-7a81-43b9-9799-0aa004f5e9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:21:29.814735 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:21:29.883030 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 737/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 22:21:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:21:30.170119 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8bd709-61cc-4e57-b5ab-f7d920edf5cc None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:21:30.172646 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-6f8bd709-61cc-4e57-b5ab-f7d920edf5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:21:30.298151 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8bd709-61cc-4e57-b5ab-f7d920edf5cc None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:21:30.338379 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:21:30.375916 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602aeb98-c588-45a3-a1b0-5102326cb6d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:21:30.376560 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602aeb98-c588-45a3-a1b0-5102326cb6d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:21:30.376843 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602aeb98-c588-45a3-a1b0-5102326cb6d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:21:30.377112 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602aeb98-c588-45a3-a1b0-5102326cb6d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:21:30.378735 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-602aeb98-c588-45a3-a1b0-5102326cb6d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:21:30.504433 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602aeb98-c588-45a3-a1b0-5102326cb6d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:21:30.505678 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602aeb98-c588-45a3-a1b0-5102326cb6d6 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:21:30.526876 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 727/1464] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:21:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:21:32.467539 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f689b-8310-4305-8d29-e4c4be18d679 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:21:32.468425 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f689b-8310-4305-8d29-e4c4be18d679 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:21:32.468425 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f689b-8310-4305-8d29-e4c4be18d679 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:21:32.470615 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 738/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 22:21:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:21:32.477265 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5dd5c1-fa4e-401d-9c0b-ca878d35bc9b None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:21:32.478061 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5dd5c1-fa4e-401d-9c0b-ca878d35bc9b None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:21:32.478219 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5dd5c1-fa4e-401d-9c0b-ca878d35bc9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:21:32.554694 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-be5dd5c1-fa4e-401d-9c0b-ca878d35bc9b None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:21:32.555897 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-be5dd5c1-fa4e-401d-9c0b-ca878d35bc9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:21:32.576547 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:21:32.658083 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 728/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 22:21:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:21:32.933720 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5f689b-8310-4305-8d29-e4c4be18d679 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:21:32.935281 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-be5f689b-8310-4305-8d29-e4c4be18d679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:21:33.176796 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5f689b-8310-4305-8d29-e4c4be18d679 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:21:33.243377 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:21:33.251870 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e60ac-b08a-4b22-8eb8-4bb3204b4e97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:21:33.252477 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e60ac-b08a-4b22-8eb8-4bb3204b4e97 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:21:33.252782 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e60ac-b08a-4b22-8eb8-4bb3204b4e97 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:21:33.253048 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e60ac-b08a-4b22-8eb8-4bb3204b4e97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:21:33.255212 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7b5e60ac-b08a-4b22-8eb8-4bb3204b4e97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:21:33.375169 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e60ac-b08a-4b22-8eb8-4bb3204b4e97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:21:33.376664 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e60ac-b08a-4b22-8eb8-4bb3204b4e97 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:21:33.397454 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 739/1467] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:21:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:21:35.363960 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03ca12-3f4c-4db1-8592-68e5ada96205 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:21:35.364592 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03ca12-3f4c-4db1-8592-68e5ada96205 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:21:35.364592 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03ca12-3f4c-4db1-8592-68e5ada96205 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:21:35.365926 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 729/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 22:21:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:21:35.372424 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ebdbc-0e4e-4844-b6e3-4de40230defc None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:21:35.373191 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ebdbc-0e4e-4844-b6e3-4de40230defc None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:21:35.373365 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ebdbc-0e4e-4844-b6e3-4de40230defc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:21:35.449557 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-9a9ebdbc-0e4e-4844-b6e3-4de40230defc None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:21:35.450762 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-9a9ebdbc-0e4e-4844-b6e3-4de40230defc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:21:35.508682 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:21:35.564934 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 740/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 22:21:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:21:35.850839 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03ca12-3f4c-4db1-8592-68e5ada96205 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:21:35.852417 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-9b03ca12-3f4c-4db1-8592-68e5ada96205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:21:35.967052 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03ca12-3f4c-4db1-8592-68e5ada96205 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:21:36.015594 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:21:36.044392 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa4c76-8ebd-4f87-bf7f-1f550db46db4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:21:36.045040 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa4c76-8ebd-4f87-bf7f-1f550db46db4 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:21:36.045318 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa4c76-8ebd-4f87-bf7f-1f550db46db4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:21:36.045592 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa4c76-8ebd-4f87-bf7f-1f550db46db4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:21:36.047203 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-ccaa4c76-8ebd-4f87-bf7f-1f550db46db4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:21:36.172541 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaa4c76-8ebd-4f87-bf7f-1f550db46db4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:21:36.173992 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaa4c76-8ebd-4f87-bf7f-1f550db46db4 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:21:36.193217 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 730/1470] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:21:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:21:45.561538 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=22 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:21:46.190515 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=66 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:21:55.919012 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66819b2f-dac8-460a-9d3a-4ec71e524b71 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:21:55.919650 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66819b2f-dac8-460a-9d3a-4ec71e524b71 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:21:55.919650 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66819b2f-dac8-460a-9d3a-4ec71e524b71 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:21:55.920952 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 741/1471] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:21:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:21:55.930473 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255a8f3-1abd-422c-b33a-3c29e8f5cffb None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:21:55.930976 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255a8f3-1abd-422c-b33a-3c29e8f5cffb None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:21:55.930976 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255a8f3-1abd-422c-b33a-3c29e8f5cffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:21:56.012674 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-9255a8f3-1abd-422c-b33a-3c29e8f5cffb None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:21:56.013913 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-9255a8f3-1abd-422c-b33a-3c29e8f5cffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:21:56.116169 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 731/1472] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:21:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:21:56.422670 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1fe033-391f-4b7f-b384-4253ed5b72c2 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:21:56.423043 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1fe033-391f-4b7f-b384-4253ed5b72c2 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:21:56.423402 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1fe033-391f-4b7f-b384-4253ed5b72c2 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:21:56.425490 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 742/1473] 10.222.0.36 () {54 vars in 967 bytes} [Mon Aug 29 22:21:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:21:56.430898 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d661ea-fb75-4669-9c63-5ab4dfd05c77 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:21:56.431194 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d661ea-fb75-4669-9c63-5ab4dfd05c77 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:21:56.431479 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d661ea-fb75-4669-9c63-5ab4dfd05c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:21:56.515428 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-e2d661ea-fb75-4669-9c63-5ab4dfd05c77 None None] MFA Rules not processed for user `e7a399ee5db44100a88a4ffb451512aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:21:56.516710 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e2d661ea-fb75-4669-9c63-5ab4dfd05c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:21:56.542435 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:21:56.604288 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 732/1474] 10.222.0.36 () {58 vars in 1064 bytes} [Mon Aug 29 22:21:56 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:21:56.616097 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1fe033-391f-4b7f-b384-4253ed5b72c2 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:21:56.617708 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-8d1fe033-391f-4b7f-b384-4253ed5b72c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:21:56.724022 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1fe033-391f-4b7f-b384-4253ed5b72c2 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:21:56.805158 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df6e9d-0b43-43d9-bf28-0b972c14e7b6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a399ee5db44100a88a4ffb451512aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:21:56.805802 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df6e9d-0b43-43d9-bf28-0b972c14e7b6 service glance] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:21:56.806126 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df6e9d-0b43-43d9-bf28-0b972c14e7b6 service glance] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:21:56.806395 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df6e9d-0b43-43d9-bf28-0b972c14e7b6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:21:56.808035 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-e7df6e9d-0b43-43d9-bf28-0b972c14e7b6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:21:56.867493 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:21:56.931331 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7df6e9d-0b43-43d9-bf28-0b972c14e7b6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:21:56.932913 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7df6e9d-0b43-43d9-bf28-0b972c14e7b6 service glance] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:21:56.952696 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 743/1475] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:21:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:21:59.002389 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54792e49-d093-4d25-9f99-42029e763b1a None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:21:59.003251 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54792e49-d093-4d25-9f99-42029e763b1a None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:21:59.003251 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54792e49-d093-4d25-9f99-42029e763b1a None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:21:59.005160 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 733/1476] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:21:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:21:59.011371 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726d202-80d6-4eaf-aac8-68f9a72ebec9 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:21:59.012080 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726d202-80d6-4eaf-aac8-68f9a72ebec9 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:21:59.012233 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726d202-80d6-4eaf-aac8-68f9a72ebec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:21:59.100240 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-b726d202-80d6-4eaf-aac8-68f9a72ebec9 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:21:59.101307 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b726d202-80d6-4eaf-aac8-68f9a72ebec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:21:59.216506 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 744/1477] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:21:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:21:59.486667 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54792e49-d093-4d25-9f99-42029e763b1a None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:21:59.488940 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-54792e49-d093-4d25-9f99-42029e763b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:21:59.643834 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54792e49-d093-4d25-9f99-42029e763b1a None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:21:59.709101 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:21:59.765922 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ecf7b-1a18-454a-868c-523da79a15d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:21:59.766532 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ecf7b-1a18-454a-868c-523da79a15d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:21:59.766910 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ecf7b-1a18-454a-868c-523da79a15d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:21:59.767346 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ecf7b-1a18-454a-868c-523da79a15d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:21:59.768116 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0ecf7b-1a18-454a-868c-523da79a15d5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:21:59.770682 dv-cinder-854268-3-smb devstack@keystone.service[81514]: WARNING py.warnings [None req-be0ecf7b-1a18-454a-868c-523da79a15d5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 22:21:59.770682 dv-cinder-854268-3-smb devstack@keystone.service[81514]: warnings.warn(msg) Aug 29 22:21:59.770682 dv-cinder-854268-3-smb devstack@keystone.service[81514]: Aug 29 22:21:59.772671 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0ecf7b-1a18-454a-868c-523da79a15d5 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:21:59.795338 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 734/1478] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Aug 29 22:21:59 2022] GET /identity/v3/projects => generated 2553 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:22:01.797061 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43019765-0fda-461b-a083-0c496ebe3982 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:22:01.797674 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43019765-0fda-461b-a083-0c496ebe3982 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:22:01.797674 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43019765-0fda-461b-a083-0c496ebe3982 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:22:01.798984 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 745/1479] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:22:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:22:01.805207 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15156f0f-61e8-4aa1-bf84-db9ae36f5334 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:22:01.805637 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15156f0f-61e8-4aa1-bf84-db9ae36f5334 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:22:01.805752 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15156f0f-61e8-4aa1-bf84-db9ae36f5334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:22:01.879030 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-15156f0f-61e8-4aa1-bf84-db9ae36f5334 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:22:01.880732 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-15156f0f-61e8-4aa1-bf84-db9ae36f5334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:22:01.991932 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 735/1480] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:22:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:22:02.304081 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43019765-0fda-461b-a083-0c496ebe3982 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:22:02.306191 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-43019765-0fda-461b-a083-0c496ebe3982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:22:02.320205 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:22:02.484405 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43019765-0fda-461b-a083-0c496ebe3982 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:22:02.584808 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:22:02.623354 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeead18-e7bb-4fea-9ca7-0412136922b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b7213b7111456a93e294ce40b95b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:22:02.623988 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeead18-e7bb-4fea-9ca7-0412136922b9 service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:22:02.624275 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeead18-e7bb-4fea-9ca7-0412136922b9 service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:22:02.624575 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeead18-e7bb-4fea-9ca7-0412136922b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:22:02.626227 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-adeead18-e7bb-4fea-9ca7-0412136922b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:22:02.724097 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeead18-e7bb-4fea-9ca7-0412136922b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:22:02.725763 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeead18-e7bb-4fea-9ca7-0412136922b9 service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:22:02.745134 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 746/1481] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:22:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:22:04.871225 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a17ec-ef02-40a1-a521-47938934e605 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:22:04.872148 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a17ec-ef02-40a1-a521-47938934e605 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:22:04.872148 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a17ec-ef02-40a1-a521-47938934e605 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:22:04.874312 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 736/1482] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:22:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:22:04.880636 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323b908-9a8a-463e-b3b7-ee37b03f04b6 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:22:04.881077 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323b908-9a8a-463e-b3b7-ee37b03f04b6 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:22:04.881178 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323b908-9a8a-463e-b3b7-ee37b03f04b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:22:04.954732 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-7323b908-9a8a-463e-b3b7-ee37b03f04b6 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:22:04.956037 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7323b908-9a8a-463e-b3b7-ee37b03f04b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:22:05.006403 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:22:05.059625 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 747/1483] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:22:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:22:05.347003 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61a17ec-ef02-40a1-a521-47938934e605 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:22:05.350232 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-d61a17ec-ef02-40a1-a521-47938934e605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:22:05.383558 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:22:05.473338 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61a17ec-ef02-40a1-a521-47938934e605 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:22:05.554129 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3344e1-f26c-4606-a834-85955991c276 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:22:05.554755 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3344e1-f26c-4606-a834-85955991c276 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:22:05.555038 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3344e1-f26c-4606-a834-85955991c276 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:22:05.555312 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3344e1-f26c-4606-a834-85955991c276 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:22:05.557006 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-2c3344e1-f26c-4606-a834-85955991c276 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:22:05.634698 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:22:05.675760 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3344e1-f26c-4606-a834-85955991c276 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:22:05.677264 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3344e1-f26c-4606-a834-85955991c276 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:22:05.697322 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 737/1484] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:22:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:22:07.656342 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9dcfb-faf4-4458-88ea-15435d408382 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:22:07.656981 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9dcfb-faf4-4458-88ea-15435d408382 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:22:07.656981 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9dcfb-faf4-4458-88ea-15435d408382 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:22:07.658291 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 748/1485] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:22:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:22:07.664815 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63200c7-4800-46a1-ab2e-cf7f0d71185d None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:22:07.665690 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63200c7-4800-46a1-ab2e-cf7f0d71185d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:22:07.665690 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63200c7-4800-46a1-ab2e-cf7f0d71185d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:22:07.741580 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-b63200c7-4800-46a1-ab2e-cf7f0d71185d None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:22:07.742781 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b63200c7-4800-46a1-ab2e-cf7f0d71185d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:22:07.848227 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 738/1486] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:22:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:22:08.132105 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b9dcfb-faf4-4458-88ea-15435d408382 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:22:08.133717 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d9b9dcfb-faf4-4458-88ea-15435d408382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:22:08.246993 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b9dcfb-faf4-4458-88ea-15435d408382 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:22:08.327861 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:22:08.329913 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a8f63-d504-4c48-8c51-8e9efba23a4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:22:08.331382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a8f63-d504-4c48-8c51-8e9efba23a4b service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:22:08.331920 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a8f63-d504-4c48-8c51-8e9efba23a4b service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:22:08.332909 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a8f63-d504-4c48-8c51-8e9efba23a4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:22:08.334757 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-801a8f63-d504-4c48-8c51-8e9efba23a4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:22:08.464734 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a8f63-d504-4c48-8c51-8e9efba23a4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:22:08.466112 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a8f63-d504-4c48-8c51-8e9efba23a4b service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:22:08.485256 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 749/1487] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:22:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:22:10.563110 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1315b-8941-48c6-8395-21f115dc02d6 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:22:10.564008 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1315b-8941-48c6-8395-21f115dc02d6 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:22:10.564008 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1315b-8941-48c6-8395-21f115dc02d6 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:22:10.566924 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 739/1488] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:22:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:22:10.573685 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9d835-1fc6-45ab-8c4e-67916c8c1aff None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:22:10.574175 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9d835-1fc6-45ab-8c4e-67916c8c1aff None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:22:10.574274 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9d835-1fc6-45ab-8c4e-67916c8c1aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:22:10.656710 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-b2a9d835-1fc6-45ab-8c4e-67916c8c1aff None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:22:10.657950 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b2a9d835-1fc6-45ab-8c4e-67916c8c1aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:22:10.715490 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:22:10.766911 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 750/1489] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:22:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:22:11.065187 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1315b-8941-48c6-8395-21f115dc02d6 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:22:11.067914 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-88e1315b-8941-48c6-8395-21f115dc02d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:22:11.116507 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:22:11.189295 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1315b-8941-48c6-8395-21f115dc02d6 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:22:11.265985 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46108b06-57cd-4d89-9972-68b9617cef1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:22:11.266621 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46108b06-57cd-4d89-9972-68b9617cef1d service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:22:11.266898 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46108b06-57cd-4d89-9972-68b9617cef1d service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:22:11.267177 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46108b06-57cd-4d89-9972-68b9617cef1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:22:11.268853 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-46108b06-57cd-4d89-9972-68b9617cef1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:22:11.365332 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:22:11.395215 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46108b06-57cd-4d89-9972-68b9617cef1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:22:11.397035 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46108b06-57cd-4d89-9972-68b9617cef1d service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:22:11.416406 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 740/1490] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:22:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:22:13.595390 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294536e-ccac-4e08-8611-d162fda697ef None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:22:13.595994 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294536e-ccac-4e08-8611-d162fda697ef None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:22:13.595994 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294536e-ccac-4e08-8611-d162fda697ef None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:22:13.597767 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 751/1491] 10.222.0.36 () {54 vars in 927 bytes} [Mon Aug 29 22:22:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:22:13.604286 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab82869-048e-4fa1-b561-5bc05710ef06 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:22:13.605077 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab82869-048e-4fa1-b561-5bc05710ef06 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:22:13.605247 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab82869-048e-4fa1-b561-5bc05710ef06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:22:13.687736 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-fab82869-048e-4fa1-b561-5bc05710ef06 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:22:13.689007 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-fab82869-048e-4fa1-b561-5bc05710ef06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:22:13.794734 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 741/1492] 10.222.0.36 () {58 vars in 1024 bytes} [Mon Aug 29 22:22:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:22:14.100370 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294536e-ccac-4e08-8611-d162fda697ef None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:22:14.101981 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-a294536e-ccac-4e08-8611-d162fda697ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:22:14.232252 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294536e-ccac-4e08-8611-d162fda697ef None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:22:14.317299 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d41d0ea-86ae-4282-bb8c-2c38b99d428d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:22:14.317922 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41d0ea-86ae-4282-bb8c-2c38b99d428d service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:22:14.318204 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41d0ea-86ae-4282-bb8c-2c38b99d428d service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:22:14.318466 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41d0ea-86ae-4282-bb8c-2c38b99d428d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:22:14.320190 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-3d41d0ea-86ae-4282-bb8c-2c38b99d428d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:22:14.331806 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:22:14.450149 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d41d0ea-86ae-4282-bb8c-2c38b99d428d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:22:14.451518 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d41d0ea-86ae-4282-bb8c-2c38b99d428d service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:22:14.472253 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 752/1493] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:22:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:22:23.792625 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=82 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:22:24.469528 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=50 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:23:35.193908 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8aa448-548e-42a2-847a-53138d056fb8 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:23:35.194751 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8aa448-548e-42a2-847a-53138d056fb8 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:23:35.194751 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8aa448-548e-42a2-847a-53138d056fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:23:35.284126 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-6a8aa448-548e-42a2-847a-53138d056fb8 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:23:35.285369 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-6a8aa448-548e-42a2-847a-53138d056fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:23:35.391601 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 742/1494] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:23:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:23:35.400991 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70c615-dc78-4203-9d20-1acb4154ea16 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:23:35.401800 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70c615-dc78-4203-9d20-1acb4154ea16 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:23:35.402060 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70c615-dc78-4203-9d20-1acb4154ea16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:23:35.485429 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-aa70c615-dc78-4203-9d20-1acb4154ea16 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:23:35.486628 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-aa70c615-dc78-4203-9d20-1acb4154ea16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:23:35.613652 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 753/1495] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:23:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:23:35.618737 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8aa448-548e-42a2-847a-53138d056fb8 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:23:35.619975 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-6a8aa448-548e-42a2-847a-53138d056fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:23:35.632165 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8aa448-548e-42a2-847a-53138d056fb8 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:23:35.708132 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:23:35.742334 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d261df30-4980-4edc-b9fc-7cf0e853e261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:23:35.742872 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261df30-4980-4edc-b9fc-7cf0e853e261 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:23:35.743151 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261df30-4980-4edc-b9fc-7cf0e853e261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:23:35.743421 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261df30-4980-4edc-b9fc-7cf0e853e261 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:23:35.744069 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d261df30-4980-4edc-b9fc-7cf0e853e261 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:23:35.744365 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d261df30-4980-4edc-b9fc-7cf0e853e261 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:23:35.745407 dv-cinder-854268-3-smb devstack@keystone.service[81514]: WARNING py.warnings [None req-d261df30-4980-4edc-b9fc-7cf0e853e261 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 22:23:35.745407 dv-cinder-854268-3-smb devstack@keystone.service[81514]: warnings.warn(msg) Aug 29 22:23:35.745407 dv-cinder-854268-3-smb devstack@keystone.service[81514]: Aug 29 22:23:35.746303 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d261df30-4980-4edc-b9fc-7cf0e853e261 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:23:35.757767 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 743/1496] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:23:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:23:35.766827 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70c615-dc78-4203-9d20-1acb4154ea16 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:23:35.776524 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70c615-dc78-4203-9d20-1acb4154ea16 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:23:35.850949 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:23:35.886034 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed5dec-7948-48d8-9fd4-05e427815bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:23:35.886663 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed5dec-7948-48d8-9fd4-05e427815bdf admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:23:35.886935 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed5dec-7948-48d8-9fd4-05e427815bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:23:35.887202 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed5dec-7948-48d8-9fd4-05e427815bdf admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:23:35.887918 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeed5dec-7948-48d8-9fd4-05e427815bdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:23:35.889914 dv-cinder-854268-3-smb devstack@keystone.service[81515]: WARNING py.warnings [None req-eeed5dec-7948-48d8-9fd4-05e427815bdf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 22:23:35.889914 dv-cinder-854268-3-smb devstack@keystone.service[81515]: warnings.warn(msg) Aug 29 22:23:35.889914 dv-cinder-854268-3-smb devstack@keystone.service[81515]: Aug 29 22:23:35.891101 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeed5dec-7948-48d8-9fd4-05e427815bdf admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:23:35.950778 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 754/1497] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:23:35 2022] POST /identity/v3/projects => generated 379 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:23:35.956078 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d261df30-4980-4edc-b9fc-7cf0e853e261 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:23:35.957599 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-d261df30-4980-4edc-b9fc-7cf0e853e261 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:23:35.992734 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d261df30-4980-4edc-b9fc-7cf0e853e261 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:23:36.093808 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c185d-50cc-42e3-a498-6bb0a97e2c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:23:36.094474 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c185d-50cc-42e3-a498-6bb0a97e2c08 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:23:36.095068 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c185d-50cc-42e3-a498-6bb0a97e2c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:23:36.095068 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c185d-50cc-42e3-a498-6bb0a97e2c08 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:23:36.095694 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c185d-50cc-42e3-a498-6bb0a97e2c08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:23:36.096736 dv-cinder-854268-3-smb devstack@keystone.service[81514]: WARNING py.warnings [None req-828c185d-50cc-42e3-a498-6bb0a97e2c08 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 22:23:36.096736 dv-cinder-854268-3-smb devstack@keystone.service[81514]: warnings.warn(msg) Aug 29 22:23:36.096736 dv-cinder-854268-3-smb devstack@keystone.service[81514]: Aug 29 22:23:36.097959 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c185d-50cc-42e3-a498-6bb0a97e2c08 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:23:36.146685 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 744/1498] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:23:35 2022] POST /identity/v3/users => generated 290 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:23:36.151374 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed5dec-7948-48d8-9fd4-05e427815bdf admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:23:36.153903 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-eeed5dec-7948-48d8-9fd4-05e427815bdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:23:36.221869 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed5dec-7948-48d8-9fd4-05e427815bdf admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:23:36.316317 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:23:36.328433 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aee878-1d7c-4194-9fc0-8faae8902830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:23:36.329272 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aee878-1d7c-4194-9fc0-8faae8902830 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:23:36.329569 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aee878-1d7c-4194-9fc0-8faae8902830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:23:36.329840 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aee878-1d7c-4194-9fc0-8faae8902830 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:23:36.330511 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aee878-1d7c-4194-9fc0-8faae8902830 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:23:36.331491 dv-cinder-854268-3-smb devstack@keystone.service[81515]: WARNING py.warnings [None req-08aee878-1d7c-4194-9fc0-8faae8902830 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 22:23:36.331491 dv-cinder-854268-3-smb devstack@keystone.service[81515]: warnings.warn(msg) Aug 29 22:23:36.331491 dv-cinder-854268-3-smb devstack@keystone.service[81515]: Aug 29 22:23:36.332382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aee878-1d7c-4194-9fc0-8faae8902830 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:23:36.345691 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 755/1499] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:23:36 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:23:36.350115 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c185d-50cc-42e3-a498-6bb0a97e2c08 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:23:36.351691 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-828c185d-50cc-42e3-a498-6bb0a97e2c08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:23:36.363434 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c185d-50cc-42e3-a498-6bb0a97e2c08 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:23:36.392692 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:23:36.475256 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5702883-06ab-4300-8cf5-cbd701d5b79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:23:36.475889 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5702883-06ab-4300-8cf5-cbd701d5b79c admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:23:36.476163 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5702883-06ab-4300-8cf5-cbd701d5b79c admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:23:36.476426 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5702883-06ab-4300-8cf5-cbd701d5b79c admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:23:36.477111 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5702883-06ab-4300-8cf5-cbd701d5b79c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:23:36.478126 dv-cinder-854268-3-smb devstack@keystone.service[81514]: WARNING py.warnings [None req-d5702883-06ab-4300-8cf5-cbd701d5b79c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 22:23:36.478126 dv-cinder-854268-3-smb devstack@keystone.service[81514]: warnings.warn(msg) Aug 29 22:23:36.478126 dv-cinder-854268-3-smb devstack@keystone.service[81514]: Aug 29 22:23:36.479026 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5702883-06ab-4300-8cf5-cbd701d5b79c admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:23:36.492356 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 745/1500] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:23:36 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:23:36.496770 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aee878-1d7c-4194-9fc0-8faae8902830 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:23:36.498322 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-08aee878-1d7c-4194-9fc0-8faae8902830 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:23:36.532267 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aee878-1d7c-4194-9fc0-8faae8902830 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:23:36.632062 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65329c-d0c5-4155-8a6e-c41f60cc12a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:23:36.632662 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65329c-d0c5-4155-8a6e-c41f60cc12a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:23:36.632942 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65329c-d0c5-4155-8a6e-c41f60cc12a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:23:36.633214 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65329c-d0c5-4155-8a6e-c41f60cc12a3 admin admin] PATH_INFO: `/v3/projects/3bbe7c4ae524496dbfd2cfde93523b01/users/7e8cd297ceb64acd9fa636d6e0390366/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:23:36.655165 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa65329c-d0c5-4155-8a6e-c41f60cc12a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bbe7c4ae524496dbfd2cfde93523b01, user_id=7e8cd297ceb64acd9fa636d6e0390366, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:23:36.656182 dv-cinder-854268-3-smb devstack@keystone.service[81515]: WARNING py.warnings [None req-fa65329c-d0c5-4155-8a6e-c41f60cc12a3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 22:23:36.656182 dv-cinder-854268-3-smb devstack@keystone.service[81515]: warnings.warn(msg) Aug 29 22:23:36.656182 dv-cinder-854268-3-smb devstack@keystone.service[81515]: Aug 29 22:23:36.658491 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa65329c-d0c5-4155-8a6e-c41f60cc12a3 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:23:36.685499 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 756/1501] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:23:36 2022] PUT /identity/v3/projects/3bbe7c4ae524496dbfd2cfde93523b01/users/7e8cd297ceb64acd9fa636d6e0390366/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:23:36.698114 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f530c4-1e51-43d7-a85d-0d602182e8e3 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:23:36.698438 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f530c4-1e51-43d7-a85d-0d602182e8e3 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:23:36.698710 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f530c4-1e51-43d7-a85d-0d602182e8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:23:36.762041 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-16f530c4-1e51-43d7-a85d-0d602182e8e3 None None] MFA Rules not processed for user `7e8cd297ceb64acd9fa636d6e0390366`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:23:36.763248 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-16f530c4-1e51-43d7-a85d-0d602182e8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:23:36.844943 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 746/1502] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:23:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:23:36.860748 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71ba90-c543-4054-b8d3-2e45561e7893 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:23:36.861091 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71ba90-c543-4054-b8d3-2e45561e7893 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:23:36.861460 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71ba90-c543-4054-b8d3-2e45561e7893 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:23:36.863547 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 757/1503] 10.222.0.36 () {54 vars in 964 bytes} [Mon Aug 29 22:23:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:23:36.870436 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139779cf-981b-4720-91bd-5eef9e72285e None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:23:36.870724 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139779cf-981b-4720-91bd-5eef9e72285e None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:23:36.871002 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139779cf-981b-4720-91bd-5eef9e72285e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:23:36.905619 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:23:36.953783 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-139779cf-981b-4720-91bd-5eef9e72285e None None] MFA Rules not processed for user `d14db90aa108495e9c48584cdc2f7206`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:23:36.955004 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-139779cf-981b-4720-91bd-5eef9e72285e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:23:37.048058 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 747/1504] 10.222.0.36 () {58 vars in 1061 bytes} [Mon Aug 29 22:23:36 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:23:37.060080 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df71ba90-c543-4054-b8d3-2e45561e7893 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:23:37.062464 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-df71ba90-c543-4054-b8d3-2e45561e7893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:23:37.124344 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:23:37.183682 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df71ba90-c543-4054-b8d3-2e45561e7893 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:23:37.263403 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f509f6-e697-427d-8110-d7adf3b52d99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:23:37.264004 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f509f6-e697-427d-8110-d7adf3b52d99 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:23:37.264280 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f509f6-e697-427d-8110-d7adf3b52d99 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:23:37.264887 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f509f6-e697-427d-8110-d7adf3b52d99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:23:37.266753 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f5f509f6-e697-427d-8110-d7adf3b52d99 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:23:37.374738 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f509f6-e697-427d-8110-d7adf3b52d99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:23:37.376238 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f509f6-e697-427d-8110-d7adf3b52d99 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:23:37.379690 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:23:37.395281 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 758/1505] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:23:37 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:23:37.441913 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0692b-8c36-4209-b3d7-2dae20ce9302 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:23:37.442413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0692b-8c36-4209-b3d7-2dae20ce9302 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:23:37.442505 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0692b-8c36-4209-b3d7-2dae20ce9302 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:23:37.443719 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 748/1506] 10.222.0.36 () {52 vars in 830 bytes} [Mon Aug 29 22:23:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:23:37.448145 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f509f6-e697-427d-8110-d7adf3b52d99 service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:23:37.449995 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f5f509f6-e697-427d-8110-d7adf3b52d99 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:23:37.565724 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f509f6-e697-427d-8110-d7adf3b52d99 service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:23:37.666797 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9057f982-5507-45ac-8c46-02297ff81910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:23:37.667432 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057f982-5507-45ac-8c46-02297ff81910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:23:37.667713 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057f982-5507-45ac-8c46-02297ff81910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:23:37.667985 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057f982-5507-45ac-8c46-02297ff81910 admin admin] PATH_INFO: `/v3/users/7e8cd297ceb64acd9fa636d6e0390366` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:23:37.681688 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9057f982-5507-45ac-8c46-02297ff81910 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e8cd297ceb64acd9fa636d6e0390366)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:23:37.682715 dv-cinder-854268-3-smb devstack@keystone.service[81515]: WARNING py.warnings [None req-9057f982-5507-45ac-8c46-02297ff81910 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 22:23:37.682715 dv-cinder-854268-3-smb devstack@keystone.service[81515]: warnings.warn(msg) Aug 29 22:23:37.682715 dv-cinder-854268-3-smb devstack@keystone.service[81515]: Aug 29 22:23:37.683941 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9057f982-5507-45ac-8c46-02297ff81910 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:23:37.693956 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:23:37.761814 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9057f982-5507-45ac-8c46-02297ff81910 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e8cd297ceb64acd9fa636d6e0390366'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:23:37.777018 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9057f982-5507-45ac-8c46-02297ff81910 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e8cd297ceb64acd9fa636d6e0390366'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:23:37.777580 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9057f982-5507-45ac-8c46-02297ff81910 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e8cd297ceb64acd9fa636d6e0390366'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:23:37.790757 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9057f982-5507-45ac-8c46-02297ff81910 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e8cd297ceb64acd9fa636d6e0390366'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:23:37.791288 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9057f982-5507-45ac-8c46-02297ff81910 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e8cd297ceb64acd9fa636d6e0390366'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:23:37.833757 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 759/1507] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:23:37 2022] DELETE /identity/v3/users/7e8cd297ceb64acd9fa636d6e0390366 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:23:37.841063 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f15d1c-5398-40c2-b707-3014c67bc805 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:23:37.841389 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f15d1c-5398-40c2-b707-3014c67bc805 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:23:37.841697 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f15d1c-5398-40c2-b707-3014c67bc805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:23:37.905791 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-66f15d1c-5398-40c2-b707-3014c67bc805 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:23:37.907057 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-66f15d1c-5398-40c2-b707-3014c67bc805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:23:37.982535 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:23:37.995870 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 749/1508] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:23:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:23:38.009255 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9057f982-5507-45ac-8c46-02297ff81910 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:23:38.010490 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-9057f982-5507-45ac-8c46-02297ff81910 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:23:38.122533 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9057f982-5507-45ac-8c46-02297ff81910 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:23:38.185059 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:23:38.207172 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28bdb2c-e914-4a0a-b9a5-99bead6987b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:23:38.207786 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28bdb2c-e914-4a0a-b9a5-99bead6987b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:23:38.208068 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28bdb2c-e914-4a0a-b9a5-99bead6987b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:23:38.208339 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28bdb2c-e914-4a0a-b9a5-99bead6987b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:23:38.209985 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b28bdb2c-e914-4a0a-b9a5-99bead6987b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:23:38.326863 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28bdb2c-e914-4a0a-b9a5-99bead6987b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:23:38.328312 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28bdb2c-e914-4a0a-b9a5-99bead6987b7 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:23:38.353259 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 760/1509] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:23:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:23:38.730488 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f15d1c-5398-40c2-b707-3014c67bc805 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:23:38.732436 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-66f15d1c-5398-40c2-b707-3014c67bc805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:23:38.745456 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f15d1c-5398-40c2-b707-3014c67bc805 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:23:38.863524 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c89dc3-133d-4a13-ae9a-f89ae34614b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:23:38.864065 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c89dc3-133d-4a13-ae9a-f89ae34614b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:23:38.864344 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c89dc3-133d-4a13-ae9a-f89ae34614b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:23:38.864653 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c89dc3-133d-4a13-ae9a-f89ae34614b4 admin admin] PATH_INFO: `/v3/projects/3bbe7c4ae524496dbfd2cfde93523b01` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:23:38.877859 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c89dc3-133d-4a13-ae9a-f89ae34614b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bbe7c4ae524496dbfd2cfde93523b01)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:23:38.878897 dv-cinder-854268-3-smb devstack@keystone.service[81514]: WARNING py.warnings [None req-59c89dc3-133d-4a13-ae9a-f89ae34614b4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 22:23:38.878897 dv-cinder-854268-3-smb devstack@keystone.service[81514]: warnings.warn(msg) Aug 29 22:23:38.878897 dv-cinder-854268-3-smb devstack@keystone.service[81514]: Aug 29 22:23:38.880130 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c89dc3-133d-4a13-ae9a-f89ae34614b4 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:23:38.958163 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-59c89dc3-133d-4a13-ae9a-f89ae34614b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bbe7c4ae524496dbfd2cfde93523b01', 'request_id': 'req-59c89dc3-133d-4a13-ae9a-f89ae34614b4'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:23:38.972064 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-59c89dc3-133d-4a13-ae9a-f89ae34614b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bbe7c4ae524496dbfd2cfde93523b01', 'request_id': 'req-59c89dc3-133d-4a13-ae9a-f89ae34614b4'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:23:38.979460 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-59c89dc3-133d-4a13-ae9a-f89ae34614b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bbe7c4ae524496dbfd2cfde93523b01', 'request_id': 'req-59c89dc3-133d-4a13-ae9a-f89ae34614b4'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:23:39.008757 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-59c89dc3-133d-4a13-ae9a-f89ae34614b4 admin admin] The token cache is being invalidate because project 3bbe7c4ae524496dbfd2cfde93523b01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:23:39.009047 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-59c89dc3-133d-4a13-ae9a-f89ae34614b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:23:39.009468 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-59c89dc3-133d-4a13-ae9a-f89ae34614b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:23:39.010924 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 750/1510] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:23:38 2022] DELETE /identity/v3/projects/3bbe7c4ae524496dbfd2cfde93523b01 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:23:48.350700 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=62 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:23:49.006441 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:25:27.817666 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ce36c-d63a-4864-a669-1f20529bad97 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:25:27.818339 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ce36c-d63a-4864-a669-1f20529bad97 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:25:27.818339 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ce36c-d63a-4864-a669-1f20529bad97 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:25:27.819579 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 761/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 22:25:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:25:27.825722 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57ce9f-f6a4-4f82-b2d8-55dd26e359aa None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:25:27.826485 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57ce9f-f6a4-4f82-b2d8-55dd26e359aa None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:25:27.826636 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57ce9f-f6a4-4f82-b2d8-55dd26e359aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:25:27.918959 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-8b57ce9f-f6a4-4f82-b2d8-55dd26e359aa None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:25:27.920201 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-8b57ce9f-f6a4-4f82-b2d8-55dd26e359aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:25:28.040049 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 751/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 22:25:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:25:28.209828 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ce36c-d63a-4864-a669-1f20529bad97 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:25:28.213806 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-3b1ce36c-d63a-4864-a669-1f20529bad97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:25:28.356014 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ce36c-d63a-4864-a669-1f20529bad97 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:25:28.365718 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac817a7e-32b3-465a-988f-a9e7a947acfa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b7213b7111456a93e294ce40b95b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:25:28.366720 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac817a7e-32b3-465a-988f-a9e7a947acfa service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:25:28.367089 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac817a7e-32b3-465a-988f-a9e7a947acfa service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:25:28.367516 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac817a7e-32b3-465a-988f-a9e7a947acfa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:25:28.380808 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac817a7e-32b3-465a-988f-a9e7a947acfa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:25:28.382522 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac817a7e-32b3-465a-988f-a9e7a947acfa service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:25:28.393946 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 762/1513] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:25:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:25:29.256442 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e854f-9250-42e0-a347-51ed7b82d5ce None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:25:29.257309 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e854f-9250-42e0-a347-51ed7b82d5ce None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:25:29.257309 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e854f-9250-42e0-a347-51ed7b82d5ce None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:25:29.259758 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 752/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 22:25:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:25:29.272958 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a6f95-79d6-4d08-9b93-cd9ec19a0058 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:25:29.272958 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a6f95-79d6-4d08-9b93-cd9ec19a0058 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:25:29.272958 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a6f95-79d6-4d08-9b93-cd9ec19a0058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:25:29.295609 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-127a6f95-79d6-4d08-9b93-cd9ec19a0058 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:25:29.297062 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-127a6f95-79d6-4d08-9b93-cd9ec19a0058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:25:29.315984 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 763/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 22:25:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:25:29.475544 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e854f-9250-42e0-a347-51ed7b82d5ce None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:25:29.495649 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e854f-9250-42e0-a347-51ed7b82d5ce None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:25:29.502435 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e01bfa-de47-4701-9ee3-4b68d36dc209 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b7213b7111456a93e294ce40b95b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:25:29.503047 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e01bfa-de47-4701-9ee3-4b68d36dc209 service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:25:29.503327 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e01bfa-de47-4701-9ee3-4b68d36dc209 service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:25:29.503613 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e01bfa-de47-4701-9ee3-4b68d36dc209 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:25:29.512379 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e01bfa-de47-4701-9ee3-4b68d36dc209 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:25:29.513974 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e01bfa-de47-4701-9ee3-4b68d36dc209 service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:25:29.523706 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 753/1516] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:25:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:25:31.952560 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fedbba4-325a-4409-b51a-cf198ef71b4b None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:25:31.953319 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fedbba4-325a-4409-b51a-cf198ef71b4b None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:25:31.953319 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fedbba4-325a-4409-b51a-cf198ef71b4b None None] PATH_INFO: `/v3` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:25:31.955201 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 764/1517] 10.222.0.48 () {54 vars in 925 bytes} [Mon Aug 29 22:25:31 2022] GET /identity/v3 => generated 255 bytes in 5 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:25:31.975146 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21034b-a94c-4033-afce-6017a0c3ed93 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:25:31.975607 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21034b-a94c-4033-afce-6017a0c3ed93 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:25:31.975607 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21034b-a94c-4033-afce-6017a0c3ed93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:25:32.041018 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-bb21034b-a94c-4033-afce-6017a0c3ed93 None None] MFA Rules not processed for user `bce3d9397cca4ae58e14c8a5ae844f8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:25:32.042226 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-bb21034b-a94c-4033-afce-6017a0c3ed93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:25:32.059787 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:25:32.121954 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 754/1518] 10.222.0.48 () {58 vars in 1015 bytes} [Mon Aug 29 22:25:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:25:36.659442 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38a9cb-229d-4122-914c-f175369ad331 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:25:36.660055 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38a9cb-229d-4122-914c-f175369ad331 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:25:36.660055 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38a9cb-229d-4122-914c-f175369ad331 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:25:36.661868 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 765/1519] 10.222.0.36 () {54 vars in 961 bytes} [Mon Aug 29 22:25:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:25:36.667980 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c72100-f263-4f14-a1e8-3ac8d5bed0a6 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:25:36.668518 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c72100-f263-4f14-a1e8-3ac8d5bed0a6 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:25:36.668634 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c72100-f263-4f14-a1e8-3ac8d5bed0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:25:36.691290 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-d5c72100-f263-4f14-a1e8-3ac8d5bed0a6 None None] MFA Rules not processed for user `bce3d9397cca4ae58e14c8a5ae844f8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:25:36.692571 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-d5c72100-f263-4f14-a1e8-3ac8d5bed0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:25:36.703588 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 755/1520] 10.222.0.36 () {58 vars in 1058 bytes} [Mon Aug 29 22:25:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:25:36.712357 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a38a9cb-229d-4122-914c-f175369ad331 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:25:36.729101 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a38a9cb-229d-4122-914c-f175369ad331 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:25:36.735148 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d407f2-c963-423b-9392-7fc4e63364a8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce3d9397cca4ae58e14c8a5ae844f8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:25:36.735770 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d407f2-c963-423b-9392-7fc4e63364a8 service placement] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:25:36.736049 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d407f2-c963-423b-9392-7fc4e63364a8 service placement] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:25:36.736325 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d407f2-c963-423b-9392-7fc4e63364a8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:25:36.747017 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d407f2-c963-423b-9392-7fc4e63364a8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:25:36.748714 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d407f2-c963-423b-9392-7fc4e63364a8 service placement] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:25:36.760546 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 766/1521] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:25:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:25:40.806079 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3292eb7-d4b6-4769-a2d2-1a94c1f33010 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:25:40.806675 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3292eb7-d4b6-4769-a2d2-1a94c1f33010 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:25:40.806675 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3292eb7-d4b6-4769-a2d2-1a94c1f33010 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:25:40.808764 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 756/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 22:25:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:25:40.817741 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db86ee-bf2a-49a9-b87e-5eea0af9727b None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:25:40.818533 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db86ee-bf2a-49a9-b87e-5eea0af9727b None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:25:40.818723 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db86ee-bf2a-49a9-b87e-5eea0af9727b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:25:40.842548 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-03db86ee-bf2a-49a9-b87e-5eea0af9727b None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:25:40.843766 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-03db86ee-bf2a-49a9-b87e-5eea0af9727b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:25:40.852553 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 767/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 22:25:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:25:41.030544 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3292eb7-d4b6-4769-a2d2-1a94c1f33010 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:25:41.052494 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3292eb7-d4b6-4769-a2d2-1a94c1f33010 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:25:41.061342 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555a05e0-672f-464f-9fb7-31a3291d8305 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b7213b7111456a93e294ce40b95b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:25:41.061913 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a05e0-672f-464f-9fb7-31a3291d8305 service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:25:41.062193 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a05e0-672f-464f-9fb7-31a3291d8305 service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:25:41.062464 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a05e0-672f-464f-9fb7-31a3291d8305 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:25:41.072899 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555a05e0-672f-464f-9fb7-31a3291d8305 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:25:41.074806 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555a05e0-672f-464f-9fb7-31a3291d8305 service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:25:41.090519 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 757/1524] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:25:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:25:41.976868 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd251e-0095-40c1-833d-f39b86eb9f87 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:25:41.977544 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd251e-0095-40c1-833d-f39b86eb9f87 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:25:41.977544 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd251e-0095-40c1-833d-f39b86eb9f87 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:25:41.978803 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 768/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 22:25:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:25:41.984280 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eede13-be69-4392-981e-db6117a2a251 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:25:41.984799 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eede13-be69-4392-981e-db6117a2a251 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:25:41.984922 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eede13-be69-4392-981e-db6117a2a251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:25:42.014279 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-b1eede13-be69-4392-981e-db6117a2a251 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:25:42.015989 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b1eede13-be69-4392-981e-db6117a2a251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:25:42.027858 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 758/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 22:25:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:25:42.207372 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd251e-0095-40c1-833d-f39b86eb9f87 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:25:42.226176 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd251e-0095-40c1-833d-f39b86eb9f87 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:25:42.232587 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdeafd6-a780-4cbb-a38d-5d33474a1fc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b7213b7111456a93e294ce40b95b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:25:42.233232 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdeafd6-a780-4cbb-a38d-5d33474a1fc0 service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:25:42.233560 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdeafd6-a780-4cbb-a38d-5d33474a1fc0 service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:25:42.233828 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdeafd6-a780-4cbb-a38d-5d33474a1fc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:25:42.243668 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdeafd6-a780-4cbb-a38d-5d33474a1fc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:25:42.245449 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdeafd6-a780-4cbb-a38d-5d33474a1fc0 service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:25:42.260665 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 769/1527] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:25:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:25:46.493077 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade3099-eaed-406e-a0e5-241c84569533 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:25:46.493676 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade3099-eaed-406e-a0e5-241c84569533 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:25:46.493676 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade3099-eaed-406e-a0e5-241c84569533 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:25:46.494992 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 759/1528] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 22:25:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:25:46.501464 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf6588-b141-4de8-a7a6-e915e7e62e53 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:25:46.501954 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf6588-b141-4de8-a7a6-e915e7e62e53 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:25:46.502065 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf6588-b141-4de8-a7a6-e915e7e62e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:25:46.521919 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-72bf6588-b141-4de8-a7a6-e915e7e62e53 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:25:46.523099 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-72bf6588-b141-4de8-a7a6-e915e7e62e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:25:46.531545 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 770/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 22:25:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:25:46.821261 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade3099-eaed-406e-a0e5-241c84569533 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:25:46.823131 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3ade3099-eaed-406e-a0e5-241c84569533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:25:46.907845 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade3099-eaed-406e-a0e5-241c84569533 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:25:46.911762 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f133f4-abe6-4b48-99db-6c1240342df1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:25:46.912377 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f133f4-abe6-4b48-99db-6c1240342df1 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:25:46.912677 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f133f4-abe6-4b48-99db-6c1240342df1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:25:46.912941 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f133f4-abe6-4b48-99db-6c1240342df1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:25:46.922335 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f133f4-abe6-4b48-99db-6c1240342df1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:25:46.923788 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f133f4-abe6-4b48-99db-6c1240342df1 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:25:46.933379 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 760/1530] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:25:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:25:48.810738 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba2c1a-b1c3-427c-83b1-5ed9fcedf183 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:25:48.811326 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba2c1a-b1c3-427c-83b1-5ed9fcedf183 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:25:48.811326 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba2c1a-b1c3-427c-83b1-5ed9fcedf183 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:25:48.812776 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 771/1531] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 22:25:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:25:48.818333 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a45d8-db58-456a-982d-8b33818e6076 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:25:48.818753 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a45d8-db58-456a-982d-8b33818e6076 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:25:48.818844 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a45d8-db58-456a-982d-8b33818e6076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:25:48.840391 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-829a45d8-db58-456a-982d-8b33818e6076 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:25:48.841940 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-829a45d8-db58-456a-982d-8b33818e6076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:25:48.850351 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 761/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 22:25:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:25:49.145429 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba2c1a-b1c3-427c-83b1-5ed9fcedf183 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:25:49.147437 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-97ba2c1a-b1c3-427c-83b1-5ed9fcedf183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:25:49.155816 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=75 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:25:49.163415 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba2c1a-b1c3-427c-83b1-5ed9fcedf183 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:25:49.167428 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395680be-f9fa-4b5d-91d1-84dd4271ee3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:25:49.168045 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395680be-f9fa-4b5d-91d1-84dd4271ee3a service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:25:49.168405 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395680be-f9fa-4b5d-91d1-84dd4271ee3a service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:25:49.168754 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395680be-f9fa-4b5d-91d1-84dd4271ee3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:25:49.178906 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395680be-f9fa-4b5d-91d1-84dd4271ee3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:25:49.180336 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395680be-f9fa-4b5d-91d1-84dd4271ee3a service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:25:49.190042 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 772/1533] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:25:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:25:52.733191 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33ab07-034f-4d90-bcd9-76806c055466 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:25:52.733790 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33ab07-034f-4d90-bcd9-76806c055466 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:25:52.733790 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33ab07-034f-4d90-bcd9-76806c055466 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:25:52.735179 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 762/1534] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 22:25:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:25:52.741007 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9afc7e1-e8fb-449c-bc6f-dc1410f8a8c3 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:25:52.741452 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9afc7e1-e8fb-449c-bc6f-dc1410f8a8c3 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:25:52.741573 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9afc7e1-e8fb-449c-bc6f-dc1410f8a8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:25:52.762766 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-d9afc7e1-e8fb-449c-bc6f-dc1410f8a8c3 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:25:52.763999 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d9afc7e1-e8fb-449c-bc6f-dc1410f8a8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:25:52.773013 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 773/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 22:25:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:25:53.334674 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33ab07-034f-4d90-bcd9-76806c055466 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:25:53.336981 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-7b33ab07-034f-4d90-bcd9-76806c055466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:25:53.408153 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:25:53.422878 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33ab07-034f-4d90-bcd9-76806c055466 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:25:53.426881 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1543838-1050-41ba-b747-19a63a3c700f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:25:53.427517 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1543838-1050-41ba-b747-19a63a3c700f service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:25:53.427794 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1543838-1050-41ba-b747-19a63a3c700f service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:25:53.428074 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1543838-1050-41ba-b747-19a63a3c700f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:25:53.438284 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1543838-1050-41ba-b747-19a63a3c700f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:25:53.439784 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1543838-1050-41ba-b747-19a63a3c700f service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:25:53.450022 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 763/1536] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:25:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:25:55.379160 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a8f82-9414-4884-ab36-2687a053b94f None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:25:55.379781 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a8f82-9414-4884-ab36-2687a053b94f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:25:55.379781 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a8f82-9414-4884-ab36-2687a053b94f None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:25:55.381118 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 774/1537] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 22:25:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:25:55.387254 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175b5f1-5e18-4ea0-8e4c-15f8ba828559 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:25:55.387747 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175b5f1-5e18-4ea0-8e4c-15f8ba828559 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:25:55.388079 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175b5f1-5e18-4ea0-8e4c-15f8ba828559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:25:55.415056 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-c175b5f1-5e18-4ea0-8e4c-15f8ba828559 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:25:55.416259 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c175b5f1-5e18-4ea0-8e4c-15f8ba828559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:25:55.425025 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 764/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 22:25:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:25:55.982562 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a8f82-9414-4884-ab36-2687a053b94f None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:25:55.984332 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-231a8f82-9414-4884-ab36-2687a053b94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:25:55.999631 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a8f82-9414-4884-ab36-2687a053b94f None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:25:56.003633 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3797188-e54f-4147-9063-d2aeccab573d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:25:56.004288 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3797188-e54f-4147-9063-d2aeccab573d service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:25:56.004720 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3797188-e54f-4147-9063-d2aeccab573d service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:25:56.005001 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3797188-e54f-4147-9063-d2aeccab573d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:25:56.015775 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3797188-e54f-4147-9063-d2aeccab573d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:25:56.017273 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3797188-e54f-4147-9063-d2aeccab573d service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:25:56.027411 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 775/1539] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:25:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:26:05.409769 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=11 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:26:06.022753 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=14 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:27:33.571417 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967569b-a833-47ae-8184-d5942d009339 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:33.572079 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967569b-a833-47ae-8184-d5942d009339 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:33.572079 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967569b-a833-47ae-8184-d5942d009339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:33.600041 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-f967569b-a833-47ae-8184-d5942d009339 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:27:33.601319 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f967569b-a833-47ae-8184-d5942d009339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:33.617389 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 765/1540] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:27:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:27:33.627887 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc809e3-cb59-4d04-b681-175c1271d4e7 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:33.628637 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc809e3-cb59-4d04-b681-175c1271d4e7 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:33.628637 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc809e3-cb59-4d04-b681-175c1271d4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:33.681437 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-6bc809e3-cb59-4d04-b681-175c1271d4e7 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:27:33.683098 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-6bc809e3-cb59-4d04-b681-175c1271d4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:33.700688 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 776/1541] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:27:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:27:33.706261 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f967569b-a833-47ae-8184-d5942d009339 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:33.726004 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f967569b-a833-47ae-8184-d5942d009339 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:33.735901 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9bf048-6a6a-42f6-a689-d09e2ff6cfef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:33.736686 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9bf048-6a6a-42f6-a689-d09e2ff6cfef admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:33.737066 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9bf048-6a6a-42f6-a689-d09e2ff6cfef admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:33.737501 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9bf048-6a6a-42f6-a689-d09e2ff6cfef admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:33.738349 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9bf048-6a6a-42f6-a689-d09e2ff6cfef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:27:33.738736 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9bf048-6a6a-42f6-a689-d09e2ff6cfef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:33.740421 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9bf048-6a6a-42f6-a689-d09e2ff6cfef admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:33.765625 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 766/1542] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:27:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:27:33.774962 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc809e3-cb59-4d04-b681-175c1271d4e7 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:33.792814 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc809e3-cb59-4d04-b681-175c1271d4e7 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:33.801918 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea9bd7-abc8-4af7-bac7-1f8000d111b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:33.804414 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea9bd7-abc8-4af7-bac7-1f8000d111b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:33.805297 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea9bd7-abc8-4af7-bac7-1f8000d111b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:33.805819 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea9bd7-abc8-4af7-bac7-1f8000d111b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:33.807072 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ea9bd7-abc8-4af7-bac7-1f8000d111b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:33.810113 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ea9bd7-abc8-4af7-bac7-1f8000d111b0 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:33.876816 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 777/1543] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:27:33 2022] POST /identity/v3/projects => generated 351 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:27:33.881849 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9bf048-6a6a-42f6-a689-d09e2ff6cfef admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:33.898733 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9bf048-6a6a-42f6-a689-d09e2ff6cfef admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:33.982274 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f529c17-3b1d-4a78-8050-857b16fcbdab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:33.982916 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f529c17-3b1d-4a78-8050-857b16fcbdab admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:33.983198 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f529c17-3b1d-4a78-8050-857b16fcbdab admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:33.983473 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f529c17-3b1d-4a78-8050-857b16fcbdab admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:33.984116 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f529c17-3b1d-4a78-8050-857b16fcbdab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:33.986458 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f529c17-3b1d-4a78-8050-857b16fcbdab admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:34.016253 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 767/1544] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:27:33 2022] POST /identity/v3/users => generated 276 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:27:34.021253 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea9bd7-abc8-4af7-bac7-1f8000d111b0 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:34.035715 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29949479-476e-41a4-a89a-f847ebff778a None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:34.036093 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29949479-476e-41a4-a89a-f847ebff778a None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:34.036339 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29949479-476e-41a4-a89a-f847ebff778a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:34.040959 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea9bd7-abc8-4af7-bac7-1f8000d111b0 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:34.053315 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79817156-7193-4b47-8cfc-30a34dc896d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:34.054430 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79817156-7193-4b47-8cfc-30a34dc896d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:34.054955 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79817156-7193-4b47-8cfc-30a34dc896d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:34.055590 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79817156-7193-4b47-8cfc-30a34dc896d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:34.056740 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79817156-7193-4b47-8cfc-30a34dc896d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:34.059184 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79817156-7193-4b47-8cfc-30a34dc896d5 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:34.076703 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 778/1545] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:27:34.077788 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-29949479-476e-41a4-a89a-f847ebff778a None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:27:34.078649 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75954a6-3b6b-4095-8e4d-a5482977d370 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:34.079094 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-29949479-476e-41a4-a89a-f847ebff778a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:34.079600 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75954a6-3b6b-4095-8e4d-a5482977d370 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:34.080256 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75954a6-3b6b-4095-8e4d-a5482977d370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:34.098456 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 768/1546] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:27:34.099533 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29949479-476e-41a4-a89a-f847ebff778a None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:34.113736 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29949479-476e-41a4-a89a-f847ebff778a None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:34.114243 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-e75954a6-3b6b-4095-8e4d-a5482977d370 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:27:34.115735 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-e75954a6-3b6b-4095-8e4d-a5482977d370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:34.130424 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f7fdb-4a4d-4038-8acf-61abeba91e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:34.130962 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f7fdb-4a4d-4038-8acf-61abeba91e46 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:34.131242 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f7fdb-4a4d-4038-8acf-61abeba91e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:34.132017 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f7fdb-4a4d-4038-8acf-61abeba91e46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:34.132715 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64f7fdb-4a4d-4038-8acf-61abeba91e46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:34.134354 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64f7fdb-4a4d-4038-8acf-61abeba91e46 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:34.138640 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 779/1547] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:27:34.141366 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc5016-4ce0-43dc-8ff3-7dd2c0d50a47 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:34.142109 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc5016-4ce0-43dc-8ff3-7dd2c0d50a47 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:34.143051 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc5016-4ce0-43dc-8ff3-7dd2c0d50a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:34.155774 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 769/1548] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:27:34.160410 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ae731-a7b0-4da3-89ce-a441a73a6cf7 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:34.160762 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ae731-a7b0-4da3-89ce-a441a73a6cf7 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:34.161039 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ae731-a7b0-4da3-89ce-a441a73a6cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:34.172731 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-bcfc5016-4ce0-43dc-8ff3-7dd2c0d50a47 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:27:34.174872 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-bcfc5016-4ce0-43dc-8ff3-7dd2c0d50a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:34.202564 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 780/1549] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:27:34.208421 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfc5016-4ce0-43dc-8ff3-7dd2c0d50a47 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:34.221881 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-639ae731-a7b0-4da3-89ce-a441a73a6cf7 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:27:34.243534 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfc5016-4ce0-43dc-8ff3-7dd2c0d50a47 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:34.245841 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-639ae731-a7b0-4da3-89ce-a441a73a6cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:34.260795 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f2dd6-c9e0-4b69-9b79-c0c0d4011b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:34.261054 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f2dd6-c9e0-4b69-9b79-c0c0d4011b4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:34.261374 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f2dd6-c9e0-4b69-9b79-c0c0d4011b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:34.261878 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f2dd6-c9e0-4b69-9b79-c0c0d4011b4c admin admin] PATH_INFO: `/v3/projects/35c691abbf1b423e9a3abec32affcaca/users/321b7156f8504d409941334369a4787f/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:34.266201 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 770/1550] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:27:34.269323 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ae731-a7b0-4da3-89ce-a441a73a6cf7 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:34.281483 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ae731-a7b0-4da3-89ce-a441a73a6cf7 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:34.288727 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9f2dd6-c9e0-4b69-9b79-c0c0d4011b4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=35c691abbf1b423e9a3abec32affcaca, user_id=321b7156f8504d409941334369a4787f, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:34.292102 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafde5a7-66d1-4d80-b7ad-b4884d02980e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:34.293099 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafde5a7-66d1-4d80-b7ad-b4884d02980e admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:34.293470 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafde5a7-66d1-4d80-b7ad-b4884d02980e admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:34.293865 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafde5a7-66d1-4d80-b7ad-b4884d02980e admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:34.295001 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafde5a7-66d1-4d80-b7ad-b4884d02980e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:27:34.295343 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafde5a7-66d1-4d80-b7ad-b4884d02980e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:34.296234 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9f2dd6-c9e0-4b69-9b79-c0c0d4011b4c admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:34.298148 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafde5a7-66d1-4d80-b7ad-b4884d02980e admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:34.321611 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 771/1551] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:27:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:27:34.322907 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da4cab-62a3-4e74-8b8d-caf8b0a07aef None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:34.323194 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da4cab-62a3-4e74-8b8d-caf8b0a07aef None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:34.323465 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da4cab-62a3-4e74-8b8d-caf8b0a07aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:34.336935 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 781/1552] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:27:34 2022] PUT /identity/v3/projects/35c691abbf1b423e9a3abec32affcaca/users/321b7156f8504d409941334369a4787f/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:27:34.336935 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632aebc-a158-4025-a298-0dae7c76e2f5 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:34.336935 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632aebc-a158-4025-a298-0dae7c76e2f5 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:34.336935 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632aebc-a158-4025-a298-0dae7c76e2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:34.355311 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-91da4cab-62a3-4e74-8b8d-caf8b0a07aef None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:27:34.363191 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-91da4cab-62a3-4e74-8b8d-caf8b0a07aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:34.367427 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-c632aebc-a158-4025-a298-0dae7c76e2f5 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:27:34.368748 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c632aebc-a158-4025-a298-0dae7c76e2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:34.430148 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 772/1553] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:27:34.431463 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f2bd5-5097-4628-9e99-dee5ea9f643b None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:34.431755 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f2bd5-5097-4628-9e99-dee5ea9f643b None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:34.432039 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f2bd5-5097-4628-9e99-dee5ea9f643b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:34.448524 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 782/1554] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:27:34.449839 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c632aebc-a158-4025-a298-0dae7c76e2f5 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:34.461109 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c632aebc-a158-4025-a298-0dae7c76e2f5 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:34.462535 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-d07f2bd5-5097-4628-9e99-dee5ea9f643b None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:27:34.463774 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-d07f2bd5-5097-4628-9e99-dee5ea9f643b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:34.466778 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d949b5-c81a-4a5f-8d5e-61dbc19118a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:34.467435 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d949b5-c81a-4a5f-8d5e-61dbc19118a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:34.467711 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d949b5-c81a-4a5f-8d5e-61dbc19118a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:34.467985 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d949b5-c81a-4a5f-8d5e-61dbc19118a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:34.468680 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d949b5-c81a-4a5f-8d5e-61dbc19118a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:27:34.468983 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d949b5-c81a-4a5f-8d5e-61dbc19118a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:34.469999 dv-cinder-854268-3-smb devstack@keystone.service[81515]: WARNING py.warnings [None req-a8d949b5-c81a-4a5f-8d5e-61dbc19118a6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 22:27:34.469999 dv-cinder-854268-3-smb devstack@keystone.service[81515]: warnings.warn(msg) Aug 29 22:27:34.469999 dv-cinder-854268-3-smb devstack@keystone.service[81515]: Aug 29 22:27:34.471049 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d949b5-c81a-4a5f-8d5e-61dbc19118a6 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:34.472802 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 773/1555] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:27:34.474026 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59595ee3-0788-472f-be0b-9291b6e71c28 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:34.474313 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59595ee3-0788-472f-be0b-9291b6e71c28 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:34.474592 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59595ee3-0788-472f-be0b-9291b6e71c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:34.494253 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 783/1556] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:27:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:27:34.494253 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d949b5-c81a-4a5f-8d5e-61dbc19118a6 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:34.499252 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d949b5-c81a-4a5f-8d5e-61dbc19118a6 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:34.500627 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-59595ee3-0788-472f-be0b-9291b6e71c28 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:27:34.501880 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-59595ee3-0788-472f-be0b-9291b6e71c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:34.507815 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3aec2-0f3c-407b-aed2-a704dd5b76ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:34.507815 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3aec2-0f3c-407b-aed2-a704dd5b76ca admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:34.509045 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3aec2-0f3c-407b-aed2-a704dd5b76ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:34.509045 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3aec2-0f3c-407b-aed2-a704dd5b76ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:34.509045 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f3aec2-0f3c-407b-aed2-a704dd5b76ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:34.510778 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f3aec2-0f3c-407b-aed2-a704dd5b76ca admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:34.514412 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 774/1557] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:27:34.515523 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a5acc-2224-4a04-a709-e5a8732c76a7 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:34.515812 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a5acc-2224-4a04-a709-e5a8732c76a7 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:34.516063 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a5acc-2224-4a04-a709-e5a8732c76a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:34.548358 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-0f9a5acc-2224-4a04-a709-e5a8732c76a7 None None] MFA Rules not processed for user `321b7156f8504d409941334369a4787f`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:27:34.550305 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-0f9a5acc-2224-4a04-a709-e5a8732c76a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:34.557116 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 784/1558] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:27:34 2022] POST /identity/v3/projects => generated 391 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:27:34.557116 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11905ba-53d0-490f-b73f-991033452033 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:34.557116 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11905ba-53d0-490f-b73f-991033452033 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:34.557116 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11905ba-53d0-490f-b73f-991033452033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:34.564298 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:27:34.587212 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-d11905ba-53d0-490f-b73f-991033452033 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:27:34.588436 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d11905ba-53d0-490f-b73f-991033452033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:34.629585 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:27:34.642239 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 775/1559] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:27:34 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:27:34.644032 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ab9f1-3f65-47a6-955e-b3a45fa89c18 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:34.644321 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ab9f1-3f65-47a6-955e-b3a45fa89c18 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:34.644652 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ab9f1-3f65-47a6-955e-b3a45fa89c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:34.664833 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 785/1560] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:27:34.672843 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-af7ab9f1-3f65-47a6-955e-b3a45fa89c18 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:27:34.672843 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-af7ab9f1-3f65-47a6-955e-b3a45fa89c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:34.673029 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3d184-cb03-4d27-a2ab-b962c02def62 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:34.673029 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3d184-cb03-4d27-a2ab-b962c02def62 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:34.673029 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3d184-cb03-4d27-a2ab-b962c02def62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:34.678187 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 776/1561] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:27:34.679530 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3fb7ca-29ca-4eab-bf28-51d40f531794 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:34.679819 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3fb7ca-29ca-4eab-bf28-51d40f531794 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:34.680080 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3fb7ca-29ca-4eab-bf28-51d40f531794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:34.688515 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-04f3d184-cb03-4d27-a2ab-b962c02def62 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:27:34.689742 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-04f3d184-cb03-4d27-a2ab-b962c02def62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:34.698363 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 786/1562] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:27:34.699146 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3d184-cb03-4d27-a2ab-b962c02def62 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:34.700819 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-5e3fb7ca-29ca-4eab-bf28-51d40f531794 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:27:34.702004 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-5e3fb7ca-29ca-4eab-bf28-51d40f531794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:34.709643 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3d184-cb03-4d27-a2ab-b962c02def62 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:34.711046 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 777/1563] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:27:34.712195 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c7390-e1d9-47f5-8809-72cbeba4c52f None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:34.712524 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c7390-e1d9-47f5-8809-72cbeba4c52f None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:34.712774 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c7390-e1d9-47f5-8809-72cbeba4c52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:34.714630 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357258e-a86b-445d-bb65-12789a048490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:34.715239 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357258e-a86b-445d-bb65-12789a048490 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:34.715628 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357258e-a86b-445d-bb65-12789a048490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:34.715904 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357258e-a86b-445d-bb65-12789a048490 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:34.716656 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7357258e-a86b-445d-bb65-12789a048490 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:34.718553 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7357258e-a86b-445d-bb65-12789a048490 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:34.733960 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-dd5c7390-e1d9-47f5-8809-72cbeba4c52f None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:27:34.735140 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-dd5c7390-e1d9-47f5-8809-72cbeba4c52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:34.744127 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 778/1564] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:27:34.744943 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5c7390-e1d9-47f5-8809-72cbeba4c52f None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:34.754270 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 787/1565] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:27:34 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:27:34.757411 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5c7390-e1d9-47f5-8809-72cbeba4c52f None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:34.759023 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357258e-a86b-445d-bb65-12789a048490 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:34.822527 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf2e05b-5773-43ae-866c-4d9a22bedee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:34.823299 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2e05b-5773-43ae-866c-4d9a22bedee3 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:34.823580 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2e05b-5773-43ae-866c-4d9a22bedee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:34.823847 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2e05b-5773-43ae-866c-4d9a22bedee3 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:34.824510 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf2e05b-5773-43ae-866c-4d9a22bedee3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:34.825343 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357258e-a86b-445d-bb65-12789a048490 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:34.826483 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf2e05b-5773-43ae-866c-4d9a22bedee3 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:34.830068 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20bcea6-b616-4402-8975-6bfcece55b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:34.830918 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20bcea6-b616-4402-8975-6bfcece55b48 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:34.831072 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20bcea6-b616-4402-8975-6bfcece55b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:34.831503 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20bcea6-b616-4402-8975-6bfcece55b48 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:34.832196 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20bcea6-b616-4402-8975-6bfcece55b48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:34.834468 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20bcea6-b616-4402-8975-6bfcece55b48 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:34.854186 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 779/1566] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:27:34 2022] POST /identity/v3/users => generated 296 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:27:34.856243 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96153753-5c02-43c4-851a-2c0d9db8bb49 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:34.856800 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96153753-5c02-43c4-851a-2c0d9db8bb49 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:34.857271 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96153753-5c02-43c4-851a-2c0d9db8bb49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:34.874447 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 788/1567] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:27:34 2022] POST /identity/v3/projects => generated 355 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:27:34.875297 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20bcea6-b616-4402-8975-6bfcece55b48 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:34.883255 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-96153753-5c02-43c4-851a-2c0d9db8bb49 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:27:34.884513 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-96153753-5c02-43c4-851a-2c0d9db8bb49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:34.960196 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20bcea6-b616-4402-8975-6bfcece55b48 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:34.961414 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 780/1568] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:27:34.962203 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96153753-5c02-43c4-851a-2c0d9db8bb49 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:34.966850 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068798be-7c47-460a-9bb0-517763cc32be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:34.967637 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068798be-7c47-460a-9bb0-517763cc32be admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:34.968537 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068798be-7c47-460a-9bb0-517763cc32be admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:34.968828 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068798be-7c47-460a-9bb0-517763cc32be admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:34.969496 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068798be-7c47-460a-9bb0-517763cc32be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:27:34.969809 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068798be-7c47-460a-9bb0-517763cc32be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:34.971598 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068798be-7c47-460a-9bb0-517763cc32be admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:34.972371 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96153753-5c02-43c4-851a-2c0d9db8bb49 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:34.977074 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473276d2-2004-4395-ba00-c4fb5364f1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:34.977714 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473276d2-2004-4395-ba00-c4fb5364f1e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:34.977995 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473276d2-2004-4395-ba00-c4fb5364f1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:34.978286 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473276d2-2004-4395-ba00-c4fb5364f1e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:34.978925 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473276d2-2004-4395-ba00-c4fb5364f1e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:27:34.979226 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473276d2-2004-4395-ba00-c4fb5364f1e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:34.980873 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473276d2-2004-4395-ba00-c4fb5364f1e2 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:34.986507 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 789/1569] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:27:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:27:34.995270 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068798be-7c47-460a-9bb0-517763cc32be admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:34.995476 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 781/1570] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:27:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:27:34.995476 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473276d2-2004-4395-ba00-c4fb5364f1e2 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:35.005750 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068798be-7c47-460a-9bb0-517763cc32be admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:35.007332 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473276d2-2004-4395-ba00-c4fb5364f1e2 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:35.010654 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9414c5-fe6a-40b9-8b53-de0f36b9fc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:35.011266 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9414c5-fe6a-40b9-8b53-de0f36b9fc35 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:35.011540 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9414c5-fe6a-40b9-8b53-de0f36b9fc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:35.011809 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9414c5-fe6a-40b9-8b53-de0f36b9fc35 admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:35.012612 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9414c5-fe6a-40b9-8b53-de0f36b9fc35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:27:35.012909 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9414c5-fe6a-40b9-8b53-de0f36b9fc35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:35.014503 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9414c5-fe6a-40b9-8b53-de0f36b9fc35 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:35.018339 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244b25bf-5303-41b4-aa3f-f823ddd0e955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:35.018960 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b25bf-5303-41b4-aa3f-f823ddd0e955 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:35.019243 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b25bf-5303-41b4-aa3f-f823ddd0e955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:35.019522 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b25bf-5303-41b4-aa3f-f823ddd0e955 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:35.020174 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244b25bf-5303-41b4-aa3f-f823ddd0e955 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:27:35.020506 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244b25bf-5303-41b4-aa3f-f823ddd0e955 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:35.022143 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244b25bf-5303-41b4-aa3f-f823ddd0e955 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:35.023846 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:27:35.028299 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 790/1571] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:27:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:27:35.029166 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9414c5-fe6a-40b9-8b53-de0f36b9fc35 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:35.036275 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 782/1572] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:27:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:27:35.037238 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244b25bf-5303-41b4-aa3f-f823ddd0e955 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:35.042056 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9414c5-fe6a-40b9-8b53-de0f36b9fc35 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:35.047871 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244b25bf-5303-41b4-aa3f-f823ddd0e955 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:35.049356 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5c5b2-8a1c-418e-b6f3-44810b7e42a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:35.050128 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5c5b2-8a1c-418e-b6f3-44810b7e42a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:35.050414 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5c5b2-8a1c-418e-b6f3-44810b7e42a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:35.050684 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5c5b2-8a1c-418e-b6f3-44810b7e42a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:35.051327 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c5c5b2-8a1c-418e-b6f3-44810b7e42a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:35.052376 dv-cinder-854268-3-smb devstack@keystone.service[81515]: WARNING py.warnings [None req-13c5c5b2-8a1c-418e-b6f3-44810b7e42a2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 22:27:35.052376 dv-cinder-854268-3-smb devstack@keystone.service[81515]: warnings.warn(msg) Aug 29 22:27:35.052376 dv-cinder-854268-3-smb devstack@keystone.service[81515]: Aug 29 22:27:35.053354 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9824bc69-992c-44b9-9000-fe5ad6afd3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:35.053668 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c5c5b2-8a1c-418e-b6f3-44810b7e42a2 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:35.054125 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824bc69-992c-44b9-9000-fe5ad6afd3b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:35.054406 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824bc69-992c-44b9-9000-fe5ad6afd3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:35.054667 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824bc69-992c-44b9-9000-fe5ad6afd3b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:35.055617 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9824bc69-992c-44b9-9000-fe5ad6afd3b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:35.057259 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9824bc69-992c-44b9-9000-fe5ad6afd3b7 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:35.068201 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 783/1573] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:27:35.069145 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9824bc69-992c-44b9-9000-fe5ad6afd3b7 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:35.076144 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:27:35.080511 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9824bc69-992c-44b9-9000-fe5ad6afd3b7 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:35.082393 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 791/1574] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:27:35 2022] POST /identity/v3/users => generated 290 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:27:35.083329 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5c5b2-8a1c-418e-b6f3-44810b7e42a2 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:35.087205 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b58397-db17-4e06-8b23-8d78aa3400f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:35.087958 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b58397-db17-4e06-8b23-8d78aa3400f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:35.088335 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b58397-db17-4e06-8b23-8d78aa3400f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:35.088728 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b58397-db17-4e06-8b23-8d78aa3400f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:35.089484 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b58397-db17-4e06-8b23-8d78aa3400f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:35.091585 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b58397-db17-4e06-8b23-8d78aa3400f8 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:35.094806 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5c5b2-8a1c-418e-b6f3-44810b7e42a2 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:35.099745 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3fbd4-ff22-4dbd-be59-9d8a81f49385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:35.100366 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3fbd4-ff22-4dbd-be59-9d8a81f49385 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:35.100681 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3fbd4-ff22-4dbd-be59-9d8a81f49385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:35.100957 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3fbd4-ff22-4dbd-be59-9d8a81f49385 admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:35.101614 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e3fbd4-ff22-4dbd-be59-9d8a81f49385 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:27:35.101920 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e3fbd4-ff22-4dbd-be59-9d8a81f49385 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:35.103933 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e3fbd4-ff22-4dbd-be59-9d8a81f49385 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:35.115735 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 784/1575] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:27:35 2022] POST /identity/v3/users => generated 284 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:27:35.116800 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b58397-db17-4e06-8b23-8d78aa3400f8 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:35.124664 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 792/1576] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:27:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:27:35.124664 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3fbd4-ff22-4dbd-be59-9d8a81f49385 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:35.126537 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b58397-db17-4e06-8b23-8d78aa3400f8 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:35.130901 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3fbd4-ff22-4dbd-be59-9d8a81f49385 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:35.131348 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc2c3f-f6cb-4b2d-b237-7efc01ba454f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:35.132294 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc2c3f-f6cb-4b2d-b237-7efc01ba454f admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:35.132645 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc2c3f-f6cb-4b2d-b237-7efc01ba454f admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:35.132952 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc2c3f-f6cb-4b2d-b237-7efc01ba454f admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:35.133824 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc2c3f-f6cb-4b2d-b237-7efc01ba454f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:35.134853 dv-cinder-854268-3-smb devstack@keystone.service[81514]: WARNING py.warnings [None req-3fcc2c3f-f6cb-4b2d-b237-7efc01ba454f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 22:27:35.134853 dv-cinder-854268-3-smb devstack@keystone.service[81514]: warnings.warn(msg) Aug 29 22:27:35.134853 dv-cinder-854268-3-smb devstack@keystone.service[81514]: Aug 29 22:27:35.136060 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc2c3f-f6cb-4b2d-b237-7efc01ba454f admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:35.136186 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e1baa-742a-49a9-9ce6-3ee1eb126f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:35.136814 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e1baa-742a-49a9-9ce6-3ee1eb126f2a admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:35.137097 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e1baa-742a-49a9-9ce6-3ee1eb126f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:35.137374 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e1baa-742a-49a9-9ce6-3ee1eb126f2a admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:35.138039 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e1baa-742a-49a9-9ce6-3ee1eb126f2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:35.139984 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e1baa-742a-49a9-9ce6-3ee1eb126f2a admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:35.167326 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 785/1577] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:27:35 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:27:35.168307 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 793/1578] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:27:35 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:27:35.169231 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e1baa-742a-49a9-9ce6-3ee1eb126f2a admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:35.171468 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc2c3f-f6cb-4b2d-b237-7efc01ba454f admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:35.231203 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e1baa-742a-49a9-9ce6-3ee1eb126f2a admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:35.234228 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc2c3f-f6cb-4b2d-b237-7efc01ba454f admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:35.235913 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f75e98-014c-46a8-a6ff-fcf1e80057c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:35.236636 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f75e98-014c-46a8-a6ff-fcf1e80057c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:35.237145 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f75e98-014c-46a8-a6ff-fcf1e80057c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:35.237815 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f75e98-014c-46a8-a6ff-fcf1e80057c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:35.238239 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f75e98-014c-46a8-a6ff-fcf1e80057c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:35.240171 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f75e98-014c-46a8-a6ff-fcf1e80057c3 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:35.240664 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af1b035-1006-44cb-8a52-56619b3b7bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:35.241364 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1b035-1006-44cb-8a52-56619b3b7bcb admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:35.241716 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1b035-1006-44cb-8a52-56619b3b7bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:35.242167 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1b035-1006-44cb-8a52-56619b3b7bcb admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:35.242878 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af1b035-1006-44cb-8a52-56619b3b7bcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:35.245200 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af1b035-1006-44cb-8a52-56619b3b7bcb admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:35.270561 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 794/1579] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:27:35 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:27:35.271508 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f75e98-014c-46a8-a6ff-fcf1e80057c3 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:35.278701 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 786/1580] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:27:35 2022] POST /identity/v3/projects => generated 405 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:27:35.279655 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af1b035-1006-44cb-8a52-56619b3b7bcb admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:35.335371 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f75e98-014c-46a8-a6ff-fcf1e80057c3 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:35.355411 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af1b035-1006-44cb-8a52-56619b3b7bcb admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:35.360740 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73455ad5-c9ae-4262-9fac-c463e3525f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:35.361409 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73455ad5-c9ae-4262-9fac-c463e3525f26 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:35.361820 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73455ad5-c9ae-4262-9fac-c463e3525f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:35.362099 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73455ad5-c9ae-4262-9fac-c463e3525f26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:35.362859 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73455ad5-c9ae-4262-9fac-c463e3525f26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:35.364503 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73455ad5-c9ae-4262-9fac-c463e3525f26 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:35.380799 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 787/1581] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:27:35.385037 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73455ad5-c9ae-4262-9fac-c463e3525f26 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:35.393690 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:27:35.396103 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73455ad5-c9ae-4262-9fac-c463e3525f26 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:35.401447 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764dade2-096a-4767-8f3c-47501dc7166e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:35.402059 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03580968-192b-44ce-b8c6-5eac798b46b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:35.402190 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764dade2-096a-4767-8f3c-47501dc7166e admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:35.402340 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764dade2-096a-4767-8f3c-47501dc7166e admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:35.402614 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764dade2-096a-4767-8f3c-47501dc7166e admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:35.403073 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03580968-192b-44ce-b8c6-5eac798b46b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:35.403259 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764dade2-096a-4767-8f3c-47501dc7166e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:35.403463 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03580968-192b-44ce-b8c6-5eac798b46b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:35.403947 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03580968-192b-44ce-b8c6-5eac798b46b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:35.404693 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03580968-192b-44ce-b8c6-5eac798b46b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:35.404939 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764dade2-096a-4767-8f3c-47501dc7166e admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:35.406451 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03580968-192b-44ce-b8c6-5eac798b46b6 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:35.417969 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 795/1582] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:27:35.418898 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03580968-192b-44ce-b8c6-5eac798b46b6 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:35.419344 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 788/1583] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:27:35.420348 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764dade2-096a-4767-8f3c-47501dc7166e admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:35.431489 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764dade2-096a-4767-8f3c-47501dc7166e admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:35.432367 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03580968-192b-44ce-b8c6-5eac798b46b6 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:35.436230 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a25d2-dce5-4362-8e6e-295ddb25d124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:35.436874 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a25d2-dce5-4362-8e6e-295ddb25d124 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:35.437157 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a25d2-dce5-4362-8e6e-295ddb25d124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:35.437474 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a25d2-dce5-4362-8e6e-295ddb25d124 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:35.437861 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62742510-d185-4ff9-8fe4-f1a5ab63ea80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:35.438106 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3a25d2-dce5-4362-8e6e-295ddb25d124 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:35.438491 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62742510-d185-4ff9-8fe4-f1a5ab63ea80 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:35.438798 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62742510-d185-4ff9-8fe4-f1a5ab63ea80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:35.439067 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62742510-d185-4ff9-8fe4-f1a5ab63ea80 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:35.439849 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62742510-d185-4ff9-8fe4-f1a5ab63ea80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:35.441887 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3a25d2-dce5-4362-8e6e-295ddb25d124 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:35.442010 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62742510-d185-4ff9-8fe4-f1a5ab63ea80 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:35.453192 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:27:35.467250 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 789/1584] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:27:35 2022] POST /identity/v3/users => generated 283 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:27:35.468165 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a25d2-dce5-4362-8e6e-295ddb25d124 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:35.478458 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 796/1585] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:27:35 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:27:35.478620 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a25d2-dce5-4362-8e6e-295ddb25d124 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:35.479653 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62742510-d185-4ff9-8fe4-f1a5ab63ea80 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:35.547978 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2786d77-e7df-413e-8477-76a754c8fbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:35.548745 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2786d77-e7df-413e-8477-76a754c8fbe1 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:35.549177 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2786d77-e7df-413e-8477-76a754c8fbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:35.550115 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2786d77-e7df-413e-8477-76a754c8fbe1 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:35.550426 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62742510-d185-4ff9-8fe4-f1a5ab63ea80 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:35.550774 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2786d77-e7df-413e-8477-76a754c8fbe1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:35.552765 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2786d77-e7df-413e-8477-76a754c8fbe1 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:35.557938 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f04f5-a97f-41f6-88f9-2fa7079cfc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:35.558563 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f04f5-a97f-41f6-88f9-2fa7079cfc78 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:35.558837 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f04f5-a97f-41f6-88f9-2fa7079cfc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:35.559104 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f04f5-a97f-41f6-88f9-2fa7079cfc78 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:35.559734 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5f04f5-a97f-41f6-88f9-2fa7079cfc78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:35.561900 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5f04f5-a97f-41f6-88f9-2fa7079cfc78 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:35.580154 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 790/1586] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:27:35 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:27:35.580154 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2786d77-e7df-413e-8477-76a754c8fbe1 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:35.584418 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 797/1587] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:27:35 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:27:35.585340 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f04f5-a97f-41f6-88f9-2fa7079cfc78 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:35.591005 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2786d77-e7df-413e-8477-76a754c8fbe1 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:35.594953 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f04f5-a97f-41f6-88f9-2fa7079cfc78 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:35.596877 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf44bc-583e-490d-b4cd-d44b365e3cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:35.597603 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf44bc-583e-490d-b4cd-d44b365e3cfa admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:35.597884 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf44bc-583e-490d-b4cd-d44b365e3cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:35.598164 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf44bc-583e-490d-b4cd-d44b365e3cfa admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:35.598804 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcf44bc-583e-490d-b4cd-d44b365e3cfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:35.599835 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509607d-fb17-438c-9167-217072e7afb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:35.600443 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509607d-fb17-438c-9167-217072e7afb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:35.600753 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509607d-fb17-438c-9167-217072e7afb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:35.600867 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcf44bc-583e-490d-b4cd-d44b365e3cfa admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:35.601024 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509607d-fb17-438c-9167-217072e7afb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:35.601666 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0509607d-fb17-438c-9167-217072e7afb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:35.603319 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0509607d-fb17-438c-9167-217072e7afb2 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:35.614342 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 798/1588] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:27:35.618215 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509607d-fb17-438c-9167-217072e7afb2 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:35.625950 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 791/1589] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:27:35 2022] POST /identity/v3/users => generated 303 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:27:35.629895 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509607d-fb17-438c-9167-217072e7afb2 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:35.630362 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf44bc-583e-490d-b4cd-d44b365e3cfa admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:35.637272 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf44bc-583e-490d-b4cd-d44b365e3cfa admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:35.637426 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb2e97e-97aa-41b8-9982-427aac472752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:35.638547 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2e97e-97aa-41b8-9982-427aac472752 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:35.639038 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2e97e-97aa-41b8-9982-427aac472752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:35.639520 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2e97e-97aa-41b8-9982-427aac472752 admin admin] PATH_INFO: `/v3/projects/fb7cc1d6231e45aead9dcd28583c8e12/users/bef91a59d5a343d886ac09ae35d7c10e/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:35.641823 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d3c3fd-cda8-4354-89b4-752c0bb538bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:35.642479 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3c3fd-cda8-4354-89b4-752c0bb538bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:35.643079 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3c3fd-cda8-4354-89b4-752c0bb538bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:35.643188 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3c3fd-cda8-4354-89b4-752c0bb538bc admin admin] PATH_INFO: `/v3/projects/84a5e18477384261ac68bd5e752647ee/users/5ee4423cd17540c2b72d3f3b58b6350b/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:35.659494 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d3c3fd-cda8-4354-89b4-752c0bb538bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=84a5e18477384261ac68bd5e752647ee, user_id=5ee4423cd17540c2b72d3f3b58b6350b, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:35.660242 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb2e97e-97aa-41b8-9982-427aac472752 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb7cc1d6231e45aead9dcd28583c8e12, user_id=bef91a59d5a343d886ac09ae35d7c10e, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:35.660570 dv-cinder-854268-3-smb devstack@keystone.service[81514]: WARNING py.warnings [None req-d8d3c3fd-cda8-4354-89b4-752c0bb538bc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 22:27:35.660570 dv-cinder-854268-3-smb devstack@keystone.service[81514]: warnings.warn(msg) Aug 29 22:27:35.660570 dv-cinder-854268-3-smb devstack@keystone.service[81514]: Aug 29 22:27:35.662506 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d3c3fd-cda8-4354-89b4-752c0bb538bc admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:35.663029 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb2e97e-97aa-41b8-9982-427aac472752 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:35.677717 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 792/1590] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:27:35 2022] PUT /identity/v3/projects/84a5e18477384261ac68bd5e752647ee/users/5ee4423cd17540c2b72d3f3b58b6350b/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:27:35.678641 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d3c3fd-cda8-4354-89b4-752c0bb538bc admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:35.687948 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 799/1591] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:27:35 2022] PUT /identity/v3/projects/fb7cc1d6231e45aead9dcd28583c8e12/users/bef91a59d5a343d886ac09ae35d7c10e/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:27:35.688630 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb2e97e-97aa-41b8-9982-427aac472752 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:35.747231 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d3c3fd-cda8-4354-89b4-752c0bb538bc admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:35.750485 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb2e97e-97aa-41b8-9982-427aac472752 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:35.753353 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb28d0-2b0d-4b4e-b1bd-ba963c1de1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:35.753982 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb28d0-2b0d-4b4e-b1bd-ba963c1de1f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:35.754321 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb28d0-2b0d-4b4e-b1bd-ba963c1de1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:35.754574 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb28d0-2b0d-4b4e-b1bd-ba963c1de1f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:35.755247 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deb28d0-2b0d-4b4e-b1bd-ba963c1de1f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:35.755599 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b69bd2-f626-4132-9740-a182ca061308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:35.757711 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b69bd2-f626-4132-9740-a182ca061308 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:35.757711 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b69bd2-f626-4132-9740-a182ca061308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:35.757711 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b69bd2-f626-4132-9740-a182ca061308 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:35.758117 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deb28d0-2b0d-4b4e-b1bd-ba963c1de1f2 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:35.758343 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b69bd2-f626-4132-9740-a182ca061308 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:35.759759 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b69bd2-f626-4132-9740-a182ca061308 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:35.773240 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 793/1592] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:27:35.773240 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb28d0-2b0d-4b4e-b1bd-ba963c1de1f2 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:35.785979 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 800/1593] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:27:35 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:27:35.786206 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb28d0-2b0d-4b4e-b1bd-ba963c1de1f2 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:35.786331 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b69bd2-f626-4132-9740-a182ca061308 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:35.788855 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b3277c-2d84-44bf-9b6c-ea33607b5511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:35.789482 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b3277c-2d84-44bf-9b6c-ea33607b5511 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:35.789763 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b3277c-2d84-44bf-9b6c-ea33607b5511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:35.790035 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b3277c-2d84-44bf-9b6c-ea33607b5511 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:35.790662 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b3277c-2d84-44bf-9b6c-ea33607b5511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:35.792273 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b3277c-2d84-44bf-9b6c-ea33607b5511 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:35.795927 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b69bd2-f626-4132-9740-a182ca061308 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:35.801920 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f1958b-4d49-42d2-bc58-c81905ecdec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:35.802524 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f1958b-4d49-42d2-bc58-c81905ecdec6 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:35.802990 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f1958b-4d49-42d2-bc58-c81905ecdec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:35.803305 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f1958b-4d49-42d2-bc58-c81905ecdec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:35.804062 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f1958b-4d49-42d2-bc58-c81905ecdec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:35.806063 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f1958b-4d49-42d2-bc58-c81905ecdec6 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:35.809020 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 794/1594] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:27:35.809790 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b3277c-2d84-44bf-9b6c-ea33607b5511 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:35.817848 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 801/1595] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:27:35.818697 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f1958b-4d49-42d2-bc58-c81905ecdec6 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:35.820203 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b3277c-2d84-44bf-9b6c-ea33607b5511 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:35.825397 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9465dc0-b7c6-4adf-85c9-929be4d5c216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:35.826171 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9465dc0-b7c6-4adf-85c9-929be4d5c216 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:35.826518 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9465dc0-b7c6-4adf-85c9-929be4d5c216 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:35.826867 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9465dc0-b7c6-4adf-85c9-929be4d5c216 admin admin] PATH_INFO: `/v3/projects/54d43bb823ab468b8f624fa340db52ec/users/a92a2da2bce0489988ab08978d85b265/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:35.826983 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:27:35.831592 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f1958b-4d49-42d2-bc58-c81905ecdec6 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:35.837573 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201e3e2-14fa-4568-ac60-c7b05cd1df4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:35.838195 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201e3e2-14fa-4568-ac60-c7b05cd1df4b admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:35.838749 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201e3e2-14fa-4568-ac60-c7b05cd1df4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:35.839007 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201e3e2-14fa-4568-ac60-c7b05cd1df4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:35.839924 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1201e3e2-14fa-4568-ac60-c7b05cd1df4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:35.841871 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1201e3e2-14fa-4568-ac60-c7b05cd1df4b admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:35.845859 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9465dc0-b7c6-4adf-85c9-929be4d5c216 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54d43bb823ab468b8f624fa340db52ec, user_id=a92a2da2bce0489988ab08978d85b265, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:35.848568 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9465dc0-b7c6-4adf-85c9-929be4d5c216 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:35.853534 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 802/1596] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:27:35.859405 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201e3e2-14fa-4568-ac60-c7b05cd1df4b admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:35.867244 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 795/1597] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:27:35 2022] PUT /identity/v3/projects/54d43bb823ab468b8f624fa340db52ec/users/a92a2da2bce0489988ab08978d85b265/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:27:35.871462 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201e3e2-14fa-4568-ac60-c7b05cd1df4b admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:35.871575 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02caf3-520b-4bed-a6a7-bcd7c9310396 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:35.871575 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02caf3-520b-4bed-a6a7-bcd7c9310396 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:35.871575 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02caf3-520b-4bed-a6a7-bcd7c9310396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:35.876702 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:27:35.893236 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-fa02caf3-520b-4bed-a6a7-bcd7c9310396 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:27:35.895032 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-fa02caf3-520b-4bed-a6a7-bcd7c9310396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:35.931520 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcee253-c0bc-44ec-b614-1e9e87dec442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:35.932146 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcee253-c0bc-44ec-b614-1e9e87dec442 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:35.932428 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcee253-c0bc-44ec-b614-1e9e87dec442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:35.932735 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcee253-c0bc-44ec-b614-1e9e87dec442 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:35.933380 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcee253-c0bc-44ec-b614-1e9e87dec442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:35.935144 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcee253-c0bc-44ec-b614-1e9e87dec442 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:35.946204 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 803/1598] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:27:35.947039 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcee253-c0bc-44ec-b614-1e9e87dec442 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:35.957324 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcee253-c0bc-44ec-b614-1e9e87dec442 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:35.963468 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a92e87-2ee1-4e44-a728-1575f76550f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:35.967332 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 796/1599] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:27:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:27:35.967470 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a92e87-2ee1-4e44-a728-1575f76550f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:35.967470 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a92e87-2ee1-4e44-a728-1575f76550f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:35.967470 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a92e87-2ee1-4e44-a728-1575f76550f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:35.967705 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa02caf3-520b-4bed-a6a7-bcd7c9310396 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:35.968271 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a92e87-2ee1-4e44-a728-1575f76550f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:35.969968 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a92e87-2ee1-4e44-a728-1575f76550f9 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:35.982248 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa02caf3-520b-4bed-a6a7-bcd7c9310396 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:35.983912 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 804/1600] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:27:35.984892 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a92e87-2ee1-4e44-a728-1575f76550f9 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:35.989030 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5bd231-06e4-4b2a-b9c0-e0281b65f582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:35.989653 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5bd231-06e4-4b2a-b9c0-e0281b65f582 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:35.989935 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5bd231-06e4-4b2a-b9c0-e0281b65f582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:35.990473 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5bd231-06e4-4b2a-b9c0-e0281b65f582 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:35.990945 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5bd231-06e4-4b2a-b9c0-e0281b65f582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:35.992902 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5bd231-06e4-4b2a-b9c0-e0281b65f582 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:35.995382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a92e87-2ee1-4e44-a728-1575f76550f9 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:35.999912 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327138d9-b317-4e12-95de-ff2642344f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:36.000517 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327138d9-b317-4e12-95de-ff2642344f5e admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:36.000801 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327138d9-b317-4e12-95de-ff2642344f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:36.001096 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327138d9-b317-4e12-95de-ff2642344f5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:36.001733 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327138d9-b317-4e12-95de-ff2642344f5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:36.003824 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 797/1601] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:27:36.003960 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327138d9-b317-4e12-95de-ff2642344f5e admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:36.007431 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5bd231-06e4-4b2a-b9c0-e0281b65f582 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:36.015270 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5bd231-06e4-4b2a-b9c0-e0281b65f582 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:36.016438 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 805/1602] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:27:36.017346 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327138d9-b317-4e12-95de-ff2642344f5e admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:36.020078 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494183fc-7424-40d1-a0d0-404b7bfb815a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:36.020729 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494183fc-7424-40d1-a0d0-404b7bfb815a admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:36.021013 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494183fc-7424-40d1-a0d0-404b7bfb815a admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:36.021278 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494183fc-7424-40d1-a0d0-404b7bfb815a admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:36.021951 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494183fc-7424-40d1-a0d0-404b7bfb815a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:36.023566 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494183fc-7424-40d1-a0d0-404b7bfb815a admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:36.027859 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327138d9-b317-4e12-95de-ff2642344f5e admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:36.033673 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332ce32-97fa-46fb-bac7-be6d78537591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:36.034450 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332ce32-97fa-46fb-bac7-be6d78537591 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:36.034585 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 798/1603] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:27:36.034723 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332ce32-97fa-46fb-bac7-be6d78537591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:36.034994 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332ce32-97fa-46fb-bac7-be6d78537591 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:36.035626 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2332ce32-97fa-46fb-bac7-be6d78537591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:36.035723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a44f47-f1f7-45e5-bde5-357f67fe726e None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:36.035957 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a44f47-f1f7-45e5-bde5-357f67fe726e None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:36.036228 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a44f47-f1f7-45e5-bde5-357f67fe726e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:36.037260 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2332ce32-97fa-46fb-bac7-be6d78537591 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:36.048247 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 806/1604] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:27:36.049339 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332ce32-97fa-46fb-bac7-be6d78537591 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:36.057197 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-96a44f47-f1f7-45e5-bde5-357f67fe726e None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:27:36.058360 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-96a44f47-f1f7-45e5-bde5-357f67fe726e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:36.058970 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332ce32-97fa-46fb-bac7-be6d78537591 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:36.065472 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ae6fc-edd2-42ad-a90f-6f0cce9c8b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:36.066146 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ae6fc-edd2-42ad-a90f-6f0cce9c8b7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:36.066433 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ae6fc-edd2-42ad-a90f-6f0cce9c8b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:36.066726 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ae6fc-edd2-42ad-a90f-6f0cce9c8b7e admin admin] PATH_INFO: `/v3/projects/84a5e18477384261ac68bd5e752647ee/users/5ee4423cd17540c2b72d3f3b58b6350b/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:36.068652 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ae6fc-edd2-42ad-a90f-6f0cce9c8b7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=84a5e18477384261ac68bd5e752647ee, user_id=5ee4423cd17540c2b72d3f3b58b6350b, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:36.068795 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 799/1605] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:27:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:27:36.071926 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a44f47-f1f7-45e5-bde5-357f67fe726e None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:36.072034 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ae6fc-edd2-42ad-a90f-6f0cce9c8b7e admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:36.088918 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 807/1606] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:27:36 2022] PUT /identity/v3/projects/84a5e18477384261ac68bd5e752647ee/users/5ee4423cd17540c2b72d3f3b58b6350b/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:27:36.089956 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ae6fc-edd2-42ad-a90f-6f0cce9c8b7e admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:36.127141 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a44f47-f1f7-45e5-bde5-357f67fe726e None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:36.161206 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ae6fc-edd2-42ad-a90f-6f0cce9c8b7e admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:36.166610 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc88b249-dcb8-4737-858d-fe277510788f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:36.167329 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88b249-dcb8-4737-858d-fe277510788f admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:36.167611 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88b249-dcb8-4737-858d-fe277510788f admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:36.167887 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88b249-dcb8-4737-858d-fe277510788f admin admin] PATH_INFO: `/v3/projects/f0a13a6f2bf74a91a25fbad35ab9a42d/users/b70b5f3634a64b5282e557d0ab40a05e/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:36.180773 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d7f13-b611-4d6a-81cf-76b326363988 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:36.181590 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d7f13-b611-4d6a-81cf-76b326363988 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:36.181943 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d7f13-b611-4d6a-81cf-76b326363988 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:36.182214 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d7f13-b611-4d6a-81cf-76b326363988 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:36.182788 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc88b249-dcb8-4737-858d-fe277510788f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0a13a6f2bf74a91a25fbad35ab9a42d, user_id=b70b5f3634a64b5282e557d0ab40a05e, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:36.185530 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc88b249-dcb8-4737-858d-fe277510788f admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:36.192247 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5d7f13-b611-4d6a-81cf-76b326363988 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:36.193797 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5d7f13-b611-4d6a-81cf-76b326363988 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:36.199844 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 808/1607] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:27:36 2022] PUT /identity/v3/projects/f0a13a6f2bf74a91a25fbad35ab9a42d/users/b70b5f3634a64b5282e557d0ab40a05e/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:27:36.200981 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc88b249-dcb8-4737-858d-fe277510788f admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:36.203476 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 800/1608] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:27:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:27:36.204343 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d7f13-b611-4d6a-81cf-76b326363988 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:36.213705 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d7f13-b611-4d6a-81cf-76b326363988 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:36.244310 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:27:36.252968 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:27:36.283919 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc88b249-dcb8-4737-858d-fe277510788f admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:36.290052 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252ab5b3-e18e-481d-b8cb-57c4c94ad4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:36.290692 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ab5b3-e18e-481d-b8cb-57c4c94ad4ea admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:36.290995 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ab5b3-e18e-481d-b8cb-57c4c94ad4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:36.291326 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ab5b3-e18e-481d-b8cb-57c4c94ad4ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:36.292223 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252ab5b3-e18e-481d-b8cb-57c4c94ad4ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:36.293682 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252ab5b3-e18e-481d-b8cb-57c4c94ad4ea admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:36.298772 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49bae45-939a-4f45-9a8f-a59cd8501445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:36.299963 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bae45-939a-4f45-9a8f-a59cd8501445 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:36.300410 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bae45-939a-4f45-9a8f-a59cd8501445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:36.300877 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bae45-939a-4f45-9a8f-a59cd8501445 admin admin] PATH_INFO: `/v3/projects/75108528700e46f79827b81316fa27ca/users/152993e6399247b398d0386144120e6f/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:36.307365 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 809/1609] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:27:36.308227 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252ab5b3-e18e-481d-b8cb-57c4c94ad4ea admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:36.320678 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252ab5b3-e18e-481d-b8cb-57c4c94ad4ea admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:36.326792 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6dc24f-3adb-4757-b4a5-0c468b5f8e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:36.327566 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6dc24f-3adb-4757-b4a5-0c468b5f8e95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:36.327956 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6dc24f-3adb-4757-b4a5-0c468b5f8e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:36.328276 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6dc24f-3adb-4757-b4a5-0c468b5f8e95 admin admin] PATH_INFO: `/v3/projects/9d1e4ac9849c4605b27126cc3bbe4475/users/d276b614aaba446cb7c7834c0acb4c6a/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:36.328725 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49bae45-939a-4f45-9a8f-a59cd8501445 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75108528700e46f79827b81316fa27ca, user_id=152993e6399247b398d0386144120e6f, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:36.336438 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49bae45-939a-4f45-9a8f-a59cd8501445 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:36.347325 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6dc24f-3adb-4757-b4a5-0c468b5f8e95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d1e4ac9849c4605b27126cc3bbe4475, user_id=d276b614aaba446cb7c7834c0acb4c6a, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:36.350969 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6dc24f-3adb-4757-b4a5-0c468b5f8e95 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:36.364318 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 801/1610] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:27:36 2022] PUT /identity/v3/projects/75108528700e46f79827b81316fa27ca/users/152993e6399247b398d0386144120e6f/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:27:36.365943 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49bae45-939a-4f45-9a8f-a59cd8501445 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:36.378777 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 810/1611] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:27:36 2022] PUT /identity/v3/projects/9d1e4ac9849c4605b27126cc3bbe4475/users/d276b614aaba446cb7c7834c0acb4c6a/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:27:36.381076 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6dc24f-3adb-4757-b4a5-0c468b5f8e95 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:36.454211 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6dc24f-3adb-4757-b4a5-0c468b5f8e95 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:36.459707 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db035cf4-e2c4-4d80-b812-36025cc98b05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:36.460796 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db035cf4-e2c4-4d80-b812-36025cc98b05 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:36.461341 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49bae45-939a-4f45-9a8f-a59cd8501445 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:36.461561 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db035cf4-e2c4-4d80-b812-36025cc98b05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:36.462054 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db035cf4-e2c4-4d80-b812-36025cc98b05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:36.533445 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db035cf4-e2c4-4d80-b812-36025cc98b05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:36.535184 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db035cf4-e2c4-4d80-b812-36025cc98b05 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:36.539671 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f6007-2d5f-494f-8eb2-bff157879661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:36.540378 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f6007-2d5f-494f-8eb2-bff157879661 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:36.540766 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f6007-2d5f-494f-8eb2-bff157879661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:36.541155 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f6007-2d5f-494f-8eb2-bff157879661 admin admin] PATH_INFO: `/v3/projects/cd6f017f61f84734a5efcaa61aaed509/users/ca57556239ba4917aa85a2f907e7a1f7/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:36.546844 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 811/1612] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:27:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:27:36.549142 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2619f-7f06-4a7e-a4c2-98733fa97d96 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:36.549850 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2619f-7f06-4a7e-a4c2-98733fa97d96 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:36.550383 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2619f-7f06-4a7e-a4c2-98733fa97d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:36.560667 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79f6007-2d5f-494f-8eb2-bff157879661 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd6f017f61f84734a5efcaa61aaed509, user_id=ca57556239ba4917aa85a2f907e7a1f7, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:36.563493 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79f6007-2d5f-494f-8eb2-bff157879661 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:36.589781 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-eed2619f-7f06-4a7e-a4c2-98733fa97d96 None None] MFA Rules not processed for user `5ee4423cd17540c2b72d3f3b58b6350b`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:27:36.591685 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-eed2619f-7f06-4a7e-a4c2-98733fa97d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:36.611005 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 802/1613] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:27:36 2022] PUT /identity/v3/projects/cd6f017f61f84734a5efcaa61aaed509/users/ca57556239ba4917aa85a2f907e7a1f7/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:27:36.616282 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c922003-4c54-4c44-844b-68e6d0fb9f1b None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:36.617850 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c922003-4c54-4c44-844b-68e6d0fb9f1b None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:36.618568 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c922003-4c54-4c44-844b-68e6d0fb9f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:36.687070 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:27:36.696382 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-7c922003-4c54-4c44-844b-68e6d0fb9f1b None None] MFA Rules not processed for user `b70b5f3634a64b5282e557d0ab40a05e`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:27:36.702268 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-7c922003-4c54-4c44-844b-68e6d0fb9f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:36.757247 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 812/1614] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:27:36 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:27:36.758116 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2619f-7f06-4a7e-a4c2-98733fa97d96 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:36.766506 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:27:36.807053 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 803/1615] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:27:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:27:36.808016 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a6566-0c5e-4472-8159-30188cb05613 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:36.808410 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a6566-0c5e-4472-8159-30188cb05613 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:36.808816 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a6566-0c5e-4472-8159-30188cb05613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:36.840912 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2619f-7f06-4a7e-a4c2-98733fa97d96 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:36.847756 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8bd4f-430d-40eb-9bc7-1748a2223b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:36.848760 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8bd4f-430d-40eb-9bc7-1748a2223b5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:36.849183 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8bd4f-430d-40eb-9bc7-1748a2223b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:36.849620 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8bd4f-430d-40eb-9bc7-1748a2223b5a admin admin] PATH_INFO: `/v3/projects/1eb371f29ae54ad383a29fe1686040ab/users/41eeb2403f4748b7931680835e47f113/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:36.856727 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-9a9a6566-0c5e-4472-8159-30188cb05613 None None] MFA Rules not processed for user `152993e6399247b398d0386144120e6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:27:36.857038 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-9a9a6566-0c5e-4472-8159-30188cb05613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:36.870533 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f8bd4f-430d-40eb-9bc7-1748a2223b5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eb371f29ae54ad383a29fe1686040ab, user_id=41eeb2403f4748b7931680835e47f113, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:36.873709 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f8bd4f-430d-40eb-9bc7-1748a2223b5a admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:36.897113 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 813/1616] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:27:36 2022] PUT /identity/v3/projects/1eb371f29ae54ad383a29fe1686040ab/users/41eeb2403f4748b7931680835e47f113/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:27:36.898853 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5bbd15-7ac3-40bc-b034-0325dbeddcde None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:36.899322 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5bbd15-7ac3-40bc-b034-0325dbeddcde None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:36.899768 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5bbd15-7ac3-40bc-b034-0325dbeddcde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:36.934323 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-5a5bbd15-7ac3-40bc-b034-0325dbeddcde None None] MFA Rules not processed for user `d276b614aaba446cb7c7834c0acb4c6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:27:36.935669 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-5a5bbd15-7ac3-40bc-b034-0325dbeddcde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:36.972968 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 804/1617] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:27:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:27:36.972968 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365fac39-cf7e-4151-846f-682b177b2244 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:36.972968 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365fac39-cf7e-4151-846f-682b177b2244 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:36.972968 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365fac39-cf7e-4151-846f-682b177b2244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:37.019386 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-365fac39-cf7e-4151-846f-682b177b2244 None None] MFA Rules not processed for user `ca57556239ba4917aa85a2f907e7a1f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:27:37.021706 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-365fac39-cf7e-4151-846f-682b177b2244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:37.024259 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 814/1618] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:27:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:27:37.025455 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5bbd15-7ac3-40bc-b034-0325dbeddcde None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:37.129518 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:27:37.139836 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5bbd15-7ac3-40bc-b034-0325dbeddcde None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:37.151004 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b83d4a0-414b-4089-a66b-ac7988073904 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:37.151879 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b83d4a0-414b-4089-a66b-ac7988073904 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:37.152319 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b83d4a0-414b-4089-a66b-ac7988073904 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:37.152777 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b83d4a0-414b-4089-a66b-ac7988073904 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:37.175187 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 805/1619] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:27:36 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:27:37.175187 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365fac39-cf7e-4151-846f-682b177b2244 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:37.190507 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365fac39-cf7e-4151-846f-682b177b2244 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:37.197119 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c982c714-36d5-4974-8add-39226f786f84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:37.198175 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982c714-36d5-4974-8add-39226f786f84 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:37.198671 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982c714-36d5-4974-8add-39226f786f84 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:37.199624 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982c714-36d5-4974-8add-39226f786f84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:37.312009 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b83d4a0-414b-4089-a66b-ac7988073904 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:37.314745 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b83d4a0-414b-4089-a66b-ac7988073904 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:37.319046 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:27:37.323809 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c982c714-36d5-4974-8add-39226f786f84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:37.325745 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c982c714-36d5-4974-8add-39226f786f84 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:37.342793 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 815/1620] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:27:37 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:27:37.344761 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6529000-5669-4fc0-a9b5-25b848c9ef45 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:37.345111 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6529000-5669-4fc0-a9b5-25b848c9ef45 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:37.345396 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6529000-5669-4fc0-a9b5-25b848c9ef45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:37.349552 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 806/1621] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:27:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:27:37.353826 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468958bd-d7dc-43fe-92a8-1be30d84fec9 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:37.354233 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468958bd-d7dc-43fe-92a8-1be30d84fec9 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:37.354606 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468958bd-d7dc-43fe-92a8-1be30d84fec9 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:37.361214 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 807/1622] 10.222.0.36 () {54 vars in 962 bytes} [Mon Aug 29 22:27:37 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:27:37.364363 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8dd139-f569-4905-9139-9cec40238494 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:37.366213 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8dd139-f569-4905-9139-9cec40238494 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:37.366610 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8dd139-f569-4905-9139-9cec40238494 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:37.371363 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 808/1623] 10.222.0.36 () {54 vars in 962 bytes} [Mon Aug 29 22:27:37 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:27:37.376704 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-f6529000-5669-4fc0-a9b5-25b848c9ef45 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:27:37.378421 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f6529000-5669-4fc0-a9b5-25b848c9ef45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:37.379454 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8dd139-f569-4905-9139-9cec40238494 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:37.473683 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 816/1624] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:27:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:27:37.473683 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f7238-531b-4c75-b113-d76cfe447ec6 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:37.473683 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f7238-531b-4c75-b113-d76cfe447ec6 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:37.473683 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f7238-531b-4c75-b113-d76cfe447ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:37.514577 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8dd139-f569-4905-9139-9cec40238494 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:37.524587 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2be173-e861-4454-92a5-88e5810dbd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:37.525284 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2be173-e861-4454-92a5-88e5810dbd83 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:37.526277 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2be173-e861-4454-92a5-88e5810dbd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:37.526557 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2be173-e861-4454-92a5-88e5810dbd83 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:37.527226 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2be173-e861-4454-92a5-88e5810dbd83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:37.529632 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2be173-e861-4454-92a5-88e5810dbd83 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:37.537096 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-653f7238-531b-4c75-b113-d76cfe447ec6 None None] MFA Rules not processed for user `90b7213b7111456a93e294ce40b95b21`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:27:37.539134 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-653f7238-531b-4c75-b113-d76cfe447ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:37.584968 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 809/1625] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:27:37 2022] POST /identity/v3/projects => generated 403 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:27:37.584968 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebdcad-9735-4868-aa8c-1c439c841883 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:37.584968 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebdcad-9735-4868-aa8c-1c439c841883 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:37.585342 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebdcad-9735-4868-aa8c-1c439c841883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:37.641172 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-bbebdcad-9735-4868-aa8c-1c439c841883 None None] MFA Rules not processed for user `90b7213b7111456a93e294ce40b95b21`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:27:37.642410 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 817/1626] 10.222.0.36 () {58 vars in 1059 bytes} [Mon Aug 29 22:27:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:27:37.643828 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f7238-531b-4c75-b113-d76cfe447ec6 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:37.652853 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-bbebdcad-9735-4868-aa8c-1c439c841883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:37.669137 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:27:37.726698 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f7238-531b-4c75-b113-d76cfe447ec6 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:37.804997 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 810/1627] 10.222.0.36 () {58 vars in 1059 bytes} [Mon Aug 29 22:27:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:27:37.809485 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbebdcad-9735-4868-aa8c-1c439c841883 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:37.839748 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96118d6d-033b-4059-b025-3b6742bcf532 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:37.846067 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96118d6d-033b-4059-b025-3b6742bcf532 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:37.846481 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96118d6d-033b-4059-b025-3b6742bcf532 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:37.846838 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96118d6d-033b-4059-b025-3b6742bcf532 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:37.943942 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbebdcad-9735-4868-aa8c-1c439c841883 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:37.949606 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70dbab3-a09e-4a4d-92a2-dfdd89b2ac66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:37.950625 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70dbab3-a09e-4a4d-92a2-dfdd89b2ac66 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:37.951115 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70dbab3-a09e-4a4d-92a2-dfdd89b2ac66 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:37.951675 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70dbab3-a09e-4a4d-92a2-dfdd89b2ac66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:37.991873 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:27:38.034019 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96118d6d-033b-4059-b025-3b6742bcf532 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:38.036396 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96118d6d-033b-4059-b025-3b6742bcf532 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:38.063859 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70dbab3-a09e-4a4d-92a2-dfdd89b2ac66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:38.069218 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70dbab3-a09e-4a4d-92a2-dfdd89b2ac66 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:38.077043 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 818/1628] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:27:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:27:38.077493 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96118d6d-033b-4059-b025-3b6742bcf532 service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:38.089161 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 811/1629] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:27:37 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:27:38.090549 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70dbab3-a09e-4a4d-92a2-dfdd89b2ac66 service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:38.106138 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96118d6d-033b-4059-b025-3b6742bcf532 service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:38.107958 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70dbab3-a09e-4a4d-92a2-dfdd89b2ac66 service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:38.117025 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e916a92-9be6-43ca-8b26-458138e45d6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b7213b7111456a93e294ce40b95b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:38.117934 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e916a92-9be6-43ca-8b26-458138e45d6b service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:38.118442 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e916a92-9be6-43ca-8b26-458138e45d6b service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:38.118837 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e916a92-9be6-43ca-8b26-458138e45d6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:38.119463 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d21b11-7503-4c52-a24c-6980035f459b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:38.120181 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d21b11-7503-4c52-a24c-6980035f459b admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:38.120514 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d21b11-7503-4c52-a24c-6980035f459b admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:38.120917 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d21b11-7503-4c52-a24c-6980035f459b admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:38.121478 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d21b11-7503-4c52-a24c-6980035f459b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:38.125993 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d21b11-7503-4c52-a24c-6980035f459b admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:38.175273 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 819/1630] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:27:38 2022] POST /identity/v3/users => generated 308 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:27:38.176195 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d21b11-7503-4c52-a24c-6980035f459b admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:38.210176 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d21b11-7503-4c52-a24c-6980035f459b admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:38.224347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1c0f3a-2360-4860-985c-08b27d7d474f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b7213b7111456a93e294ce40b95b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:38.225346 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c0f3a-2360-4860-985c-08b27d7d474f service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:38.225900 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c0f3a-2360-4860-985c-08b27d7d474f service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:38.226191 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c0f3a-2360-4860-985c-08b27d7d474f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:38.298886 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e916a92-9be6-43ca-8b26-458138e45d6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:38.311437 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e916a92-9be6-43ca-8b26-458138e45d6b service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:38.351496 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 812/1631] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:27:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:27:38.369180 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e916a92-9be6-43ca-8b26-458138e45d6b service nova] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:38.397101 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e916a92-9be6-43ca-8b26-458138e45d6b service nova] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:38.406670 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c46dadd-a8ed-4fe5-af42-0fbf30d52810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:38.407391 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46dadd-a8ed-4fe5-af42-0fbf30d52810 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:38.407727 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46dadd-a8ed-4fe5-af42-0fbf30d52810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:38.408006 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46dadd-a8ed-4fe5-af42-0fbf30d52810 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:38.408768 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c46dadd-a8ed-4fe5-af42-0fbf30d52810 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:38.411017 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c46dadd-a8ed-4fe5-af42-0fbf30d52810 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:38.423442 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1c0f3a-2360-4860-985c-08b27d7d474f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:38.426429 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1c0f3a-2360-4860-985c-08b27d7d474f service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:38.440569 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 813/1632] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:27:38.442116 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c46dadd-a8ed-4fe5-af42-0fbf30d52810 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:38.462114 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 820/1633] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:27:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:27:38.462357 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c46dadd-a8ed-4fe5-af42-0fbf30d52810 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:38.478808 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb1e6e6-ad1c-4184-9def-05e584ca3455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:38.480894 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1e6e6-ad1c-4184-9def-05e584ca3455 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:38.481354 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1e6e6-ad1c-4184-9def-05e584ca3455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:38.481955 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1e6e6-ad1c-4184-9def-05e584ca3455 admin admin] PATH_INFO: `/v3/projects/d64f4b5100ec418bbb351f0c95dc1a65/users/cfe236859dce4b81838b533341c509b7/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:38.553612 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb1e6e6-ad1c-4184-9def-05e584ca3455 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d64f4b5100ec418bbb351f0c95dc1a65, user_id=cfe236859dce4b81838b533341c509b7, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:38.564857 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb1e6e6-ad1c-4184-9def-05e584ca3455 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:38.603766 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 814/1634] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:27:38 2022] PUT /identity/v3/projects/d64f4b5100ec418bbb351f0c95dc1a65/users/cfe236859dce4b81838b533341c509b7/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:27:38.607982 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1c0f3a-2360-4860-985c-08b27d7d474f service nova] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:38.613983 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:27:38.627243 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1c0f3a-2360-4860-985c-08b27d7d474f service nova] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:38.792371 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d2210-86ab-433a-b56f-399bd22a9c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:38.793784 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d2210-86ab-433a-b56f-399bd22a9c0b admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:38.794209 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d2210-86ab-433a-b56f-399bd22a9c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:38.794487 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d2210-86ab-433a-b56f-399bd22a9c0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:38.795583 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6d2210-86ab-433a-b56f-399bd22a9c0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:38.797306 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6d2210-86ab-433a-b56f-399bd22a9c0b admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:38.826864 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb1e6e6-ad1c-4184-9def-05e584ca3455 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:38.832202 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 821/1635] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:27:38.847045 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb1e6e6-ad1c-4184-9def-05e584ca3455 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:38.879488 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f761c9bb-c92f-46d8-a163-e5d2aa0a5073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:38.880299 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761c9bb-c92f-46d8-a163-e5d2aa0a5073 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:38.880716 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761c9bb-c92f-46d8-a163-e5d2aa0a5073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:38.881088 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761c9bb-c92f-46d8-a163-e5d2aa0a5073 admin admin] PATH_INFO: `/v3/projects/d64f4b5100ec418bbb351f0c95dc1a65/users/cfe236859dce4b81838b533341c509b7/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:38.892721 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f761c9bb-c92f-46d8-a163-e5d2aa0a5073 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d64f4b5100ec418bbb351f0c95dc1a65, user_id=cfe236859dce4b81838b533341c509b7, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:38.898842 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f761c9bb-c92f-46d8-a163-e5d2aa0a5073 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:38.956428 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 815/1636] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:27:38 2022] PUT /identity/v3/projects/d64f4b5100ec418bbb351f0c95dc1a65/users/cfe236859dce4b81838b533341c509b7/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:27:38.958820 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b462d-cddb-43ca-882a-309e6be0edb2 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:38.959311 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b462d-cddb-43ca-882a-309e6be0edb2 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:38.960410 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b462d-cddb-43ca-882a-309e6be0edb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:39.033198 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-6b1b462d-cddb-43ca-882a-309e6be0edb2 None None] MFA Rules not processed for user `cfe236859dce4b81838b533341c509b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:27:39.038162 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-6b1b462d-cddb-43ca-882a-309e6be0edb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:39.151055 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9b7a2-be5b-4609-917e-d283d2583179 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:39.151528 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9b7a2-be5b-4609-917e-d283d2583179 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:39.151990 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9b7a2-be5b-4609-917e-d283d2583179 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:39.153689 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 816/1637] 10.222.0.36 () {54 vars in 912 bytes} [Mon Aug 29 22:27:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:27:39.161204 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35afe13-16cc-4630-b4e8-1bee373e4946 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:39.161625 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35afe13-16cc-4630-b4e8-1bee373e4946 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:39.162032 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35afe13-16cc-4630-b4e8-1bee373e4946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:39.201179 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-c35afe13-16cc-4630-b4e8-1bee373e4946 None None] MFA Rules not processed for user `90b7213b7111456a93e294ce40b95b21`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:27:39.203957 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c35afe13-16cc-4630-b4e8-1bee373e4946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:39.270845 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 822/1638] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:27:38 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:27:39.272499 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caafc9f8-1803-4f96-8b89-5a56d47e546c None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:39.272800 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caafc9f8-1803-4f96-8b89-5a56d47e546c None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:39.273072 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caafc9f8-1803-4f96-8b89-5a56d47e546c None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:39.277291 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 823/1639] 10.222.0.36 () {54 vars in 912 bytes} [Mon Aug 29 22:27:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:27:39.278351 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caafc9f8-1803-4f96-8b89-5a56d47e546c None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:39.330947 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 817/1640] 10.222.0.36 () {58 vars in 1009 bytes} [Mon Aug 29 22:27:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:27:39.335103 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97944c70-0c7f-46b2-8f68-f9685329ee1f None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:39.336202 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97944c70-0c7f-46b2-8f68-f9685329ee1f None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:39.336972 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97944c70-0c7f-46b2-8f68-f9685329ee1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:39.434908 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-97944c70-0c7f-46b2-8f68-f9685329ee1f None None] MFA Rules not processed for user `90b7213b7111456a93e294ce40b95b21`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:27:39.434908 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-97944c70-0c7f-46b2-8f68-f9685329ee1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:39.435388 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caafc9f8-1803-4f96-8b89-5a56d47e546c None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:39.435635 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 818/1641] 10.222.0.36 () {58 vars in 1009 bytes} [Mon Aug 29 22:27:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:27:39.435635 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97944c70-0c7f-46b2-8f68-f9685329ee1f None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:39.435816 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78401ab2-c560-4411-bb12-996daf484d70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:39.435816 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78401ab2-c560-4411-bb12-996daf484d70 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:39.435816 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78401ab2-c560-4411-bb12-996daf484d70 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:39.435816 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78401ab2-c560-4411-bb12-996daf484d70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:39.441086 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:27:39.470083 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97944c70-0c7f-46b2-8f68-f9685329ee1f None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:39.477704 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78401ab2-c560-4411-bb12-996daf484d70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:39.479133 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98692c61-85c5-4259-a1ed-d0f14d4022b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:39.480858 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98692c61-85c5-4259-a1ed-d0f14d4022b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:39.481197 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98692c61-85c5-4259-a1ed-d0f14d4022b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:39.481470 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98692c61-85c5-4259-a1ed-d0f14d4022b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:39.482903 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78401ab2-c560-4411-bb12-996daf484d70 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:39.509307 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98692c61-85c5-4259-a1ed-d0f14d4022b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:39.512378 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 824/1642] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:27:39 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:27:39.512756 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98692c61-85c5-4259-a1ed-d0f14d4022b8 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:39.528729 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 819/1643] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:27:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:27:39.588022 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78401ab2-c560-4411-bb12-996daf484d70 service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:39.600670 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78401ab2-c560-4411-bb12-996daf484d70 service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:39.614252 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bcd42c-7fbf-46fa-8f5c-a4db8429c6f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:39.615294 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bcd42c-7fbf-46fa-8f5c-a4db8429c6f5 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:39.615677 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bcd42c-7fbf-46fa-8f5c-a4db8429c6f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:39.616045 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bcd42c-7fbf-46fa-8f5c-a4db8429c6f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:39.646642 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bcd42c-7fbf-46fa-8f5c-a4db8429c6f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:39.649564 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bcd42c-7fbf-46fa-8f5c-a4db8429c6f5 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:39.679100 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 825/1644] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:27:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:27:41.060092 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98692c61-85c5-4259-a1ed-d0f14d4022b8 service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:41.232075 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98692c61-85c5-4259-a1ed-d0f14d4022b8 service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:41.246986 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440dd14f-6c05-4756-aa7f-8f07199e7920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:41.247806 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440dd14f-6c05-4756-aa7f-8f07199e7920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:41.248115 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440dd14f-6c05-4756-aa7f-8f07199e7920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:41.248355 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440dd14f-6c05-4756-aa7f-8f07199e7920 admin admin] PATH_INFO: `/v3/users/ca57556239ba4917aa85a2f907e7a1f7` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:41.253417 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440dd14f-6c05-4756-aa7f-8f07199e7920 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca57556239ba4917aa85a2f907e7a1f7)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:41.254474 dv-cinder-854268-3-smb devstack@keystone.service[81514]: WARNING py.warnings [None req-440dd14f-6c05-4756-aa7f-8f07199e7920 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 22:27:41.254474 dv-cinder-854268-3-smb devstack@keystone.service[81514]: warnings.warn(msg) Aug 29 22:27:41.254474 dv-cinder-854268-3-smb devstack@keystone.service[81514]: Aug 29 22:27:41.255730 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440dd14f-6c05-4756-aa7f-8f07199e7920 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:41.409004 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-440dd14f-6c05-4756-aa7f-8f07199e7920 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca57556239ba4917aa85a2f907e7a1f7'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:27:41.432708 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-440dd14f-6c05-4756-aa7f-8f07199e7920 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca57556239ba4917aa85a2f907e7a1f7'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:27:41.470093 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-440dd14f-6c05-4756-aa7f-8f07199e7920 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca57556239ba4917aa85a2f907e7a1f7'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:27:41.471762 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-440dd14f-6c05-4756-aa7f-8f07199e7920 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca57556239ba4917aa85a2f907e7a1f7'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:27:41.527459 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-440dd14f-6c05-4756-aa7f-8f07199e7920 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca57556239ba4917aa85a2f907e7a1f7'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:27:41.545436 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 820/1645] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:27:41 2022] DELETE /identity/v3/users/ca57556239ba4917aa85a2f907e7a1f7 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:27:41.547317 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ae410-4280-4f2d-ba75-6dc50c006e28 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:41.547841 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ae410-4280-4f2d-ba75-6dc50c006e28 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:41.547841 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ae410-4280-4f2d-ba75-6dc50c006e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:41.571882 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-c41ae410-4280-4f2d-ba75-6dc50c006e28 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:27:41.573523 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c41ae410-4280-4f2d-ba75-6dc50c006e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:41.585010 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:27:41.770771 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 826/1646] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:27:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:27:41.804030 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440dd14f-6c05-4756-aa7f-8f07199e7920 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:41.805878 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-440dd14f-6c05-4756-aa7f-8f07199e7920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:42.033807 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440dd14f-6c05-4756-aa7f-8f07199e7920 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:42.044861 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a51e268-f391-4986-834a-4050ee6e327a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:42.045517 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51e268-f391-4986-834a-4050ee6e327a service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:42.045831 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51e268-f391-4986-834a-4050ee6e327a service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:42.046067 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51e268-f391-4986-834a-4050ee6e327a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:42.082821 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a51e268-f391-4986-834a-4050ee6e327a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:42.084338 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a51e268-f391-4986-834a-4050ee6e327a service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:42.119984 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 821/1647] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:27:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:27:43.354838 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ae410-4280-4f2d-ba75-6dc50c006e28 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:43.360326 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c41ae410-4280-4f2d-ba75-6dc50c006e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:43.420807 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ae410-4280-4f2d-ba75-6dc50c006e28 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:43.438867 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439b6409-3fc4-44c2-87f1-570616e8e737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:43.440015 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b6409-3fc4-44c2-87f1-570616e8e737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:43.442064 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b6409-3fc4-44c2-87f1-570616e8e737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:43.442968 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b6409-3fc4-44c2-87f1-570616e8e737 admin admin] PATH_INFO: `/v3/users/d276b614aaba446cb7c7834c0acb4c6a` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:43.445441 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439b6409-3fc4-44c2-87f1-570616e8e737 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d276b614aaba446cb7c7834c0acb4c6a)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:43.452350 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439b6409-3fc4-44c2-87f1-570616e8e737 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:43.588762 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-439b6409-3fc4-44c2-87f1-570616e8e737 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd276b614aaba446cb7c7834c0acb4c6a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:27:43.605463 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-439b6409-3fc4-44c2-87f1-570616e8e737 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd276b614aaba446cb7c7834c0acb4c6a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:27:43.606562 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-439b6409-3fc4-44c2-87f1-570616e8e737 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd276b614aaba446cb7c7834c0acb4c6a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:27:43.627261 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-439b6409-3fc4-44c2-87f1-570616e8e737 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd276b614aaba446cb7c7834c0acb4c6a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:27:43.628141 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-439b6409-3fc4-44c2-87f1-570616e8e737 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd276b614aaba446cb7c7834c0acb4c6a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:27:43.696896 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 827/1648] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:27:43 2022] DELETE /identity/v3/users/d276b614aaba446cb7c7834c0acb4c6a => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:27:43.702070 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751793c-1f89-4ecd-b080-e3b132726e1f None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:43.702070 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751793c-1f89-4ecd-b080-e3b132726e1f None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:43.702684 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751793c-1f89-4ecd-b080-e3b132726e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:43.771435 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-a751793c-1f89-4ecd-b080-e3b132726e1f None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:27:43.778722 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a751793c-1f89-4ecd-b080-e3b132726e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:43.791851 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:27:43.990785 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 822/1649] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:27:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:27:44.191233 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439b6409-3fc4-44c2-87f1-570616e8e737 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:44.193031 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-439b6409-3fc4-44c2-87f1-570616e8e737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:44.468911 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439b6409-3fc4-44c2-87f1-570616e8e737 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:44.479022 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2bf4ee-990e-439b-aa5b-e637a2067037 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:44.479894 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2bf4ee-990e-439b-aa5b-e637a2067037 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:44.480278 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2bf4ee-990e-439b-aa5b-e637a2067037 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:44.481733 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2bf4ee-990e-439b-aa5b-e637a2067037 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:44.525979 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2bf4ee-990e-439b-aa5b-e637a2067037 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:44.531070 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2bf4ee-990e-439b-aa5b-e637a2067037 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:44.568885 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 828/1650] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:27:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:27:44.828897 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a751793c-1f89-4ecd-b080-e3b132726e1f None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:44.832193 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a751793c-1f89-4ecd-b080-e3b132726e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:44.855686 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a751793c-1f89-4ecd-b080-e3b132726e1f None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:44.873179 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b3b8d-993d-4413-9feb-a15170c8570d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:44.875460 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b3b8d-993d-4413-9feb-a15170c8570d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:44.876436 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b3b8d-993d-4413-9feb-a15170c8570d admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:44.877164 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b3b8d-993d-4413-9feb-a15170c8570d admin admin] PATH_INFO: `/v3/projects/cd6f017f61f84734a5efcaa61aaed509` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:44.879041 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b3b8d-993d-4413-9feb-a15170c8570d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd6f017f61f84734a5efcaa61aaed509)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:44.884285 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b3b8d-993d-4413-9feb-a15170c8570d admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:44.993458 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-386b3b8d-993d-4413-9feb-a15170c8570d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd6f017f61f84734a5efcaa61aaed509', 'request_id': 'req-386b3b8d-993d-4413-9feb-a15170c8570d'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:27:45.004590 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-386b3b8d-993d-4413-9feb-a15170c8570d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd6f017f61f84734a5efcaa61aaed509', 'request_id': 'req-386b3b8d-993d-4413-9feb-a15170c8570d'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:27:45.036637 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-386b3b8d-993d-4413-9feb-a15170c8570d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd6f017f61f84734a5efcaa61aaed509', 'request_id': 'req-386b3b8d-993d-4413-9feb-a15170c8570d'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:27:45.123415 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-386b3b8d-993d-4413-9feb-a15170c8570d admin admin] The token cache is being invalidate because project cd6f017f61f84734a5efcaa61aaed509 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:27:45.124023 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-386b3b8d-993d-4413-9feb-a15170c8570d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:27:45.134816 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-386b3b8d-993d-4413-9feb-a15170c8570d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:27:45.136994 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 823/1651] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:27:44 2022] DELETE /identity/v3/projects/cd6f017f61f84734a5efcaa61aaed509 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:27:45.144914 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2bf4ee-990e-439b-aa5b-e637a2067037 service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:45.168172 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2bf4ee-990e-439b-aa5b-e637a2067037 service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:45.261545 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:27:45.290090 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b3b8d-993d-4413-9feb-a15170c8570d admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:45.291512 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-386b3b8d-993d-4413-9feb-a15170c8570d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:45.390260 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c284c-c884-4d13-82f2-0a5837ea3d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:45.391364 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c284c-c884-4d13-82f2-0a5837ea3d82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:45.391821 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c284c-c884-4d13-82f2-0a5837ea3d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:45.392281 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c284c-c884-4d13-82f2-0a5837ea3d82 admin admin] PATH_INFO: `/v3/users/cfe236859dce4b81838b533341c509b7` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:45.398223 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c284c-c884-4d13-82f2-0a5837ea3d82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfe236859dce4b81838b533341c509b7)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:45.408091 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c284c-c884-4d13-82f2-0a5837ea3d82 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:45.498652 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b3b8d-993d-4413-9feb-a15170c8570d admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:45.523159 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a947f73-ef71-4018-b16b-2e882a709ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:45.525728 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a947f73-ef71-4018-b16b-2e882a709ecf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:45.526178 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a947f73-ef71-4018-b16b-2e882a709ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:45.527606 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a947f73-ef71-4018-b16b-2e882a709ecf admin admin] PATH_INFO: `/v3/users/152993e6399247b398d0386144120e6f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:45.530125 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a947f73-ef71-4018-b16b-2e882a709ecf admin admin] RBAC: Authorizing `identity:delete_user(user_id=152993e6399247b398d0386144120e6f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:45.536321 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a947f73-ef71-4018-b16b-2e882a709ecf admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:45.538756 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-6f4c284c-c884-4d13-82f2-0a5837ea3d82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfe236859dce4b81838b533341c509b7'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:27:45.558571 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-6f4c284c-c884-4d13-82f2-0a5837ea3d82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfe236859dce4b81838b533341c509b7'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:27:45.559508 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-6f4c284c-c884-4d13-82f2-0a5837ea3d82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfe236859dce4b81838b533341c509b7'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:27:45.586812 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-6f4c284c-c884-4d13-82f2-0a5837ea3d82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfe236859dce4b81838b533341c509b7'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:27:45.588185 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-6f4c284c-c884-4d13-82f2-0a5837ea3d82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfe236859dce4b81838b533341c509b7'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:27:45.626793 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 829/1652] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:27:45 2022] DELETE /identity/v3/users/cfe236859dce4b81838b533341c509b7 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:27:45.630695 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:27:45.667779 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-7a947f73-ef71-4018-b16b-2e882a709ecf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '152993e6399247b398d0386144120e6f'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:27:45.690233 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-7a947f73-ef71-4018-b16b-2e882a709ecf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '152993e6399247b398d0386144120e6f'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:27:45.717243 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-7a947f73-ef71-4018-b16b-2e882a709ecf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '152993e6399247b398d0386144120e6f'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:27:45.718544 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-7a947f73-ef71-4018-b16b-2e882a709ecf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '152993e6399247b398d0386144120e6f'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:27:45.749554 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-7a947f73-ef71-4018-b16b-2e882a709ecf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '152993e6399247b398d0386144120e6f'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:27:45.767639 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 824/1653] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:27:45 2022] DELETE /identity/v3/users/152993e6399247b398d0386144120e6f => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:27:45.772491 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988382b-f591-4a91-8f33-22fbbe2e5142 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:45.773402 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988382b-f591-4a91-8f33-22fbbe2e5142 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:45.773768 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988382b-f591-4a91-8f33-22fbbe2e5142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:45.832844 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-f988382b-f591-4a91-8f33-22fbbe2e5142 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:27:45.849310 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f988382b-f591-4a91-8f33-22fbbe2e5142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:46.035720 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 830/1654] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:27:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:27:46.072409 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a947f73-ef71-4018-b16b-2e882a709ecf admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:46.074139 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-7a947f73-ef71-4018-b16b-2e882a709ecf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:46.262482 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a947f73-ef71-4018-b16b-2e882a709ecf admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:46.281022 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6e66b-4f9f-41ed-8c98-3bc708085156 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:46.281674 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6e66b-4f9f-41ed-8c98-3bc708085156 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:46.281954 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6e66b-4f9f-41ed-8c98-3bc708085156 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:46.282231 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6e66b-4f9f-41ed-8c98-3bc708085156 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:46.317113 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d6e66b-4f9f-41ed-8c98-3bc708085156 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:46.318613 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d6e66b-4f9f-41ed-8c98-3bc708085156 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:46.344125 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 825/1655] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:27:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:27:46.370973 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67bee4-8ad6-4272-a74b-06c6462224e4 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:46.371391 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67bee4-8ad6-4272-a74b-06c6462224e4 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:46.371815 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67bee4-8ad6-4272-a74b-06c6462224e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:46.446154 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-bb67bee4-8ad6-4272-a74b-06c6462224e4 None None] MFA Rules not processed for user `a92a2da2bce0489988ab08978d85b265`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:27:46.453128 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-bb67bee4-8ad6-4272-a74b-06c6462224e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:46.511034 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6e66b-4f9f-41ed-8c98-3bc708085156 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:46.512814 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-30d6e66b-4f9f-41ed-8c98-3bc708085156 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:46.538370 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6e66b-4f9f-41ed-8c98-3bc708085156 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:46.547525 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cda9e3-d5e1-4a3f-8393-30348545b7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:46.556704 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cda9e3-d5e1-4a3f-8393-30348545b7ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:46.556994 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cda9e3-d5e1-4a3f-8393-30348545b7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:46.557728 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cda9e3-d5e1-4a3f-8393-30348545b7ea admin admin] PATH_INFO: `/v3/projects/d64f4b5100ec418bbb351f0c95dc1a65` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:46.561886 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cda9e3-d5e1-4a3f-8393-30348545b7ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=d64f4b5100ec418bbb351f0c95dc1a65)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:46.570370 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cda9e3-d5e1-4a3f-8393-30348545b7ea admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:46.600420 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:27:46.696972 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 831/1656] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:27:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:27:46.700627 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573735ea-e6a6-410e-8424-3792985c3d81 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:46.702093 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573735ea-e6a6-410e-8424-3792985c3d81 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:46.706116 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573735ea-e6a6-410e-8424-3792985c3d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:46.722455 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-46cda9e3-d5e1-4a3f-8393-30348545b7ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd64f4b5100ec418bbb351f0c95dc1a65', 'request_id': 'req-46cda9e3-d5e1-4a3f-8393-30348545b7ea'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:27:46.753296 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-46cda9e3-d5e1-4a3f-8393-30348545b7ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd64f4b5100ec418bbb351f0c95dc1a65', 'request_id': 'req-46cda9e3-d5e1-4a3f-8393-30348545b7ea'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:27:46.771859 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-46cda9e3-d5e1-4a3f-8393-30348545b7ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd64f4b5100ec418bbb351f0c95dc1a65', 'request_id': 'req-46cda9e3-d5e1-4a3f-8393-30348545b7ea'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:27:46.773097 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-573735ea-e6a6-410e-8424-3792985c3d81 None None] MFA Rules not processed for user `a92a2da2bce0489988ab08978d85b265`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:27:46.778994 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-573735ea-e6a6-410e-8424-3792985c3d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:46.812180 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-46cda9e3-d5e1-4a3f-8393-30348545b7ea admin admin] The token cache is being invalidate because project d64f4b5100ec418bbb351f0c95dc1a65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:27:46.812494 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-46cda9e3-d5e1-4a3f-8393-30348545b7ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:27:46.819071 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-46cda9e3-d5e1-4a3f-8393-30348545b7ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:27:46.832613 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 826/1657] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:27:46 2022] DELETE /identity/v3/projects/d64f4b5100ec418bbb351f0c95dc1a65 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:27:46.836146 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5e035-6015-4345-84bf-da979d371233 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:46.841560 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5e035-6015-4345-84bf-da979d371233 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:46.841881 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5e035-6015-4345-84bf-da979d371233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:46.959936 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-16f5e035-6015-4345-84bf-da979d371233 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:27:46.964066 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-16f5e035-6015-4345-84bf-da979d371233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:47.060153 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:27:47.068743 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 832/1658] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:27:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:27:47.079264 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573735ea-e6a6-410e-8424-3792985c3d81 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:47.081826 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-573735ea-e6a6-410e-8424-3792985c3d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:47.149248 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 827/1659] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:27:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:27:47.152572 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6fbe0c-4eb2-44d8-b042-2285b7f0e1ff None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:47.153361 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6fbe0c-4eb2-44d8-b042-2285b7f0e1ff None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:47.154155 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6fbe0c-4eb2-44d8-b042-2285b7f0e1ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:47.210791 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-1e6fbe0c-4eb2-44d8-b042-2285b7f0e1ff None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:27:47.212517 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-1e6fbe0c-4eb2-44d8-b042-2285b7f0e1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:47.241657 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 828/1660] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:27:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:27:47.256641 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6fbe0c-4eb2-44d8-b042-2285b7f0e1ff None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:47.283519 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6fbe0c-4eb2-44d8-b042-2285b7f0e1ff None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:47.292164 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a8d61-01b9-4483-b95f-7180bb8fabe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:47.293088 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a8d61-01b9-4483-b95f-7180bb8fabe9 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:47.293582 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a8d61-01b9-4483-b95f-7180bb8fabe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:47.294313 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a8d61-01b9-4483-b95f-7180bb8fabe9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:47.295313 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2a8d61-01b9-4483-b95f-7180bb8fabe9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:27:47.296608 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2a8d61-01b9-4483-b95f-7180bb8fabe9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:47.299251 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2a8d61-01b9-4483-b95f-7180bb8fabe9 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:47.328723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 829/1661] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:27:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:27:47.330085 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a8d61-01b9-4483-b95f-7180bb8fabe9 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:47.334584 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573735ea-e6a6-410e-8424-3792985c3d81 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:47.354488 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02297c4-9345-48af-b8f3-4d2b9918c07b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b7213b7111456a93e294ce40b95b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:47.356879 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02297c4-9345-48af-b8f3-4d2b9918c07b service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:47.357165 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02297c4-9345-48af-b8f3-4d2b9918c07b service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:47.357457 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02297c4-9345-48af-b8f3-4d2b9918c07b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:47.360870 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-e02297c4-9345-48af-b8f3-4d2b9918c07b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:47.363160 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a8d61-01b9-4483-b95f-7180bb8fabe9 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:47.368561 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a466c5f5-a30f-4841-867d-8942a21538a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:47.369554 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466c5f5-a30f-4841-867d-8942a21538a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:47.370419 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466c5f5-a30f-4841-867d-8942a21538a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:47.370419 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466c5f5-a30f-4841-867d-8942a21538a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:47.371224 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a466c5f5-a30f-4841-867d-8942a21538a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:47.373073 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a466c5f5-a30f-4841-867d-8942a21538a2 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:47.392239 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02297c4-9345-48af-b8f3-4d2b9918c07b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:47.395622 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02297c4-9345-48af-b8f3-4d2b9918c07b service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:47.420088 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 833/1662] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:27:47 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:27:47.427697 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02297c4-9345-48af-b8f3-4d2b9918c07b service nova] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:47.427901 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 830/1663] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:27:47 2022] POST /identity/v3/projects => generated 379 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:27:47.440738 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02297c4-9345-48af-b8f3-4d2b9918c07b service nova] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:47.528522 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9898cfa-cbfb-4c6e-b2f5-deb5235144d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:47.529501 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9898cfa-cbfb-4c6e-b2f5-deb5235144d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:47.529891 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9898cfa-cbfb-4c6e-b2f5-deb5235144d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:47.530335 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9898cfa-cbfb-4c6e-b2f5-deb5235144d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:47.531166 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9898cfa-cbfb-4c6e-b2f5-deb5235144d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:47.534640 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9898cfa-cbfb-4c6e-b2f5-deb5235144d6 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:47.598668 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:27:47.622064 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a466c5f5-a30f-4841-867d-8942a21538a2 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:47.631077 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 834/1664] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:27:47 2022] POST /identity/v3/users => generated 290 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:27:47.666256 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a466c5f5-a30f-4841-867d-8942a21538a2 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:47.679047 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9898cfa-cbfb-4c6e-b2f5-deb5235144d6 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:47.681778 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b9898cfa-cbfb-4c6e-b2f5-deb5235144d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:47.685144 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21445db0-8ddc-42e7-92d5-21b376684846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:47.685973 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21445db0-8ddc-42e7-92d5-21b376684846 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:47.686412 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21445db0-8ddc-42e7-92d5-21b376684846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:47.686890 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21445db0-8ddc-42e7-92d5-21b376684846 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:47.687819 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21445db0-8ddc-42e7-92d5-21b376684846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:47.693467 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21445db0-8ddc-42e7-92d5-21b376684846 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:47.729783 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9898cfa-cbfb-4c6e-b2f5-deb5235144d6 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:47.732363 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 831/1665] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:27:47.733534 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21445db0-8ddc-42e7-92d5-21b376684846 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:47.741834 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-21445db0-8ddc-42e7-92d5-21b376684846 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:47.751650 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18dd69-6146-48ce-a37c-7874594dfeac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:47.755733 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18dd69-6146-48ce-a37c-7874594dfeac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:47.757166 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18dd69-6146-48ce-a37c-7874594dfeac admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:47.757508 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18dd69-6146-48ce-a37c-7874594dfeac admin admin] PATH_INFO: `/v3/projects/75108528700e46f79827b81316fa27ca` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:47.765303 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c18dd69-6146-48ce-a37c-7874594dfeac admin admin] RBAC: Authorizing `identity:delete_project(project_id=75108528700e46f79827b81316fa27ca)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:47.770227 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21445db0-8ddc-42e7-92d5-21b376684846 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:47.776314 dv-cinder-854268-3-smb devstack@keystone.service[81515]: WARNING py.warnings [None req-2c18dd69-6146-48ce-a37c-7874594dfeac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 22:27:47.776314 dv-cinder-854268-3-smb devstack@keystone.service[81515]: warnings.warn(msg) Aug 29 22:27:47.776314 dv-cinder-854268-3-smb devstack@keystone.service[81515]: Aug 29 22:27:47.781462 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db34ece8-5503-4ee3-874b-44e569ae4e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:47.783198 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34ece8-5503-4ee3-874b-44e569ae4e82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:47.783625 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34ece8-5503-4ee3-874b-44e569ae4e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:47.784341 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34ece8-5503-4ee3-874b-44e569ae4e82 admin admin] PATH_INFO: `/v3/projects/9d1e4ac9849c4605b27126cc3bbe4475` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:47.786383 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c18dd69-6146-48ce-a37c-7874594dfeac admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:47.786868 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db34ece8-5503-4ee3-874b-44e569ae4e82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d1e4ac9849c4605b27126cc3bbe4475)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:47.789155 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db34ece8-5503-4ee3-874b-44e569ae4e82 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:47.902393 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-db34ece8-5503-4ee3-874b-44e569ae4e82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d1e4ac9849c4605b27126cc3bbe4475', 'request_id': 'req-db34ece8-5503-4ee3-874b-44e569ae4e82'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:27:47.921548 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-db34ece8-5503-4ee3-874b-44e569ae4e82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d1e4ac9849c4605b27126cc3bbe4475', 'request_id': 'req-db34ece8-5503-4ee3-874b-44e569ae4e82'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:27:47.939145 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-db34ece8-5503-4ee3-874b-44e569ae4e82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d1e4ac9849c4605b27126cc3bbe4475', 'request_id': 'req-db34ece8-5503-4ee3-874b-44e569ae4e82'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:27:47.955914 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-2c18dd69-6146-48ce-a37c-7874594dfeac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75108528700e46f79827b81316fa27ca', 'request_id': 'req-2c18dd69-6146-48ce-a37c-7874594dfeac'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:27:47.972611 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-db34ece8-5503-4ee3-874b-44e569ae4e82 admin admin] The token cache is being invalidate because project 9d1e4ac9849c4605b27126cc3bbe4475 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:27:47.972934 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-db34ece8-5503-4ee3-874b-44e569ae4e82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:27:47.975569 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-db34ece8-5503-4ee3-874b-44e569ae4e82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:27:47.977634 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 832/1666] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:27:47 2022] DELETE /identity/v3/projects/9d1e4ac9849c4605b27126cc3bbe4475 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:27:47.984254 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db34ece8-5503-4ee3-874b-44e569ae4e82 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:47.990621 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-db34ece8-5503-4ee3-874b-44e569ae4e82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:48.034729 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-2c18dd69-6146-48ce-a37c-7874594dfeac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75108528700e46f79827b81316fa27ca', 'request_id': 'req-2c18dd69-6146-48ce-a37c-7874594dfeac'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:27:48.068293 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-2c18dd69-6146-48ce-a37c-7874594dfeac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75108528700e46f79827b81316fa27ca', 'request_id': 'req-2c18dd69-6146-48ce-a37c-7874594dfeac'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:27:48.110306 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-2c18dd69-6146-48ce-a37c-7874594dfeac admin admin] The token cache is being invalidate because project 75108528700e46f79827b81316fa27ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:27:48.110845 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-2c18dd69-6146-48ce-a37c-7874594dfeac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:27:48.112857 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-2c18dd69-6146-48ce-a37c-7874594dfeac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:27:48.115582 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 835/1667] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:27:47 2022] DELETE /identity/v3/projects/75108528700e46f79827b81316fa27ca => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:27:48.117183 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b00e2-d685-4839-94e4-5f56f7949ff1 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:48.117618 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b00e2-d685-4839-94e4-5f56f7949ff1 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:48.118286 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b00e2-d685-4839-94e4-5f56f7949ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:48.149008 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-d10b00e2-d685-4839-94e4-5f56f7949ff1 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:27:48.151462 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d10b00e2-d685-4839-94e4-5f56f7949ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:48.200388 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db34ece8-5503-4ee3-874b-44e569ae4e82 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:48.242675 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:27:48.379644 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 836/1668] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:27:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:27:48.385372 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cd1f3-0fc9-48b9-bd9e-0d2a7313476e None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:48.385978 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cd1f3-0fc9-48b9-bd9e-0d2a7313476e None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:48.386488 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cd1f3-0fc9-48b9-bd9e-0d2a7313476e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:48.390334 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43fb3b-6bfc-43d3-b41b-076f88f4b808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:48.390985 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43fb3b-6bfc-43d3-b41b-076f88f4b808 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:48.391263 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43fb3b-6bfc-43d3-b41b-076f88f4b808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:48.391631 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43fb3b-6bfc-43d3-b41b-076f88f4b808 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:48.392179 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd43fb3b-6bfc-43d3-b41b-076f88f4b808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:48.394487 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd43fb3b-6bfc-43d3-b41b-076f88f4b808 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:48.433077 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 833/1669] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 448 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:27:48.433077 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37eb0d-b65b-4ede-b5c1-2d754a9f3b27 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:48.433077 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37eb0d-b65b-4ede-b5c1-2d754a9f3b27 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:48.433077 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37eb0d-b65b-4ede-b5c1-2d754a9f3b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:48.447071 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-781cd1f3-0fc9-48b9-bd9e-0d2a7313476e None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:27:48.448381 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-781cd1f3-0fc9-48b9-bd9e-0d2a7313476e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:48.473086 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 837/1670] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:27:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:27:48.473963 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781cd1f3-0fc9-48b9-bd9e-0d2a7313476e None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:48.481010 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-0f37eb0d-b65b-4ede-b5c1-2d754a9f3b27 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:27:48.485124 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-0f37eb0d-b65b-4ede-b5c1-2d754a9f3b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:48.492907 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-781cd1f3-0fc9-48b9-bd9e-0d2a7313476e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:48.508549 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 834/1671] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:27:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:27:48.510016 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9217975-3b1e-4592-8497-24f30a1df1c5 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:48.510394 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9217975-3b1e-4592-8497-24f30a1df1c5 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:48.510903 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9217975-3b1e-4592-8497-24f30a1df1c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:48.524218 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781cd1f3-0fc9-48b9-bd9e-0d2a7313476e None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:48.537287 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-c9217975-3b1e-4592-8497-24f30a1df1c5 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:27:48.538646 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c9217975-3b1e-4592-8497-24f30a1df1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:48.549896 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 835/1672] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:27:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:27:48.551184 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9217975-3b1e-4592-8497-24f30a1df1c5 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:48.553388 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15d380-7bd7-4f3f-ad7b-c575d30e445e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:48.554159 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15d380-7bd7-4f3f-ad7b-c575d30e445e admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:48.554444 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15d380-7bd7-4f3f-ad7b-c575d30e445e admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:48.554726 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15d380-7bd7-4f3f-ad7b-c575d30e445e admin admin] PATH_INFO: `/v3/projects/fbed0cc7bb6349418fac6cb5fcf1b295/users/71ae57b9f0aa48abbe23d43cbcaed8d4/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:48.575306 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9217975-3b1e-4592-8497-24f30a1df1c5 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:48.588837 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c46e8-d85a-49e9-8aa7-a209ebc492c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:48.589624 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c46e8-d85a-49e9-8aa7-a209ebc492c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:48.590124 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c46e8-d85a-49e9-8aa7-a209ebc492c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:48.591801 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c46e8-d85a-49e9-8aa7-a209ebc492c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:48.592026 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef15d380-7bd7-4f3f-ad7b-c575d30e445e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbed0cc7bb6349418fac6cb5fcf1b295, user_id=71ae57b9f0aa48abbe23d43cbcaed8d4, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:48.592928 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c46e8-d85a-49e9-8aa7-a209ebc492c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:27:48.593775 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c46e8-d85a-49e9-8aa7-a209ebc492c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:48.596086 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef15d380-7bd7-4f3f-ad7b-c575d30e445e admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:48.599451 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c46e8-d85a-49e9-8aa7-a209ebc492c0 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:48.630143 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 838/1673] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:27:48 2022] PUT /identity/v3/projects/fbed0cc7bb6349418fac6cb5fcf1b295/users/71ae57b9f0aa48abbe23d43cbcaed8d4/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:27:48.631136 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15d380-7bd7-4f3f-ad7b-c575d30e445e admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:48.651461 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 836/1674] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:27:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:27:48.651461 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d3161-6464-4e23-9ee6-04bc13b4c654 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:48.651461 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d3161-6464-4e23-9ee6-04bc13b4c654 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:48.651461 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d3161-6464-4e23-9ee6-04bc13b4c654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:48.742354 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-6a8d3161-6464-4e23-9ee6-04bc13b4c654 None None] MFA Rules not processed for user `71ae57b9f0aa48abbe23d43cbcaed8d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:27:48.745124 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-6a8d3161-6464-4e23-9ee6-04bc13b4c654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:48.802267 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:27:48.839553 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15d380-7bd7-4f3f-ad7b-c575d30e445e admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:48.844913 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df1337b-53de-43c7-9448-f14550722171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:48.845675 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1337b-53de-43c7-9448-f14550722171 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:48.845968 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1337b-53de-43c7-9448-f14550722171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:48.846232 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1337b-53de-43c7-9448-f14550722171 admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:48.851411 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df1337b-53de-43c7-9448-f14550722171 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:27:48.851799 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df1337b-53de-43c7-9448-f14550722171 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:48.858784 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df1337b-53de-43c7-9448-f14550722171 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:48.888876 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 839/1675] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:27:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:27:48.889838 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df1337b-53de-43c7-9448-f14550722171 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:48.932990 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df1337b-53de-43c7-9448-f14550722171 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:48.946071 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04dc8c4-8208-43b1-b0ad-5156c41bfe93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:48.946828 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04dc8c4-8208-43b1-b0ad-5156c41bfe93 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:48.947122 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04dc8c4-8208-43b1-b0ad-5156c41bfe93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:48.947713 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04dc8c4-8208-43b1-b0ad-5156c41bfe93 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:48.948965 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04dc8c4-8208-43b1-b0ad-5156c41bfe93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:48.951335 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04dc8c4-8208-43b1-b0ad-5156c41bfe93 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:48.988262 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 837/1676] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:27:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:27:48.990149 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35210923-4dbe-4ead-ab01-5d46c04f15cb None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:48.990644 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35210923-4dbe-4ead-ab01-5d46c04f15cb None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:48.991095 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35210923-4dbe-4ead-ab01-5d46c04f15cb None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:48.993366 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 838/1677] 10.222.0.36 () {54 vars in 912 bytes} [Mon Aug 29 22:27:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:27:49.002923 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35210923-4dbe-4ead-ab01-5d46c04f15cb None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:49.023628 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 840/1678] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:27:48 2022] POST /identity/v3/projects => generated 375 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:27:49.023628 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04dc8c4-8208-43b1-b0ad-5156c41bfe93 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:49.039442 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35210923-4dbe-4ead-ab01-5d46c04f15cb None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:49.210167 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04dc8c4-8208-43b1-b0ad-5156c41bfe93 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:49.224398 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf2342-aa67-4667-86a5-492f5a5715b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:49.224398 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf2342-aa67-4667-86a5-492f5a5715b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:49.225039 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf2342-aa67-4667-86a5-492f5a5715b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:49.225440 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b62e6a-3feb-42c9-bfa0-2fd251ccb263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:49.226276 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b62e6a-3feb-42c9-bfa0-2fd251ccb263 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:49.226630 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b62e6a-3feb-42c9-bfa0-2fd251ccb263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:49.226971 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b62e6a-3feb-42c9-bfa0-2fd251ccb263 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:49.227710 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b62e6a-3feb-42c9-bfa0-2fd251ccb263 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:49.229501 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf2342-aa67-4667-86a5-492f5a5715b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:49.230264 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebf2342-aa67-4667-86a5-492f5a5715b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:49.238134 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebf2342-aa67-4667-86a5-492f5a5715b4 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:49.239673 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b62e6a-3feb-42c9-bfa0-2fd251ccb263 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:49.330153 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 841/1679] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:27:49 2022] POST /identity/v3/projects => generated 381 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:27:49.332046 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c22e37-d7a6-438e-9b89-7181ed76c64d None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:49.333787 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c22e37-d7a6-438e-9b89-7181ed76c64d None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:49.334299 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c22e37-d7a6-438e-9b89-7181ed76c64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:49.350033 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 839/1680] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:27:48 2022] POST /identity/v3/projects => generated 369 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:27:49.358176 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf2342-aa67-4667-86a5-492f5a5715b4 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:49.369351 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:27:49.449584 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-02c22e37-d7a6-438e-9b89-7181ed76c64d None None] MFA Rules not processed for user `204c597d751c420796bd972f10a3d149`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:27:49.459126 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-02c22e37-d7a6-438e-9b89-7181ed76c64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:49.598430 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 842/1681] 10.222.0.36 () {58 vars in 1009 bytes} [Mon Aug 29 22:27:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:27:49.599377 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c22e37-d7a6-438e-9b89-7181ed76c64d None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:49.628325 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf2342-aa67-4667-86a5-492f5a5715b4 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:49.645958 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a296ce5-fd30-4c9b-855f-bc403698a890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:49.646955 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a296ce5-fd30-4c9b-855f-bc403698a890 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:49.647427 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a296ce5-fd30-4c9b-855f-bc403698a890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:49.648080 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a296ce5-fd30-4c9b-855f-bc403698a890 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:49.649673 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a296ce5-fd30-4c9b-855f-bc403698a890 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:49.653041 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a296ce5-fd30-4c9b-855f-bc403698a890 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:49.709909 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 840/1682] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:27:49 2022] POST /identity/v3/users => generated 288 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:27:49.710491 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:27:49.713818 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a296ce5-fd30-4c9b-855f-bc403698a890 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:49.745082 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c22e37-d7a6-438e-9b89-7181ed76c64d None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:49.751223 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a867826-756d-473c-8bf5-2b8e175b81b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:49.751903 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a867826-756d-473c-8bf5-2b8e175b81b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:49.755059 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a867826-756d-473c-8bf5-2b8e175b81b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:49.755427 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a867826-756d-473c-8bf5-2b8e175b81b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:49.756177 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a867826-756d-473c-8bf5-2b8e175b81b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:49.758711 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a296ce5-fd30-4c9b-855f-bc403698a890 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:49.759825 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a867826-756d-473c-8bf5-2b8e175b81b7 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:49.770868 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a29a66-c812-4203-b355-90c407e8ddaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:49.771933 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a29a66-c812-4203-b355-90c407e8ddaf admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:49.772839 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a29a66-c812-4203-b355-90c407e8ddaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:49.773363 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a29a66-c812-4203-b355-90c407e8ddaf admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:49.782856 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a29a66-c812-4203-b355-90c407e8ddaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:49.788686 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a29a66-c812-4203-b355-90c407e8ddaf admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:49.805874 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 843/1683] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:27:49 2022] POST /identity/v3/users => generated 297 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:27:49.811138 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2fed3-55b2-47f0-9384-335c5434c14d None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:49.811669 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2fed3-55b2-47f0-9384-335c5434c14d None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:49.812175 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2fed3-55b2-47f0-9384-335c5434c14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:49.842844 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 841/1684] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:27:49 2022] POST /identity/v3/users => generated 285 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:27:49.846219 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a29a66-c812-4203-b355-90c407e8ddaf admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:49.852029 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c6a29a66-c812-4203-b355-90c407e8ddaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:49.890097 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a29a66-c812-4203-b355-90c407e8ddaf admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:49.911629 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e8eca-989b-45eb-ae77-5f90ccb5029c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:49.913093 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e8eca-989b-45eb-ae77-5f90ccb5029c service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:49.913093 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e8eca-989b-45eb-ae77-5f90ccb5029c service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:49.913093 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e8eca-989b-45eb-ae77-5f90ccb5029c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:49.937330 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-f3c2fed3-55b2-47f0-9384-335c5434c14d None None] MFA Rules not processed for user `bef91a59d5a343d886ac09ae35d7c10e`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:27:49.937900 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e8eca-989b-45eb-ae77-5f90ccb5029c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:49.939563 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f3c2fed3-55b2-47f0-9384-335c5434c14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:49.944767 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e8eca-989b-45eb-ae77-5f90ccb5029c service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:49.964420 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 842/1685] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:27:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:27:49.966093 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e8eca-989b-45eb-ae77-5f90ccb5029c service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:50.001376 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e8eca-989b-45eb-ae77-5f90ccb5029c service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:50.019867 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99646d-78f6-43f4-90dd-f44f4a913c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:50.021833 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99646d-78f6-43f4-90dd-f44f4a913c10 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:50.022219 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99646d-78f6-43f4-90dd-f44f4a913c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:50.022708 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99646d-78f6-43f4-90dd-f44f4a913c10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:50.027001 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d99646d-78f6-43f4-90dd-f44f4a913c10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:50.033714 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d99646d-78f6-43f4-90dd-f44f4a913c10 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:50.094995 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 843/1686] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:27:50.094995 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99646d-78f6-43f4-90dd-f44f4a913c10 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:50.113907 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99646d-78f6-43f4-90dd-f44f4a913c10 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:50.131883 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f224d38-4a3c-44af-afb6-6cd2ef25985c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:50.132725 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f224d38-4a3c-44af-afb6-6cd2ef25985c admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:50.133157 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f224d38-4a3c-44af-afb6-6cd2ef25985c admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:50.133727 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f224d38-4a3c-44af-afb6-6cd2ef25985c admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:50.134805 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f224d38-4a3c-44af-afb6-6cd2ef25985c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:50.143703 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f224d38-4a3c-44af-afb6-6cd2ef25985c admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:50.152351 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 844/1687] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:27:49 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:27:50.153339 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2fed3-55b2-47f0-9384-335c5434c14d None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:50.174392 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 844/1688] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:27:50.176046 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f224d38-4a3c-44af-afb6-6cd2ef25985c admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:50.201649 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f224d38-4a3c-44af-afb6-6cd2ef25985c admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:50.205089 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2fed3-55b2-47f0-9384-335c5434c14d None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:50.216439 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d655bfa5-9687-455f-ab59-64c73686fd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:50.217157 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655bfa5-9687-455f-ab59-64c73686fd75 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:50.217440 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655bfa5-9687-455f-ab59-64c73686fd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:50.217722 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655bfa5-9687-455f-ab59-64c73686fd75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:50.219865 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df664138-8539-45f3-b536-cefe38a8a3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:50.221777 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df664138-8539-45f3-b536-cefe38a8a3e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:50.222567 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df664138-8539-45f3-b536-cefe38a8a3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:50.223542 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d655bfa5-9687-455f-ab59-64c73686fd75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:50.223993 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df664138-8539-45f3-b536-cefe38a8a3e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:50.225351 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d655bfa5-9687-455f-ab59-64c73686fd75 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:50.227154 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df664138-8539-45f3-b536-cefe38a8a3e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:50.236833 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df664138-8539-45f3-b536-cefe38a8a3e2 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:50.271666 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 845/1689] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:27:50.273424 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f33631-d48e-445f-ba79-b184dc7bbee8 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:50.273862 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f33631-d48e-445f-ba79-b184dc7bbee8 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:50.274307 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f33631-d48e-445f-ba79-b184dc7bbee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:50.276353 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 845/1690] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:27:50.277439 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df664138-8539-45f3-b536-cefe38a8a3e2 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:50.312441 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-36f33631-d48e-445f-ba79-b184dc7bbee8 None None] MFA Rules not processed for user `bef91a59d5a343d886ac09ae35d7c10e`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:27:50.314024 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-36f33631-d48e-445f-ba79-b184dc7bbee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:50.320741 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df664138-8539-45f3-b536-cefe38a8a3e2 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:50.341814 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97cf3e9-bf7e-45a5-b675-271f2405af1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:50.342677 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cf3e9-bf7e-45a5-b675-271f2405af1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:50.343057 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cf3e9-bf7e-45a5-b675-271f2405af1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:50.343427 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cf3e9-bf7e-45a5-b675-271f2405af1e admin admin] PATH_INFO: `/v3/projects/2865af5f1b834eff8e5551b9c4ce7f69/users/063af6124c6847368e6bfc7e5ed35fdc/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:50.364800 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 846/1691] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:27:50 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:27:50.370330 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f33631-d48e-445f-ba79-b184dc7bbee8 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:50.392109 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97cf3e9-bf7e-45a5-b675-271f2405af1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2865af5f1b834eff8e5551b9c4ce7f69, user_id=063af6124c6847368e6bfc7e5ed35fdc, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:50.395477 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97cf3e9-bf7e-45a5-b675-271f2405af1e admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:50.412900 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f33631-d48e-445f-ba79-b184dc7bbee8 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:50.428364 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d670bc03-7b4e-41c4-b1e5-39f1eac024f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:50.429900 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670bc03-7b4e-41c4-b1e5-39f1eac024f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:50.430193 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670bc03-7b4e-41c4-b1e5-39f1eac024f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:50.430644 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670bc03-7b4e-41c4-b1e5-39f1eac024f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:50.438799 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d670bc03-7b4e-41c4-b1e5-39f1eac024f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:50.442171 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d670bc03-7b4e-41c4-b1e5-39f1eac024f9 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:50.448805 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 846/1692] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:27:50 2022] PUT /identity/v3/projects/2865af5f1b834eff8e5551b9c4ce7f69/users/063af6124c6847368e6bfc7e5ed35fdc/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:27:50.450346 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97cf3e9-bf7e-45a5-b675-271f2405af1e admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:50.477872 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 847/1693] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:27:50.479519 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d670bc03-7b4e-41c4-b1e5-39f1eac024f9 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:50.485210 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d670bc03-7b4e-41c4-b1e5-39f1eac024f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:50.626001 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97cf3e9-bf7e-45a5-b675-271f2405af1e admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:50.639380 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09508e5b-79be-4edc-9fb3-08c3c4b8174d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:50.640025 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09508e5b-79be-4edc-9fb3-08c3c4b8174d admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:50.640412 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09508e5b-79be-4edc-9fb3-08c3c4b8174d admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:50.640832 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09508e5b-79be-4edc-9fb3-08c3c4b8174d admin admin] PATH_INFO: `/v3/projects/4202a87e893d4e2688195047d8b5e1ba/users/28f9ff1a75e646b2980047e54e4d1c12/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:50.667673 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:27:50.682855 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09508e5b-79be-4edc-9fb3-08c3c4b8174d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4202a87e893d4e2688195047d8b5e1ba, user_id=28f9ff1a75e646b2980047e54e4d1c12, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:50.686353 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09508e5b-79be-4edc-9fb3-08c3c4b8174d admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:50.715862 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 847/1694] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:27:50 2022] PUT /identity/v3/projects/4202a87e893d4e2688195047d8b5e1ba/users/28f9ff1a75e646b2980047e54e4d1c12/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:27:50.719128 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09508e5b-79be-4edc-9fb3-08c3c4b8174d admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:50.765779 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d670bc03-7b4e-41c4-b1e5-39f1eac024f9 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:50.913231 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:27:50.925746 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09508e5b-79be-4edc-9fb3-08c3c4b8174d admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:50.932566 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fca346-2d04-4d03-9a5b-47c163d83afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:50.933512 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fca346-2d04-4d03-9a5b-47c163d83afd admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:50.946234 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fca346-2d04-4d03-9a5b-47c163d83afd admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:50.952061 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fca346-2d04-4d03-9a5b-47c163d83afd admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:50.953395 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fca346-2d04-4d03-9a5b-47c163d83afd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:50.958422 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fca346-2d04-4d03-9a5b-47c163d83afd admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:50.974465 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 848/1695] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:27:50.975964 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fca346-2d04-4d03-9a5b-47c163d83afd admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:50.998583 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fca346-2d04-4d03-9a5b-47c163d83afd admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:51.021830 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22941605-300a-47b8-af3e-fd28fb645577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:51.024526 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22941605-300a-47b8-af3e-fd28fb645577 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:51.025429 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22941605-300a-47b8-af3e-fd28fb645577 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:51.025968 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b62a206-24b7-4dbb-acf9-ac6a6b68d6a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b7213b7111456a93e294ce40b95b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:51.026665 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22941605-300a-47b8-af3e-fd28fb645577 admin admin] PATH_INFO: `/v3/projects/9d7c0160808142b7979c18011c3ef809/users/b9d64230f3e5413fbd7a31b6ca53dce3/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:51.026801 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62a206-24b7-4dbb-acf9-ac6a6b68d6a9 service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:51.027139 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62a206-24b7-4dbb-acf9-ac6a6b68d6a9 service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:51.027396 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62a206-24b7-4dbb-acf9-ac6a6b68d6a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:51.054153 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22941605-300a-47b8-af3e-fd28fb645577 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d7c0160808142b7979c18011c3ef809, user_id=b9d64230f3e5413fbd7a31b6ca53dce3, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:51.057845 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22941605-300a-47b8-af3e-fd28fb645577 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:51.111146 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 849/1696] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:27:50 2022] PUT /identity/v3/projects/9d7c0160808142b7979c18011c3ef809/users/b9d64230f3e5413fbd7a31b6ca53dce3/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:27:51.114881 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ceddf-8efd-4d9f-b84b-aeed7d78e028 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:51.115041 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ceddf-8efd-4d9f-b84b-aeed7d78e028 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:51.117465 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ceddf-8efd-4d9f-b84b-aeed7d78e028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:51.231401 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-b10ceddf-8efd-4d9f-b84b-aeed7d78e028 None None] MFA Rules not processed for user `28f9ff1a75e646b2980047e54e4d1c12`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:27:51.235906 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b10ceddf-8efd-4d9f-b84b-aeed7d78e028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:51.262384 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b62a206-24b7-4dbb-acf9-ac6a6b68d6a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:51.273633 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b62a206-24b7-4dbb-acf9-ac6a6b68d6a9 service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:51.341407 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 848/1697] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:27:50 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 863 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:27:51.347201 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b62a206-24b7-4dbb-acf9-ac6a6b68d6a9 service nova] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:51.419287 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b62a206-24b7-4dbb-acf9-ac6a6b68d6a9 service nova] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:51.443309 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 850/1698] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:27:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:27:51.450844 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4680d8-ca3a-4e58-97d4-3aa2d884ac9d None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:51.456131 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4680d8-ca3a-4e58-97d4-3aa2d884ac9d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:51.459217 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4680d8-ca3a-4e58-97d4-3aa2d884ac9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:51.605970 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-df4680d8-ca3a-4e58-97d4-3aa2d884ac9d None None] MFA Rules not processed for user `b9d64230f3e5413fbd7a31b6ca53dce3`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:27:51.609872 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-df4680d8-ca3a-4e58-97d4-3aa2d884ac9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:51.757595 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27ab97e-9cf5-4064-a76b-ce1b0e042fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:51.758915 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ab97e-9cf5-4064-a76b-ce1b0e042fbd admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:51.759463 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ab97e-9cf5-4064-a76b-ce1b0e042fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:51.760038 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ab97e-9cf5-4064-a76b-ce1b0e042fbd admin admin] PATH_INFO: `/v3/projects/2865af5f1b834eff8e5551b9c4ce7f69/users/063af6124c6847368e6bfc7e5ed35fdc/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:51.763151 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27ab97e-9cf5-4064-a76b-ce1b0e042fbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2865af5f1b834eff8e5551b9c4ce7f69, user_id=063af6124c6847368e6bfc7e5ed35fdc, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:51.783341 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27ab97e-9cf5-4064-a76b-ce1b0e042fbd admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:51.826143 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:27:51.867376 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 849/1699] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:27:51 2022] PUT /identity/v3/projects/2865af5f1b834eff8e5551b9c4ce7f69/users/063af6124c6847368e6bfc7e5ed35fdc/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:27:51.867376 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27ab97e-9cf5-4064-a76b-ce1b0e042fbd admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:51.870408 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c27ab97e-9cf5-4064-a76b-ce1b0e042fbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:51.976189 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 851/1700] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:27:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 530 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:27:51.977617 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4680d8-ca3a-4e58-97d4-3aa2d884ac9d None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:51.982607 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-df4680d8-ca3a-4e58-97d4-3aa2d884ac9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:52.051841 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4680d8-ca3a-4e58-97d4-3aa2d884ac9d None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:52.120690 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:27:52.134775 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27ab97e-9cf5-4064-a76b-ce1b0e042fbd admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:52.160531 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a2d4c-b5fd-40cf-93b9-55c7f213ad3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b7213b7111456a93e294ce40b95b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:52.161409 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a2d4c-b5fd-40cf-93b9-55c7f213ad3c service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:52.161516 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a2d4c-b5fd-40cf-93b9-55c7f213ad3c service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:52.161746 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a2d4c-b5fd-40cf-93b9-55c7f213ad3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:52.313285 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce78a92-41bd-4b2e-9814-52187fe0153a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:52.315614 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce78a92-41bd-4b2e-9814-52187fe0153a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:52.315949 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce78a92-41bd-4b2e-9814-52187fe0153a admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:52.316278 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce78a92-41bd-4b2e-9814-52187fe0153a admin admin] PATH_INFO: `/v3/users/b70b5f3634a64b5282e557d0ab40a05e` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:52.317628 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce78a92-41bd-4b2e-9814-52187fe0153a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b70b5f3634a64b5282e557d0ab40a05e)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:52.319637 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce78a92-41bd-4b2e-9814-52187fe0153a admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:52.366756 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163a2d4c-b5fd-40cf-93b9-55c7f213ad3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:52.369835 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163a2d4c-b5fd-40cf-93b9-55c7f213ad3c service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:52.399066 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 850/1701] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:27:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:27:52.401311 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b7f8c-aa33-4d9f-a2f2-d30303b666d4 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:52.401601 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b7f8c-aa33-4d9f-a2f2-d30303b666d4 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:52.402650 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b7f8c-aa33-4d9f-a2f2-d30303b666d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:52.444861 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-5ce78a92-41bd-4b2e-9814-52187fe0153a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b70b5f3634a64b5282e557d0ab40a05e'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:27:52.460165 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-5ce78a92-41bd-4b2e-9814-52187fe0153a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b70b5f3634a64b5282e557d0ab40a05e'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:27:52.478152 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-5ce78a92-41bd-4b2e-9814-52187fe0153a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b70b5f3634a64b5282e557d0ab40a05e'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:27:52.479199 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-5ce78a92-41bd-4b2e-9814-52187fe0153a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b70b5f3634a64b5282e557d0ab40a05e'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:27:52.485871 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-892b7f8c-aa33-4d9f-a2f2-d30303b666d4 None None] MFA Rules not processed for user `063af6124c6847368e6bfc7e5ed35fdc`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:27:52.487309 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-892b7f8c-aa33-4d9f-a2f2-d30303b666d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:52.510078 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-5ce78a92-41bd-4b2e-9814-52187fe0153a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b70b5f3634a64b5282e557d0ab40a05e'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:27:52.524332 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 852/1702] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:27:51 2022] DELETE /identity/v3/users/b70b5f3634a64b5282e557d0ab40a05e => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:27:52.525040 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce78a92-41bd-4b2e-9814-52187fe0153a admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:52.526460 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-5ce78a92-41bd-4b2e-9814-52187fe0153a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:52.672020 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 851/1703] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:27:52 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:27:52.672020 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b7f8c-aa33-4d9f-a2f2-d30303b666d4 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:52.672020 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-892b7f8c-aa33-4d9f-a2f2-d30303b666d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:52.692581 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:27:52.699634 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b7f8c-aa33-4d9f-a2f2-d30303b666d4 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:52.713979 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce78a92-41bd-4b2e-9814-52187fe0153a admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:52.737515 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958908c4-c061-4017-a083-c02c149cbccd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce3d9397cca4ae58e14c8a5ae844f8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:52.742326 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958908c4-c061-4017-a083-c02c149cbccd service placement] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:52.743026 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958908c4-c061-4017-a083-c02c149cbccd service placement] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:52.743498 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958908c4-c061-4017-a083-c02c149cbccd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:52.753742 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-958908c4-c061-4017-a083-c02c149cbccd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:52.801962 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958908c4-c061-4017-a083-c02c149cbccd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:52.803752 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958908c4-c061-4017-a083-c02c149cbccd service placement] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:52.849375 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 853/1704] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:27:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:27:52.851895 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddcae3-58dd-4f58-b906-b7d0411067ab None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:52.853113 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddcae3-58dd-4f58-b906-b7d0411067ab None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:52.854230 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddcae3-58dd-4f58-b906-b7d0411067ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:52.878672 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b4e2d-b106-46a2-9529-360466521152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:52.880094 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b4e2d-b106-46a2-9529-360466521152 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:52.880893 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b4e2d-b106-46a2-9529-360466521152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:52.881924 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b4e2d-b106-46a2-9529-360466521152 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:52.883058 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563b4e2d-b106-46a2-9529-360466521152 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:52.887522 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563b4e2d-b106-46a2-9529-360466521152 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:52.912477 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-3fddcae3-58dd-4f58-b906-b7d0411067ab None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:27:52.914426 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3fddcae3-58dd-4f58-b906-b7d0411067ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:52.926624 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 854/1705] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:27:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:27:52.927956 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fddcae3-58dd-4f58-b906-b7d0411067ab None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:52.937791 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3fddcae3-58dd-4f58-b906-b7d0411067ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:52.968097 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 852/1706] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:27:52 2022] POST /identity/v3/projects => generated 367 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:27:52.970701 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152de6b-c60c-4c8d-8959-f1e63d233889 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:52.971100 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152de6b-c60c-4c8d-8959-f1e63d233889 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:52.971710 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152de6b-c60c-4c8d-8959-f1e63d233889 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:53.013353 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 853/1707] 10.222.0.36 () {54 vars in 912 bytes} [Mon Aug 29 22:27:52 2022] GET /identity => generated 270 bytes in 44 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:27:53.014379 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0152de6b-c60c-4c8d-8959-f1e63d233889 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:53.017562 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-0152de6b-c60c-4c8d-8959-f1e63d233889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:53.067308 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:27:53.151472 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fddcae3-58dd-4f58-b906-b7d0411067ab None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:53.233446 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0152de6b-c60c-4c8d-8959-f1e63d233889 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:53.241849 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fee79f-ba69-4017-b5d7-130eba1aa623 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:53.242771 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fee79f-ba69-4017-b5d7-130eba1aa623 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:53.243198 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fee79f-ba69-4017-b5d7-130eba1aa623 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:53.243739 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fee79f-ba69-4017-b5d7-130eba1aa623 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:53.373254 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be31b1-de15-48cc-bdcc-8b82f209c522 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:53.374793 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be31b1-de15-48cc-bdcc-8b82f209c522 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:53.377090 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be31b1-de15-48cc-bdcc-8b82f209c522 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:53.377765 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be31b1-de15-48cc-bdcc-8b82f209c522 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:53.461922 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fee79f-ba69-4017-b5d7-130eba1aa623 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:53.467684 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fee79f-ba69-4017-b5d7-130eba1aa623 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:53.500992 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 854/1708] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:27:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:27:53.502471 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fee79f-ba69-4017-b5d7-130eba1aa623 service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:53.528917 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fee79f-ba69-4017-b5d7-130eba1aa623 service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:53.541193 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756cb32d-ea5b-48f3-9aa4-c47d0bc9301d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:53.542315 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756cb32d-ea5b-48f3-9aa4-c47d0bc9301d admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:53.542579 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756cb32d-ea5b-48f3-9aa4-c47d0bc9301d admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:53.542851 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756cb32d-ea5b-48f3-9aa4-c47d0bc9301d admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:53.543498 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756cb32d-ea5b-48f3-9aa4-c47d0bc9301d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:53.545620 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756cb32d-ea5b-48f3-9aa4-c47d0bc9301d admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:53.597864 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be31b1-de15-48cc-bdcc-8b82f209c522 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:53.599646 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be31b1-de15-48cc-bdcc-8b82f209c522 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:53.603368 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 855/1709] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:27:53 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:27:53.606229 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df9584-28f5-44e7-8bfb-8112c466c5e2 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:53.606591 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df9584-28f5-44e7-8bfb-8112c466c5e2 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:53.606864 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df9584-28f5-44e7-8bfb-8112c466c5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:53.627545 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 855/1710] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:27:52 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 700 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:27:53.630222 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be31b1-de15-48cc-bdcc-8b82f209c522 service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:53.662045 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be31b1-de15-48cc-bdcc-8b82f209c522 service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:53.672678 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a9989a-d927-4edc-87a4-13aac4437f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:53.673628 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9989a-d927-4edc-87a4-13aac4437f56 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:53.674766 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9989a-d927-4edc-87a4-13aac4437f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:53.675471 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9989a-d927-4edc-87a4-13aac4437f56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:53.677524 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a9989a-d927-4edc-87a4-13aac4437f56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:53.682681 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a9989a-d927-4edc-87a4-13aac4437f56 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:53.693495 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-74df9584-28f5-44e7-8bfb-8112c466c5e2 None None] MFA Rules not processed for user `204c597d751c420796bd972f10a3d149`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:27:53.695096 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-74df9584-28f5-44e7-8bfb-8112c466c5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:53.714339 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 856/1711] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:27:53 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:27:53.715859 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a9989a-d927-4edc-87a4-13aac4437f56 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:53.744421 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 856/1712] 10.222.0.36 () {58 vars in 1009 bytes} [Mon Aug 29 22:27:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:27:53.755912 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a9989a-d927-4edc-87a4-13aac4437f56 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:53.764710 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df9584-28f5-44e7-8bfb-8112c466c5e2 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:53.781791 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df9584-28f5-44e7-8bfb-8112c466c5e2 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:53.781928 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63273628-4e96-4cc0-bac6-116f031f4d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:53.784878 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63273628-4e96-4cc0-bac6-116f031f4d62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:53.785173 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63273628-4e96-4cc0-bac6-116f031f4d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:53.799962 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63273628-4e96-4cc0-bac6-116f031f4d62 admin admin] PATH_INFO: `/v3/projects/b6097a0798ca46a18721a4b85d0a0a06/users/16ec3406976747d794435f1f19edb4d4/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:53.801176 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df2338-4160-43bc-a597-cca712c8b1bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:53.801176 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df2338-4160-43bc-a597-cca712c8b1bc service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:53.802017 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df2338-4160-43bc-a597-cca712c8b1bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:53.803967 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df2338-4160-43bc-a597-cca712c8b1bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:53.842218 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29df2338-4160-43bc-a597-cca712c8b1bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:53.843803 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29df2338-4160-43bc-a597-cca712c8b1bc service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:53.878208 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63273628-4e96-4cc0-bac6-116f031f4d62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6097a0798ca46a18721a4b85d0a0a06, user_id=16ec3406976747d794435f1f19edb4d4, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:53.884850 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63273628-4e96-4cc0-bac6-116f031f4d62 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:53.885308 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 857/1713] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:27:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:27:53.886300 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df2338-4160-43bc-a597-cca712c8b1bc service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:53.929325 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df2338-4160-43bc-a597-cca712c8b1bc service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:53.939888 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 857/1714] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:27:53 2022] PUT /identity/v3/projects/b6097a0798ca46a18721a4b85d0a0a06/users/16ec3406976747d794435f1f19edb4d4/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:27:53.947019 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63273628-4e96-4cc0-bac6-116f031f4d62 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:53.976705 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:27:54.096178 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c16a38d-eb59-41f3-b8b3-0c13b5107b93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:54.097155 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16a38d-eb59-41f3-b8b3-0c13b5107b93 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:54.097433 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16a38d-eb59-41f3-b8b3-0c13b5107b93 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:54.108554 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16a38d-eb59-41f3-b8b3-0c13b5107b93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:54.108691 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63273628-4e96-4cc0-bac6-116f031f4d62 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:54.112421 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9815979a-ccc0-420d-b18b-e0a93aca5d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:54.113498 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9815979a-ccc0-420d-b18b-e0a93aca5d26 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:54.113880 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9815979a-ccc0-420d-b18b-e0a93aca5d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:54.114225 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-6c16a38d-eb59-41f3-b8b3-0c13b5107b93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:54.114364 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9815979a-ccc0-420d-b18b-e0a93aca5d26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:54.115228 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9815979a-ccc0-420d-b18b-e0a93aca5d26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:54.117266 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9815979a-ccc0-420d-b18b-e0a93aca5d26 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:54.150682 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 858/1715] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:27:53 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:27:54.151254 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5794e13-336e-413a-94b4-f12d23a5c6ca None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:54.152589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5794e13-336e-413a-94b4-f12d23a5c6ca None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:54.153939 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5794e13-336e-413a-94b4-f12d23a5c6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:54.242523 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-e5794e13-336e-413a-94b4-f12d23a5c6ca None None] MFA Rules not processed for user `41eeb2403f4748b7931680835e47f113`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:27:54.246658 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e5794e13-336e-413a-94b4-f12d23a5c6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:54.318310 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:27:54.369285 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c16a38d-eb59-41f3-b8b3-0c13b5107b93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:54.375299 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c16a38d-eb59-41f3-b8b3-0c13b5107b93 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:54.409590 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 859/1716] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:27:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:27:54.410845 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5794e13-336e-413a-94b4-f12d23a5c6ca None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:54.415682 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 858/1717] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:27:53 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:27:54.417490 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c16a38d-eb59-41f3-b8b3-0c13b5107b93 service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:54.419449 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-6c16a38d-eb59-41f3-b8b3-0c13b5107b93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:54.450312 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5794e13-336e-413a-94b4-f12d23a5c6ca None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:54.463586 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d091c75-e49b-429a-abcb-61ab69aed9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:54.464476 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d091c75-e49b-429a-abcb-61ab69aed9fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:54.464910 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d091c75-e49b-429a-abcb-61ab69aed9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:54.465282 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d091c75-e49b-429a-abcb-61ab69aed9fd admin admin] PATH_INFO: `/v3/projects/b6097a0798ca46a18721a4b85d0a0a06/users/16ec3406976747d794435f1f19edb4d4/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:54.471739 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d091c75-e49b-429a-abcb-61ab69aed9fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6097a0798ca46a18721a4b85d0a0a06, user_id=16ec3406976747d794435f1f19edb4d4, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:54.478438 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c16a38d-eb59-41f3-b8b3-0c13b5107b93 service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:54.479458 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d091c75-e49b-429a-abcb-61ab69aed9fd admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:54.495170 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568cbb09-82da-40bf-ba58-5e02dca42472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:54.496574 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568cbb09-82da-40bf-ba58-5e02dca42472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:54.497004 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568cbb09-82da-40bf-ba58-5e02dca42472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:54.500470 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568cbb09-82da-40bf-ba58-5e02dca42472 admin admin] PATH_INFO: `/v3/users/28f9ff1a75e646b2980047e54e4d1c12` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:54.507108 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568cbb09-82da-40bf-ba58-5e02dca42472 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28f9ff1a75e646b2980047e54e4d1c12)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:54.515893 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 860/1718] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:27:54 2022] PUT /identity/v3/projects/b6097a0798ca46a18721a4b85d0a0a06/users/16ec3406976747d794435f1f19edb4d4/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:27:54.515893 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d091c75-e49b-429a-abcb-61ab69aed9fd admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:54.515893 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-6d091c75-e49b-429a-abcb-61ab69aed9fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:54.517667 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568cbb09-82da-40bf-ba58-5e02dca42472 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:54.721145 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-568cbb09-82da-40bf-ba58-5e02dca42472 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28f9ff1a75e646b2980047e54e4d1c12'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:27:54.752485 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-568cbb09-82da-40bf-ba58-5e02dca42472 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28f9ff1a75e646b2980047e54e4d1c12'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:27:54.757528 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-568cbb09-82da-40bf-ba58-5e02dca42472 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28f9ff1a75e646b2980047e54e4d1c12'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:27:54.775202 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-568cbb09-82da-40bf-ba58-5e02dca42472 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28f9ff1a75e646b2980047e54e4d1c12'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:27:54.776919 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-568cbb09-82da-40bf-ba58-5e02dca42472 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28f9ff1a75e646b2980047e54e4d1c12'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:27:54.795483 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d091c75-e49b-429a-abcb-61ab69aed9fd admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:54.816815 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4132895e-da99-4ed5-810e-c28b1973c34a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b7213b7111456a93e294ce40b95b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:54.820319 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132895e-da99-4ed5-810e-c28b1973c34a service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:54.820659 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132895e-da99-4ed5-810e-c28b1973c34a service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:54.820953 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132895e-da99-4ed5-810e-c28b1973c34a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:54.827617 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 859/1719] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:27:54 2022] DELETE /identity/v3/users/28f9ff1a75e646b2980047e54e4d1c12 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:27:54.830110 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59e3d7-28fb-427a-9fdb-a034d5785797 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:54.830275 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59e3d7-28fb-427a-9fdb-a034d5785797 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:54.831103 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59e3d7-28fb-427a-9fdb-a034d5785797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:54.832022 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-4132895e-da99-4ed5-810e-c28b1973c34a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:54.874343 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-ef59e3d7-28fb-427a-9fdb-a034d5785797 None None] MFA Rules not processed for user `16ec3406976747d794435f1f19edb4d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:27:54.875586 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ef59e3d7-28fb-427a-9fdb-a034d5785797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:54.896527 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:27:55.025805 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 860/1720] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:27:54 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:27:55.027590 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59e3d7-28fb-427a-9fdb-a034d5785797 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:55.047132 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ef59e3d7-28fb-427a-9fdb-a034d5785797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:55.050691 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4132895e-da99-4ed5-810e-c28b1973c34a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:55.055013 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4132895e-da99-4ed5-810e-c28b1973c34a service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:55.111234 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 861/1721] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:27:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 603 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:27:55.112614 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca66cc-753f-4be9-abbd-ef6c5396b858 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:55.112900 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca66cc-753f-4be9-abbd-ef6c5396b858 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:55.113172 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca66cc-753f-4be9-abbd-ef6c5396b858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:55.200863 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:27:55.201100 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-d2ca66cc-753f-4be9-abbd-ef6c5396b858 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:27:55.202110 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-d2ca66cc-753f-4be9-abbd-ef6c5396b858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:55.311004 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59e3d7-28fb-427a-9fdb-a034d5785797 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:55.342276 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c60b2d-49a7-4931-8f03-a586c5fc4a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:55.348185 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c60b2d-49a7-4931-8f03-a586c5fc4a37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:55.348735 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c60b2d-49a7-4931-8f03-a586c5fc4a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:55.349304 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c60b2d-49a7-4931-8f03-a586c5fc4a37 admin admin] PATH_INFO: `/v3/projects/f0a13a6f2bf74a91a25fbad35ab9a42d` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:55.351481 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c60b2d-49a7-4931-8f03-a586c5fc4a37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0a13a6f2bf74a91a25fbad35ab9a42d)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:55.362877 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c60b2d-49a7-4931-8f03-a586c5fc4a37 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:55.457830 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 862/1722] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:27:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:27:55.459933 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca66cc-753f-4be9-abbd-ef6c5396b858 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:55.463189 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-d2ca66cc-753f-4be9-abbd-ef6c5396b858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:55.605209 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-26c60b2d-49a7-4931-8f03-a586c5fc4a37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0a13a6f2bf74a91a25fbad35ab9a42d', 'request_id': 'req-26c60b2d-49a7-4931-8f03-a586c5fc4a37'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:27:55.621136 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-26c60b2d-49a7-4931-8f03-a586c5fc4a37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0a13a6f2bf74a91a25fbad35ab9a42d', 'request_id': 'req-26c60b2d-49a7-4931-8f03-a586c5fc4a37'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:27:55.634085 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-26c60b2d-49a7-4931-8f03-a586c5fc4a37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0a13a6f2bf74a91a25fbad35ab9a42d', 'request_id': 'req-26c60b2d-49a7-4931-8f03-a586c5fc4a37'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:27:55.664000 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-26c60b2d-49a7-4931-8f03-a586c5fc4a37 admin admin] The token cache is being invalidate because project f0a13a6f2bf74a91a25fbad35ab9a42d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:27:55.664293 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-26c60b2d-49a7-4931-8f03-a586c5fc4a37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:27:55.665383 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-26c60b2d-49a7-4931-8f03-a586c5fc4a37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:27:55.677535 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca66cc-753f-4be9-abbd-ef6c5396b858 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:55.677979 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 861/1723] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:27:55 2022] DELETE /identity/v3/projects/f0a13a6f2bf74a91a25fbad35ab9a42d => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:27:55.681480 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e069b-b030-4326-8346-fc40d2e0df71 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:55.684475 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e069b-b030-4326-8346-fc40d2e0df71 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:55.684979 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e069b-b030-4326-8346-fc40d2e0df71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:55.737813 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-b30e069b-b030-4326-8346-fc40d2e0df71 None None] MFA Rules not processed for user `bef91a59d5a343d886ac09ae35d7c10e`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:27:55.740401 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b30e069b-b030-4326-8346-fc40d2e0df71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:55.857526 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a731d-2994-4ddb-adc2-b6a64f387e22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:55.863576 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a731d-2994-4ddb-adc2-b6a64f387e22 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:55.864668 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a731d-2994-4ddb-adc2-b6a64f387e22 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:55.865803 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a731d-2994-4ddb-adc2-b6a64f387e22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:55.871092 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-ca0a731d-2994-4ddb-adc2-b6a64f387e22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:55.936528 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 862/1724] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:27:55 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:27:55.952240 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30e069b-b030-4326-8346-fc40d2e0df71 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:55.961829 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b30e069b-b030-4326-8346-fc40d2e0df71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:56.016428 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:27:56.155201 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0a731d-2994-4ddb-adc2-b6a64f387e22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:56.156402 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0a731d-2994-4ddb-adc2-b6a64f387e22 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:56.210292 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 863/1725] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:27:55 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 752 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:27:56.211820 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc12bb-3b4c-4ec2-b3f6-0ef26a2682e2 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:56.212106 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc12bb-3b4c-4ec2-b3f6-0ef26a2682e2 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:56.212381 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc12bb-3b4c-4ec2-b3f6-0ef26a2682e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:56.243842 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30e069b-b030-4326-8346-fc40d2e0df71 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:56.262154 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e204c2-3075-49b6-9e8c-5d0753e16507 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:56.263508 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e204c2-3075-49b6-9e8c-5d0753e16507 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:56.263789 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e204c2-3075-49b6-9e8c-5d0753e16507 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:56.264083 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e204c2-3075-49b6-9e8c-5d0753e16507 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:56.279548 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-07e204c2-3075-49b6-9e8c-5d0753e16507 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:56.346676 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-0fdc12bb-3b4c-4ec2-b3f6-0ef26a2682e2 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:27:56.347914 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-0fdc12bb-3b4c-4ec2-b3f6-0ef26a2682e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:56.389576 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:27:56.550530 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e204c2-3075-49b6-9e8c-5d0753e16507 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:56.552252 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e204c2-3075-49b6-9e8c-5d0753e16507 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:56.571311 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 863/1726] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:27:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 634 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:27:56.591202 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 864/1727] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:27:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:27:56.607573 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf41e9-fbe9-4246-a579-b6c799b70cf6 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:56.607573 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf41e9-fbe9-4246-a579-b6c799b70cf6 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:56.607573 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf41e9-fbe9-4246-a579-b6c799b70cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:56.674032 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-c1cf41e9-fbe9-4246-a579-b6c799b70cf6 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:27:56.675366 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c1cf41e9-fbe9-4246-a579-b6c799b70cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:56.703570 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 864/1728] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:27:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:27:56.707176 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdc12bb-3b4c-4ec2-b3f6-0ef26a2682e2 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:56.719272 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdc12bb-3b4c-4ec2-b3f6-0ef26a2682e2 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:56.743628 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0cef6c-21ff-4ec0-9797-18d15cab357c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:56.744268 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0cef6c-21ff-4ec0-9797-18d15cab357c admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:56.744620 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0cef6c-21ff-4ec0-9797-18d15cab357c admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:56.744891 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0cef6c-21ff-4ec0-9797-18d15cab357c admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:56.745553 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0cef6c-21ff-4ec0-9797-18d15cab357c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:27:56.745855 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0cef6c-21ff-4ec0-9797-18d15cab357c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:56.747486 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0cef6c-21ff-4ec0-9797-18d15cab357c admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:56.811164 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf41e9-fbe9-4246-a579-b6c799b70cf6 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:56.821489 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf41e9-fbe9-4246-a579-b6c799b70cf6 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:56.823530 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 865/1729] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:27:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:27:56.841246 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c164dd-c5bf-4e06-9ae8-c9fcb4a940ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:56.841889 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c164dd-c5bf-4e06-9ae8-c9fcb4a940ee admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:56.842166 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c164dd-c5bf-4e06-9ae8-c9fcb4a940ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:56.842463 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c164dd-c5bf-4e06-9ae8-c9fcb4a940ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:56.843078 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c164dd-c5bf-4e06-9ae8-c9fcb4a940ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:56.845100 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c164dd-c5bf-4e06-9ae8-c9fcb4a940ee admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:56.963619 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 865/1730] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:27:56 2022] POST /identity/v3/projects => generated 403 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:27:56.968582 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0cef6c-21ff-4ec0-9797-18d15cab357c admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:56.982170 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0cef6c-21ff-4ec0-9797-18d15cab357c admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:57.192311 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec30a09b-f5a8-485b-9398-852de5df4583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:57.192587 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30a09b-f5a8-485b-9398-852de5df4583 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:57.192820 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30a09b-f5a8-485b-9398-852de5df4583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:57.193097 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30a09b-f5a8-485b-9398-852de5df4583 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:57.205123 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec30a09b-f5a8-485b-9398-852de5df4583 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:57.220430 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec30a09b-f5a8-485b-9398-852de5df4583 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:57.324575 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c164dd-c5bf-4e06-9ae8-c9fcb4a940ee admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:57.341284 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 866/1731] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:27:56 2022] POST /identity/v3/users => generated 302 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:27:57.348722 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c164dd-c5bf-4e06-9ae8-c9fcb4a940ee admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:57.360993 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea160de0-c80b-402f-8207-a9582210297c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:57.364122 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea160de0-c80b-402f-8207-a9582210297c admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:57.366000 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea160de0-c80b-402f-8207-a9582210297c admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:57.366211 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea160de0-c80b-402f-8207-a9582210297c admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:57.371259 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea160de0-c80b-402f-8207-a9582210297c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:57.375039 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea160de0-c80b-402f-8207-a9582210297c admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:57.413915 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec30a09b-f5a8-485b-9398-852de5df4583 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:57.424905 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 866/1732] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:27:57 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:27:57.425488 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec30a09b-f5a8-485b-9398-852de5df4583 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:57.466830 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d498c6b3-0817-4e49-a727-1f6b1928c9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:57.467470 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498c6b3-0817-4e49-a727-1f6b1928c9b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:57.467751 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498c6b3-0817-4e49-a727-1f6b1928c9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:57.468025 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498c6b3-0817-4e49-a727-1f6b1928c9b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:57.469433 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d498c6b3-0817-4e49-a727-1f6b1928c9b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:57.471085 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d498c6b3-0817-4e49-a727-1f6b1928c9b6 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:57.517753 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 867/1733] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:27:57 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:27:57.522470 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea160de0-c80b-402f-8207-a9582210297c admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:57.558934 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea160de0-c80b-402f-8207-a9582210297c admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:57.577715 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c6d76-3f5a-48b2-9207-74a5075ed3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:57.578531 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c6d76-3f5a-48b2-9207-74a5075ed3ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:57.578812 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c6d76-3f5a-48b2-9207-74a5075ed3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:57.579084 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c6d76-3f5a-48b2-9207-74a5075ed3ec admin admin] PATH_INFO: `/v3/projects/5a8593cb30f546b08abcdcfb00d2dbf3/users/52ceb68d67dd47a3ac2abc533744e3ba/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:57.589446 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65df526-afce-44e2-86d6-fc2f1b402f5d None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:57.589746 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65df526-afce-44e2-86d6-fc2f1b402f5d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:57.590014 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65df526-afce-44e2-86d6-fc2f1b402f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:57.661804 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66c6d76-3f5a-48b2-9207-74a5075ed3ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a8593cb30f546b08abcdcfb00d2dbf3, user_id=52ceb68d67dd47a3ac2abc533744e3ba, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:57.669307 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66c6d76-3f5a-48b2-9207-74a5075ed3ec admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:57.703079 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 867/1734] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:27:57 2022] PUT /identity/v3/projects/5a8593cb30f546b08abcdcfb00d2dbf3/users/52ceb68d67dd47a3ac2abc533744e3ba/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:27:57.711436 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff30ceb-e7f7-4d81-abc7-a09262713bed None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:57.712417 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff30ceb-e7f7-4d81-abc7-a09262713bed None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:57.713684 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff30ceb-e7f7-4d81-abc7-a09262713bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:57.788406 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-8ff30ceb-e7f7-4d81-abc7-a09262713bed None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:27:57.792731 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-8ff30ceb-e7f7-4d81-abc7-a09262713bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:57.817103 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-f65df526-afce-44e2-86d6-fc2f1b402f5d None None] MFA Rules not processed for user `b32922d090564162810dd8b28c3a322b`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:27:57.818345 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f65df526-afce-44e2-86d6-fc2f1b402f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:57.832835 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:27:58.025352 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 868/1735] 10.222.0.36 () {58 vars in 1009 bytes} [Mon Aug 29 22:27:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 437 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:27:58.053612 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 868/1736] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:27:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:27:58.163942 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65df526-afce-44e2-86d6-fc2f1b402f5d None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:58.309798 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff30ceb-e7f7-4d81-abc7-a09262713bed None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:27:58.311557 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-8ff30ceb-e7f7-4d81-abc7-a09262713bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:27:58.364391 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65df526-afce-44e2-86d6-fc2f1b402f5d None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:58.376250 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf284b23-e62a-4206-94cb-4a85e68b65e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:58.377907 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf284b23-e62a-4206-94cb-4a85e68b65e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:58.378372 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf284b23-e62a-4206-94cb-4a85e68b65e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:58.378646 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf284b23-e62a-4206-94cb-4a85e68b65e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:58.398188 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf284b23-e62a-4206-94cb-4a85e68b65e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:58.399968 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf284b23-e62a-4206-94cb-4a85e68b65e9 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:58.462791 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 869/1737] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:27:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:27:58.496863 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:27:58.596698 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff30ceb-e7f7-4d81-abc7-a09262713bed None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:27:58.618002 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe15fd-7406-4506-b9cb-751c8c8d7135 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3472d8ffa748d8828c6a2d89ee7ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:27:58.621818 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe15fd-7406-4506-b9cb-751c8c8d7135 service swift] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:27:58.623318 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe15fd-7406-4506-b9cb-751c8c8d7135 service swift] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:27:58.623747 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe15fd-7406-4506-b9cb-751c8c8d7135 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:27:58.654070 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe15fd-7406-4506-b9cb-751c8c8d7135 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:27:58.656767 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe15fd-7406-4506-b9cb-751c8c8d7135 service swift] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:27:58.707316 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 869/1738] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Aug 29 22:27:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 22:28:00.459243 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf284b23-e62a-4206-94cb-4a85e68b65e9 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:00.462622 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-bf284b23-e62a-4206-94cb-4a85e68b65e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:00.549038 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf284b23-e62a-4206-94cb-4a85e68b65e9 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:00.573788 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c57de-44ff-41f5-88a5-9443286ec533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:00.576910 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c57de-44ff-41f5-88a5-9443286ec533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:00.577203 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c57de-44ff-41f5-88a5-9443286ec533 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:00.581775 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c57de-44ff-41f5-88a5-9443286ec533 admin admin] PATH_INFO: `/v3/projects/4202a87e893d4e2688195047d8b5e1ba` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:00.591660 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0c57de-44ff-41f5-88a5-9443286ec533 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4202a87e893d4e2688195047d8b5e1ba)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:00.611951 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0c57de-44ff-41f5-88a5-9443286ec533 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:00.824398 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ea0c57de-44ff-41f5-88a5-9443286ec533 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4202a87e893d4e2688195047d8b5e1ba', 'request_id': 'req-ea0c57de-44ff-41f5-88a5-9443286ec533'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:00.853838 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ea0c57de-44ff-41f5-88a5-9443286ec533 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4202a87e893d4e2688195047d8b5e1ba', 'request_id': 'req-ea0c57de-44ff-41f5-88a5-9443286ec533'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:00.885775 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ea0c57de-44ff-41f5-88a5-9443286ec533 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4202a87e893d4e2688195047d8b5e1ba', 'request_id': 'req-ea0c57de-44ff-41f5-88a5-9443286ec533'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:00.937364 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ea0c57de-44ff-41f5-88a5-9443286ec533 admin admin] The token cache is being invalidate because project 4202a87e893d4e2688195047d8b5e1ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:28:00.938616 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ea0c57de-44ff-41f5-88a5-9443286ec533 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:00.939568 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ea0c57de-44ff-41f5-88a5-9443286ec533 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:00.945426 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 870/1739] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:28:00 2022] DELETE /identity/v3/projects/4202a87e893d4e2688195047d8b5e1ba => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:00.951099 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036f069-adae-4e06-9c85-5265d3ccb01b None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:00.952084 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036f069-adae-4e06-9c85-5265d3ccb01b None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:00.952542 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036f069-adae-4e06-9c85-5265d3ccb01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:01.037133 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-f036f069-adae-4e06-9c85-5265d3ccb01b None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:01.040063 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f036f069-adae-4e06-9c85-5265d3ccb01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:01.333005 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 870/1740] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:01.342928 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80072b53-fec4-4971-8fef-6b36be417af7 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:01.343527 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80072b53-fec4-4971-8fef-6b36be417af7 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:01.343987 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80072b53-fec4-4971-8fef-6b36be417af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:01.380919 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-80072b53-fec4-4971-8fef-6b36be417af7 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:01.384631 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-80072b53-fec4-4971-8fef-6b36be417af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:01.399432 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 871/1741] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:01.404031 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f036f069-adae-4e06-9c85-5265d3ccb01b None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:01.416507 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f036f069-adae-4e06-9c85-5265d3ccb01b None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:01.424537 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb394c74-aa86-4b80-810d-c45146b2511c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:01.425487 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb394c74-aa86-4b80-810d-c45146b2511c admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:01.425875 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb394c74-aa86-4b80-810d-c45146b2511c admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:01.426912 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb394c74-aa86-4b80-810d-c45146b2511c admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:01.427853 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb394c74-aa86-4b80-810d-c45146b2511c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:28:01.428294 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb394c74-aa86-4b80-810d-c45146b2511c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:01.431999 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb394c74-aa86-4b80-810d-c45146b2511c admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:01.505378 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80072b53-fec4-4971-8fef-6b36be417af7 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:01.507133 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 871/1742] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:28:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:28:01.529385 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80072b53-fec4-4971-8fef-6b36be417af7 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:01.540288 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d8b6ff-1941-4cf6-a0a9-208535014e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:01.541127 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8b6ff-1941-4cf6-a0a9-208535014e3f admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:01.541427 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8b6ff-1941-4cf6-a0a9-208535014e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:01.541942 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8b6ff-1941-4cf6-a0a9-208535014e3f admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:01.542762 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d8b6ff-1941-4cf6-a0a9-208535014e3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:01.555834 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d8b6ff-1941-4cf6-a0a9-208535014e3f admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:01.652603 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb394c74-aa86-4b80-810d-c45146b2511c admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:01.665743 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 872/1743] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:28:01 2022] POST /identity/v3/projects => generated 365 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:01.678498 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb394c74-aa86-4b80-810d-c45146b2511c admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:01.814993 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d8b6ff-1941-4cf6-a0a9-208535014e3f admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:01.819547 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-16d8b6ff-1941-4cf6-a0a9-208535014e3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:01.828423 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:01.934592 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2005a44-4369-4a68-9d55-cafd9c2c97fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:01.936469 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2005a44-4369-4a68-9d55-cafd9c2c97fc admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:01.938180 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2005a44-4369-4a68-9d55-cafd9c2c97fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:01.938497 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2005a44-4369-4a68-9d55-cafd9c2c97fc admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:01.939204 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2005a44-4369-4a68-9d55-cafd9c2c97fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:01.948014 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2005a44-4369-4a68-9d55-cafd9c2c97fc admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:02.002930 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 872/1744] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:28:01 2022] POST /identity/v3/users => generated 283 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:02.008231 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2005a44-4369-4a68-9d55-cafd9c2c97fc admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:02.053361 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2005a44-4369-4a68-9d55-cafd9c2c97fc admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:02.056089 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d8b6ff-1941-4cf6-a0a9-208535014e3f admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:02.075391 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c33ce-5e96-4ea9-b4fd-f035509c5a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:02.077964 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebbe5e9-f1ed-49c2-ae8e-3c3b1a01f121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:02.082076 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c33ce-5e96-4ea9-b4fd-f035509c5a84 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:02.088752 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebbe5e9-f1ed-49c2-ae8e-3c3b1a01f121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:02.088862 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c33ce-5e96-4ea9-b4fd-f035509c5a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:02.088862 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c33ce-5e96-4ea9-b4fd-f035509c5a84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:02.089038 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebbe5e9-f1ed-49c2-ae8e-3c3b1a01f121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:02.089131 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c33ce-5e96-4ea9-b4fd-f035509c5a84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:02.089219 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebbe5e9-f1ed-49c2-ae8e-3c3b1a01f121 admin admin] PATH_INFO: `/v3/users/b9d64230f3e5413fbd7a31b6ca53dce3` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:02.093303 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c33ce-5e96-4ea9-b4fd-f035509c5a84 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:02.095635 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebbe5e9-f1ed-49c2-ae8e-3c3b1a01f121 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9d64230f3e5413fbd7a31b6ca53dce3)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:02.099724 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebbe5e9-f1ed-49c2-ae8e-3c3b1a01f121 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:02.132177 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 873/1745] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:28:02.141171 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d9a6a-0ee1-4673-b5f0-6731dcfb3e25 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:02.143850 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d9a6a-0ee1-4673-b5f0-6731dcfb3e25 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:02.145729 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d9a6a-0ee1-4673-b5f0-6731dcfb3e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:02.238532 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-724d9a6a-0ee1-4673-b5f0-6731dcfb3e25 None None] MFA Rules not processed for user `204c597d751c420796bd972f10a3d149`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:02.243788 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-724d9a6a-0ee1-4673-b5f0-6731dcfb3e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:02.302952 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-4ebbe5e9-f1ed-49c2-ae8e-3c3b1a01f121 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9d64230f3e5413fbd7a31b6ca53dce3'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:02.332571 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-4ebbe5e9-f1ed-49c2-ae8e-3c3b1a01f121 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9d64230f3e5413fbd7a31b6ca53dce3'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:02.384571 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-4ebbe5e9-f1ed-49c2-ae8e-3c3b1a01f121 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9d64230f3e5413fbd7a31b6ca53dce3'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:02.385743 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-4ebbe5e9-f1ed-49c2-ae8e-3c3b1a01f121 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9d64230f3e5413fbd7a31b6ca53dce3'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:02.416738 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:02.431272 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-4ebbe5e9-f1ed-49c2-ae8e-3c3b1a01f121 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9d64230f3e5413fbd7a31b6ca53dce3'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:02.445475 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 873/1746] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:28:01 2022] DELETE /identity/v3/users/b9d64230f3e5413fbd7a31b6ca53dce3 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:28:02.448131 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebbe5e9-f1ed-49c2-ae8e-3c3b1a01f121 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:02.451573 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-4ebbe5e9-f1ed-49c2-ae8e-3c3b1a01f121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:02.538660 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 874/1747] 10.222.0.48 () {58 vars in 1015 bytes} [Mon Aug 29 22:28:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:02.543651 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59674118-d1c0-47de-a091-d97d07bd4480 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:02.545351 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59674118-d1c0-47de-a091-d97d07bd4480 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:02.546078 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59674118-d1c0-47de-a091-d97d07bd4480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:02.585551 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-59674118-d1c0-47de-a091-d97d07bd4480 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:02.588569 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-59674118-d1c0-47de-a091-d97d07bd4480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:02.739168 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 875/1748] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:02.739847 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59674118-d1c0-47de-a091-d97d07bd4480 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:02.749383 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-59674118-d1c0-47de-a091-d97d07bd4480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:02.798032 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebbe5e9-f1ed-49c2-ae8e-3c3b1a01f121 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:02.813207 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d8ccd-dbb5-47dd-b38b-2a008b45db2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:02.814456 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d8ccd-dbb5-47dd-b38b-2a008b45db2b admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:02.818206 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d8ccd-dbb5-47dd-b38b-2a008b45db2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:02.819425 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d8ccd-dbb5-47dd-b38b-2a008b45db2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:02.820824 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9d8ccd-dbb5-47dd-b38b-2a008b45db2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:02.826096 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9d8ccd-dbb5-47dd-b38b-2a008b45db2b admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:02.855253 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 874/1749] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:02.859480 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d8ccd-dbb5-47dd-b38b-2a008b45db2b admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:02.866243 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-fb9d8ccd-dbb5-47dd-b38b-2a008b45db2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:03.008308 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:03.027279 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59674118-d1c0-47de-a091-d97d07bd4480 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:03.045839 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ad6a0-4287-40a3-bdf3-de81b0ac370c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:03.056867 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ad6a0-4287-40a3-bdf3-de81b0ac370c service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:03.057234 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ad6a0-4287-40a3-bdf3-de81b0ac370c service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:03.057666 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ad6a0-4287-40a3-bdf3-de81b0ac370c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:03.092400 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ad6a0-4287-40a3-bdf3-de81b0ac370c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:03.098908 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ad6a0-4287-40a3-bdf3-de81b0ac370c service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:03.123667 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d8ccd-dbb5-47dd-b38b-2a008b45db2b admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:03.135636 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398db4c7-4f59-439f-8570-1498792ee0c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:03.136683 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398db4c7-4f59-439f-8570-1498792ee0c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:03.137193 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398db4c7-4f59-439f-8570-1498792ee0c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:03.137937 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398db4c7-4f59-439f-8570-1498792ee0c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:03.141257 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 876/1750] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:28:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:28:03.145065 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ad6a0-4287-40a3-bdf3-de81b0ac370c service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:03.216209 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398db4c7-4f59-439f-8570-1498792ee0c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:03.222965 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398db4c7-4f59-439f-8570-1498792ee0c5 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:03.238815 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ad6a0-4287-40a3-bdf3-de81b0ac370c service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:03.257326 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51436c-1194-43ab-8132-ac3e88d1e590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:03.264109 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51436c-1194-43ab-8132-ac3e88d1e590 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:03.264769 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51436c-1194-43ab-8132-ac3e88d1e590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:03.265258 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51436c-1194-43ab-8132-ac3e88d1e590 admin admin] PATH_INFO: `/v3/projects/dcf3d90a4a35472d861fc6b338f7538a/users/c960ff998e92413e87cef7a6d48dfa1a/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:03.275294 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 875/1751] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:28:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:28:03.348192 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb51436c-1194-43ab-8132-ac3e88d1e590 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcf3d90a4a35472d861fc6b338f7538a, user_id=c960ff998e92413e87cef7a6d48dfa1a, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:03.368930 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb51436c-1194-43ab-8132-ac3e88d1e590 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:03.384747 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398db4c7-4f59-439f-8570-1498792ee0c5 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:03.386671 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-398db4c7-4f59-439f-8570-1498792ee0c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:03.427539 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398db4c7-4f59-439f-8570-1498792ee0c5 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:03.445486 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 877/1752] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:28:03 2022] PUT /identity/v3/projects/dcf3d90a4a35472d861fc6b338f7538a/users/c960ff998e92413e87cef7a6d48dfa1a/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:03.446212 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9cfb9-ecc0-45ae-8f7a-c7e7b1570a20 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:03.446824 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9cfb9-ecc0-45ae-8f7a-c7e7b1570a20 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:03.447030 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9cfb9-ecc0-45ae-8f7a-c7e7b1570a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:03.551822 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-06f9cfb9-ecc0-45ae-8f7a-c7e7b1570a20 None None] MFA Rules not processed for user `c960ff998e92413e87cef7a6d48dfa1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:03.553078 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-06f9cfb9-ecc0-45ae-8f7a-c7e7b1570a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:03.636002 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed84fe1-ae5e-47e2-a4f1-e094cf1e1bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:03.636002 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed84fe1-ae5e-47e2-a4f1-e094cf1e1bf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:03.636002 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed84fe1-ae5e-47e2-a4f1-e094cf1e1bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:03.636002 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed84fe1-ae5e-47e2-a4f1-e094cf1e1bf3 admin admin] PATH_INFO: `/v3/users/321b7156f8504d409941334369a4787f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:03.636551 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed84fe1-ae5e-47e2-a4f1-e094cf1e1bf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=321b7156f8504d409941334369a4787f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:03.636551 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed84fe1-ae5e-47e2-a4f1-e094cf1e1bf3 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:03.701641 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:03.731802 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1ed84fe1-ae5e-47e2-a4f1-e094cf1e1bf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '321b7156f8504d409941334369a4787f'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:03.752124 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1ed84fe1-ae5e-47e2-a4f1-e094cf1e1bf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '321b7156f8504d409941334369a4787f'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:03.768853 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 878/1753] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:03.771772 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1ed84fe1-ae5e-47e2-a4f1-e094cf1e1bf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '321b7156f8504d409941334369a4787f'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:03.773851 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9cfb9-ecc0-45ae-8f7a-c7e7b1570a20 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:03.774133 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1ed84fe1-ae5e-47e2-a4f1-e094cf1e1bf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '321b7156f8504d409941334369a4787f'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:03.798384 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9cfb9-ecc0-45ae-8f7a-c7e7b1570a20 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:03.805568 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d77b850-c1f5-467a-b934-c56bf4719ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:03.807813 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77b850-c1f5-467a-b934-c56bf4719ad5 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:03.808279 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77b850-c1f5-467a-b934-c56bf4719ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:03.808742 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77b850-c1f5-467a-b934-c56bf4719ad5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:03.809846 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d77b850-c1f5-467a-b934-c56bf4719ad5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:03.812796 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d77b850-c1f5-467a-b934-c56bf4719ad5 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:03.816588 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1ed84fe1-ae5e-47e2-a4f1-e094cf1e1bf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '321b7156f8504d409941334369a4787f'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:03.835564 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 876/1754] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:28:03 2022] DELETE /identity/v3/users/321b7156f8504d409941334369a4787f => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:03.841496 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d980f5-b762-4340-a48b-71b1dd07ac62 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:03.844133 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d980f5-b762-4340-a48b-71b1dd07ac62 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:03.844978 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d980f5-b762-4340-a48b-71b1dd07ac62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:03.908182 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 879/1755] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:28:03 2022] POST /identity/v3/projects => generated 359 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:03.912245 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-05d980f5-b762-4340-a48b-71b1dd07ac62 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:03.912591 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d77b850-c1f5-467a-b934-c56bf4719ad5 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:03.913925 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-05d980f5-b762-4340-a48b-71b1dd07ac62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:03.914920 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-6d77b850-c1f5-467a-b934-c56bf4719ad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:03.996202 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:04.076841 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 877/1756] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:04.119777 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d980f5-b762-4340-a48b-71b1dd07ac62 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:04.122528 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-05d980f5-b762-4340-a48b-71b1dd07ac62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:04.191513 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d77b850-c1f5-467a-b934-c56bf4719ad5 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:04.211223 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0cbb3-4a81-4396-a9d5-ec5f0cc1256a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:04.212155 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0cbb3-4a81-4396-a9d5-ec5f0cc1256a admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:04.212903 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0cbb3-4a81-4396-a9d5-ec5f0cc1256a admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:04.212903 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0cbb3-4a81-4396-a9d5-ec5f0cc1256a admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:04.216632 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b0cbb3-4a81-4396-a9d5-ec5f0cc1256a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:04.222687 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b0cbb3-4a81-4396-a9d5-ec5f0cc1256a admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:04.301694 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 880/1757] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:28:03 2022] POST /identity/v3/users => generated 286 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:04.303565 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0cbb3-4a81-4396-a9d5-ec5f0cc1256a admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:04.319410 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0cbb3-4a81-4396-a9d5-ec5f0cc1256a admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:04.334815 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a3eaf-68c6-4980-a89b-f8f3dc116b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:04.334815 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a3eaf-68c6-4980-a89b-f8f3dc116b6b admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:04.335240 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a3eaf-68c6-4980-a89b-f8f3dc116b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:04.335240 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a3eaf-68c6-4980-a89b-f8f3dc116b6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:04.335837 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0a3eaf-68c6-4980-a89b-f8f3dc116b6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:04.337815 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0a3eaf-68c6-4980-a89b-f8f3dc116b6b admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:04.354621 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d980f5-b762-4340-a48b-71b1dd07ac62 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:04.364739 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999553a-14b8-42d1-957b-d94274e0b7b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:04.366430 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999553a-14b8-42d1-957b-d94274e0b7b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:04.367294 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999553a-14b8-42d1-957b-d94274e0b7b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:04.367765 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999553a-14b8-42d1-957b-d94274e0b7b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:04.372870 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 881/1758] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:04.374816 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a3eaf-68c6-4980-a89b-f8f3dc116b6b admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:04.383130 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7999553a-14b8-42d1-957b-d94274e0b7b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:04.385056 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7999553a-14b8-42d1-957b-d94274e0b7b3 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:04.401123 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 878/1759] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:28:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:28:04.423645 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a3eaf-68c6-4980-a89b-f8f3dc116b6b admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:04.428941 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525956a3-2e13-43ce-a302-4d5f6e2cda33 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:04.429605 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525956a3-2e13-43ce-a302-4d5f6e2cda33 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:04.430501 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525956a3-2e13-43ce-a302-4d5f6e2cda33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:04.445161 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a1255-bd82-43ff-aa9e-60964bf366d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:04.446296 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a1255-bd82-43ff-aa9e-60964bf366d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:04.446729 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a1255-bd82-43ff-aa9e-60964bf366d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:04.447152 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a1255-bd82-43ff-aa9e-60964bf366d8 admin admin] PATH_INFO: `/v3/projects/97a40c465a2f43159d8811afc8744562/users/dc7228df6faf4219b1fe85cd37c70d16/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:04.492086 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-525956a3-2e13-43ce-a302-4d5f6e2cda33 None None] MFA Rules not processed for user `52ceb68d67dd47a3ac2abc533744e3ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:04.493719 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-525956a3-2e13-43ce-a302-4d5f6e2cda33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:04.501484 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40a1255-bd82-43ff-aa9e-60964bf366d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97a40c465a2f43159d8811afc8744562, user_id=dc7228df6faf4219b1fe85cd37c70d16, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:04.517485 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40a1255-bd82-43ff-aa9e-60964bf366d8 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:04.594415 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 882/1760] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:28:04 2022] PUT /identity/v3/projects/97a40c465a2f43159d8811afc8744562/users/dc7228df6faf4219b1fe85cd37c70d16/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:04.601218 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a1255-bd82-43ff-aa9e-60964bf366d8 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:04.608921 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 879/1761] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:04 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:28:04.610162 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525956a3-2e13-43ce-a302-4d5f6e2cda33 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:04.612799 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-525956a3-2e13-43ce-a302-4d5f6e2cda33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:04.633680 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525956a3-2e13-43ce-a302-4d5f6e2cda33 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:04.907350 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda7aeb-71fc-4cc8-bbab-fa2953c75afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:04.907350 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda7aeb-71fc-4cc8-bbab-fa2953c75afa admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:04.907350 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda7aeb-71fc-4cc8-bbab-fa2953c75afa admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:04.907350 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda7aeb-71fc-4cc8-bbab-fa2953c75afa admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:04.909347 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda7aeb-71fc-4cc8-bbab-fa2953c75afa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:04.911379 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a1255-bd82-43ff-aa9e-60964bf366d8 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:04.911911 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda7aeb-71fc-4cc8-bbab-fa2953c75afa admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:04.941365 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448043db-aba9-4c0c-bd7a-27017eadf6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:04.943897 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448043db-aba9-4c0c-bd7a-27017eadf6ff admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:04.944656 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448043db-aba9-4c0c-bd7a-27017eadf6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:04.946216 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448043db-aba9-4c0c-bd7a-27017eadf6ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:04.948482 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448043db-aba9-4c0c-bd7a-27017eadf6ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:04.948840 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:04.952465 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448043db-aba9-4c0c-bd7a-27017eadf6ff admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:04.962921 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 880/1762] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:28:04 2022] POST /identity/v3/projects => generated 403 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:04.965189 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9a425-0846-40d8-8c60-4ccdac0af7a4 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:04.965482 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9a425-0846-40d8-8c60-4ccdac0af7a4 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:04.968683 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9a425-0846-40d8-8c60-4ccdac0af7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:04.983016 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 883/1763] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:04.985105 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448043db-aba9-4c0c-bd7a-27017eadf6ff admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:05.029153 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448043db-aba9-4c0c-bd7a-27017eadf6ff admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:05.045434 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-65e9a425-0846-40d8-8c60-4ccdac0af7a4 None None] MFA Rules not processed for user `41eeb2403f4748b7931680835e47f113`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:05.047540 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-65e9a425-0846-40d8-8c60-4ccdac0af7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:05.085679 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:05.215073 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7c799-9df9-4fa5-adb8-e7de05217572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:05.215762 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7c799-9df9-4fa5-adb8-e7de05217572 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:05.234234 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7c799-9df9-4fa5-adb8-e7de05217572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:05.236267 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7c799-9df9-4fa5-adb8-e7de05217572 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:05.237238 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e7c799-9df9-4fa5-adb8-e7de05217572 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:05.251687 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e7c799-9df9-4fa5-adb8-e7de05217572 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:05.315435 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 881/1764] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:05.318219 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e9a425-0846-40d8-8c60-4ccdac0af7a4 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:05.321868 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 884/1765] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:28:04 2022] POST /identity/v3/users => generated 308 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:05.321868 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7c799-9df9-4fa5-adb8-e7de05217572 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:05.328311 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b3e7c799-9df9-4fa5-adb8-e7de05217572 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:05.375994 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e9a425-0846-40d8-8c60-4ccdac0af7a4 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:05.396211 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7c799-9df9-4fa5-adb8-e7de05217572 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:05.396902 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15669c-840e-499d-b993-2f8e8a7d85f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:05.398069 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15669c-840e-499d-b993-2f8e8a7d85f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:05.398352 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15669c-840e-499d-b993-2f8e8a7d85f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:05.400904 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15669c-840e-499d-b993-2f8e8a7d85f1 admin admin] PATH_INFO: `/v3/projects/97a40c465a2f43159d8811afc8744562/users/dc7228df6faf4219b1fe85cd37c70d16/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:05.405244 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15669c-840e-499d-b993-2f8e8a7d85f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97a40c465a2f43159d8811afc8744562, user_id=dc7228df6faf4219b1fe85cd37c70d16, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:05.410890 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15669c-840e-499d-b993-2f8e8a7d85f1 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:05.420696 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea97f3e-34cb-486f-87b7-59f3d7e76ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:05.421378 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea97f3e-34cb-486f-87b7-59f3d7e76ab2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:05.421664 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea97f3e-34cb-486f-87b7-59f3d7e76ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:05.421944 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea97f3e-34cb-486f-87b7-59f3d7e76ab2 admin admin] PATH_INFO: `/v3/users/71ae57b9f0aa48abbe23d43cbcaed8d4` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:05.423955 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea97f3e-34cb-486f-87b7-59f3d7e76ab2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71ae57b9f0aa48abbe23d43cbcaed8d4)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:05.426769 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 882/1766] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:28:05 2022] PUT /identity/v3/projects/97a40c465a2f43159d8811afc8744562/users/dc7228df6faf4219b1fe85cd37c70d16/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:05.427734 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15669c-840e-499d-b993-2f8e8a7d85f1 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:05.430314 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-4f15669c-840e-499d-b993-2f8e8a7d85f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:05.453925 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea97f3e-34cb-486f-87b7-59f3d7e76ab2 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:05.574561 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9ea97f3e-34cb-486f-87b7-59f3d7e76ab2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71ae57b9f0aa48abbe23d43cbcaed8d4'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:05.592275 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9ea97f3e-34cb-486f-87b7-59f3d7e76ab2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71ae57b9f0aa48abbe23d43cbcaed8d4'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:05.593840 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9ea97f3e-34cb-486f-87b7-59f3d7e76ab2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71ae57b9f0aa48abbe23d43cbcaed8d4'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:05.622459 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9ea97f3e-34cb-486f-87b7-59f3d7e76ab2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71ae57b9f0aa48abbe23d43cbcaed8d4'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:05.622459 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9ea97f3e-34cb-486f-87b7-59f3d7e76ab2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71ae57b9f0aa48abbe23d43cbcaed8d4'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:05.658302 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15669c-840e-499d-b993-2f8e8a7d85f1 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:05.671066 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 885/1767] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:28:05 2022] DELETE /identity/v3/users/71ae57b9f0aa48abbe23d43cbcaed8d4 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:05.671066 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea97f3e-34cb-486f-87b7-59f3d7e76ab2 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:05.671838 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-9ea97f3e-34cb-486f-87b7-59f3d7e76ab2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:05.675201 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d610306-e602-4716-9b3d-0d052e079b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:05.675934 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d610306-e602-4716-9b3d-0d052e079b72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:05.676974 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d610306-e602-4716-9b3d-0d052e079b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:05.676974 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d610306-e602-4716-9b3d-0d052e079b72 admin admin] PATH_INFO: `/v3/projects/9d7c0160808142b7979c18011c3ef809` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:05.678348 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d610306-e602-4716-9b3d-0d052e079b72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d7c0160808142b7979c18011c3ef809)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:05.680351 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d610306-e602-4716-9b3d-0d052e079b72 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:05.810516 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2d610306-e602-4716-9b3d-0d052e079b72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d7c0160808142b7979c18011c3ef809', 'request_id': 'req-2d610306-e602-4716-9b3d-0d052e079b72'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:05.835167 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2d610306-e602-4716-9b3d-0d052e079b72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d7c0160808142b7979c18011c3ef809', 'request_id': 'req-2d610306-e602-4716-9b3d-0d052e079b72'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:05.857797 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2d610306-e602-4716-9b3d-0d052e079b72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d7c0160808142b7979c18011c3ef809', 'request_id': 'req-2d610306-e602-4716-9b3d-0d052e079b72'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:05.858065 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea97f3e-34cb-486f-87b7-59f3d7e76ab2 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:05.880747 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2d610306-e602-4716-9b3d-0d052e079b72 admin admin] The token cache is being invalidate because project 9d7c0160808142b7979c18011c3ef809 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:28:05.880968 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2d610306-e602-4716-9b3d-0d052e079b72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:05.882558 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2d610306-e602-4716-9b3d-0d052e079b72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:05.889885 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 883/1768] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:28:05 2022] DELETE /identity/v3/projects/9d7c0160808142b7979c18011c3ef809 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:05.893773 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a2933-b878-41d0-8087-7cf707b97a8f None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:05.894057 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a2933-b878-41d0-8087-7cf707b97a8f None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:05.899034 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a2933-b878-41d0-8087-7cf707b97a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:05.901989 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:05.948896 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f8613e-b220-4a51-aa3c-f66222bbdbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:05.949880 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f8613e-b220-4a51-aa3c-f66222bbdbaf admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:05.950323 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f8613e-b220-4a51-aa3c-f66222bbdbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:05.950776 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f8613e-b220-4a51-aa3c-f66222bbdbaf admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:05.951523 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f8613e-b220-4a51-aa3c-f66222bbdbaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:05.953260 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f8613e-b220-4a51-aa3c-f66222bbdbaf admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:05.970254 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 886/1769] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:05.972677 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c029f-55fe-4d7e-b7cb-d2d22087382f None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:05.972973 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c029f-55fe-4d7e-b7cb-d2d22087382f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:05.973283 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c029f-55fe-4d7e-b7cb-d2d22087382f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:05.979085 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-819a2933-b878-41d0-8087-7cf707b97a8f None None] MFA Rules not processed for user `dc7228df6faf4219b1fe85cd37c70d16`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:05.980287 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-819a2933-b878-41d0-8087-7cf707b97a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:05.997031 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-5b1c029f-55fe-4d7e-b7cb-d2d22087382f None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:05.998276 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-5b1c029f-55fe-4d7e-b7cb-d2d22087382f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:06.008148 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 887/1770] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:06.009215 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c029f-55fe-4d7e-b7cb-d2d22087382f None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:06.010567 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-5b1c029f-55fe-4d7e-b7cb-d2d22087382f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:06.017394 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:06.031639 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c029f-55fe-4d7e-b7cb-d2d22087382f None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:06.040022 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce50c81-2f20-4bce-ac43-8f804e4fbbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:06.040798 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce50c81-2f20-4bce-ac43-8f804e4fbbb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:06.041194 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce50c81-2f20-4bce-ac43-8f804e4fbbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:06.041354 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce50c81-2f20-4bce-ac43-8f804e4fbbb0 admin admin] PATH_INFO: `/v3/users/16ec3406976747d794435f1f19edb4d4` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:06.043151 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce50c81-2f20-4bce-ac43-8f804e4fbbb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16ec3406976747d794435f1f19edb4d4)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:06.045427 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce50c81-2f20-4bce-ac43-8f804e4fbbb0 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:06.112688 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-3ce50c81-2f20-4bce-ac43-8f804e4fbbb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16ec3406976747d794435f1f19edb4d4'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:06.122539 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-3ce50c81-2f20-4bce-ac43-8f804e4fbbb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16ec3406976747d794435f1f19edb4d4'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:06.123866 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-3ce50c81-2f20-4bce-ac43-8f804e4fbbb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16ec3406976747d794435f1f19edb4d4'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:06.143041 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-3ce50c81-2f20-4bce-ac43-8f804e4fbbb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16ec3406976747d794435f1f19edb4d4'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:06.144131 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-3ce50c81-2f20-4bce-ac43-8f804e4fbbb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16ec3406976747d794435f1f19edb4d4'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:06.176986 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 888/1771] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:28:06 2022] DELETE /identity/v3/users/16ec3406976747d794435f1f19edb4d4 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:06.185926 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce50c81-2f20-4bce-ac43-8f804e4fbbb0 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:06.193485 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 884/1772] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:05 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:06.193485 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a2933-b878-41d0-8087-7cf707b97a8f None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:06.193773 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-3ce50c81-2f20-4bce-ac43-8f804e4fbbb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:06.193868 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-819a2933-b878-41d0-8087-7cf707b97a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:06.317657 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a2933-b878-41d0-8087-7cf707b97a8f None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:06.383811 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce50c81-2f20-4bce-ac43-8f804e4fbbb0 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:06.401398 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9850f28-cfbb-49c1-8583-52905a42e5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:06.402475 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9850f28-cfbb-49c1-8583-52905a42e5f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:06.402928 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9850f28-cfbb-49c1-8583-52905a42e5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:06.403309 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9850f28-cfbb-49c1-8583-52905a42e5f1 admin admin] PATH_INFO: `/v3/projects/096054c778214bf9842acc238a1442e4/users/f687db21c04d47e4a1da394c1b413caa/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:06.446144 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9850f28-cfbb-49c1-8583-52905a42e5f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=096054c778214bf9842acc238a1442e4, user_id=f687db21c04d47e4a1da394c1b413caa, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:06.447626 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbfa7a1-84bb-4623-8b2f-9cccb5c6d0ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:06.448331 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfa7a1-84bb-4623-8b2f-9cccb5c6d0ee service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:06.448660 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfa7a1-84bb-4623-8b2f-9cccb5c6d0ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:06.448941 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfa7a1-84bb-4623-8b2f-9cccb5c6d0ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:06.451671 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-9dbfa7a1-84bb-4623-8b2f-9cccb5c6d0ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:06.451827 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9850f28-cfbb-49c1-8583-52905a42e5f1 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:06.476819 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbfa7a1-84bb-4623-8b2f-9cccb5c6d0ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:06.479518 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbfa7a1-84bb-4623-8b2f-9cccb5c6d0ee service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:06.494217 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 889/1773] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:28:06 2022] PUT /identity/v3/projects/096054c778214bf9842acc238a1442e4/users/f687db21c04d47e4a1da394c1b413caa/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:06.494911 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9850f28-cfbb-49c1-8583-52905a42e5f1 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:06.500871 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f9850f28-cfbb-49c1-8583-52905a42e5f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:06.522783 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 885/1774] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:28:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:28:06.524302 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbfa7a1-84bb-4623-8b2f-9cccb5c6d0ee service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:06.538206 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:06.546613 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbfa7a1-84bb-4623-8b2f-9cccb5c6d0ee service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:06.654563 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9850f28-cfbb-49c1-8583-52905a42e5f1 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:06.671156 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b778a-cb86-40ad-a1ca-3ea4034538cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:06.671374 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b778a-cb86-40ad-a1ca-3ea4034538cd service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:06.671534 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b778a-cb86-40ad-a1ca-3ea4034538cd service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:06.671920 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b778a-cb86-40ad-a1ca-3ea4034538cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:06.742373 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a61d6b-ef61-44e2-acf5-68705c699f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:06.743196 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a61d6b-ef61-44e2-acf5-68705c699f52 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:06.743587 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a61d6b-ef61-44e2-acf5-68705c699f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:06.743978 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a61d6b-ef61-44e2-acf5-68705c699f52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:06.744774 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a61d6b-ef61-44e2-acf5-68705c699f52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:06.746540 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a61d6b-ef61-44e2-acf5-68705c699f52 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:06.755852 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:06.773988 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 886/1775] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:06.775466 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a61d6b-ef61-44e2-acf5-68705c699f52 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:06.826679 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a61d6b-ef61-44e2-acf5-68705c699f52 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:06.854463 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b9365-6b0e-4f12-8dc0-e7d0a633ad21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:06.855287 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b9365-6b0e-4f12-8dc0-e7d0a633ad21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:06.855625 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b9365-6b0e-4f12-8dc0-e7d0a633ad21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:06.855969 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b9365-6b0e-4f12-8dc0-e7d0a633ad21 admin admin] PATH_INFO: `/v3/projects/096054c778214bf9842acc238a1442e4/users/f687db21c04d47e4a1da394c1b413caa/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:06.861411 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8b9365-6b0e-4f12-8dc0-e7d0a633ad21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=096054c778214bf9842acc238a1442e4, user_id=f687db21c04d47e4a1da394c1b413caa, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:06.869735 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8b9365-6b0e-4f12-8dc0-e7d0a633ad21 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:06.915855 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 887/1776] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:28:06 2022] PUT /identity/v3/projects/096054c778214bf9842acc238a1442e4/users/f687db21c04d47e4a1da394c1b413caa/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:06.926638 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063b778a-cb86-40ad-a1ca-3ea4034538cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:06.928612 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063b778a-cb86-40ad-a1ca-3ea4034538cd service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:06.954109 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 890/1777] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:28:06 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:28:06.992992 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b9365-6b0e-4f12-8dc0-e7d0a633ad21 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:06.995529 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-1d8b9365-6b0e-4f12-8dc0-e7d0a633ad21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:07.248950 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b9365-6b0e-4f12-8dc0-e7d0a633ad21 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:07.266421 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d190d-0f74-4cb5-a86b-4a4f728aa1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:07.267382 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d190d-0f74-4cb5-a86b-4a4f728aa1d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:07.267785 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d190d-0f74-4cb5-a86b-4a4f728aa1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:07.268666 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d190d-0f74-4cb5-a86b-4a4f728aa1d5 admin admin] PATH_INFO: `/v3/projects/35c691abbf1b423e9a3abec32affcaca` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:07.277249 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157d190d-0f74-4cb5-a86b-4a4f728aa1d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35c691abbf1b423e9a3abec32affcaca)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:07.288259 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157d190d-0f74-4cb5-a86b-4a4f728aa1d5 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:07.472147 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-157d190d-0f74-4cb5-a86b-4a4f728aa1d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35c691abbf1b423e9a3abec32affcaca', 'request_id': 'req-157d190d-0f74-4cb5-a86b-4a4f728aa1d5'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:07.487820 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-157d190d-0f74-4cb5-a86b-4a4f728aa1d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35c691abbf1b423e9a3abec32affcaca', 'request_id': 'req-157d190d-0f74-4cb5-a86b-4a4f728aa1d5'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:07.507755 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-157d190d-0f74-4cb5-a86b-4a4f728aa1d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35c691abbf1b423e9a3abec32affcaca', 'request_id': 'req-157d190d-0f74-4cb5-a86b-4a4f728aa1d5'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:07.543482 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-157d190d-0f74-4cb5-a86b-4a4f728aa1d5 admin admin] The token cache is being invalidate because project 35c691abbf1b423e9a3abec32affcaca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:28:07.543482 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-157d190d-0f74-4cb5-a86b-4a4f728aa1d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:07.544822 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-157d190d-0f74-4cb5-a86b-4a4f728aa1d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:07.551206 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 888/1778] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:28:06 2022] DELETE /identity/v3/projects/35c691abbf1b423e9a3abec32affcaca => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:07.555736 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b778a-cb86-40ad-a1ca-3ea4034538cd service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:07.577205 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b778a-cb86-40ad-a1ca-3ea4034538cd service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:07.784505 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5709950d-ab88-47e9-bcdd-7d6281ef8eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:07.785188 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709950d-ab88-47e9-bcdd-7d6281ef8eb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:07.785468 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709950d-ab88-47e9-bcdd-7d6281ef8eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:07.785742 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709950d-ab88-47e9-bcdd-7d6281ef8eb1 admin admin] PATH_INFO: `/v3/users/5ee4423cd17540c2b72d3f3b58b6350b` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:07.790934 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5709950d-ab88-47e9-bcdd-7d6281ef8eb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ee4423cd17540c2b72d3f3b58b6350b)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:07.795445 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5709950d-ab88-47e9-bcdd-7d6281ef8eb1 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:07.998271 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5709950d-ab88-47e9-bcdd-7d6281ef8eb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ee4423cd17540c2b72d3f3b58b6350b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:08.058526 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5709950d-ab88-47e9-bcdd-7d6281ef8eb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ee4423cd17540c2b72d3f3b58b6350b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:08.064907 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5709950d-ab88-47e9-bcdd-7d6281ef8eb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ee4423cd17540c2b72d3f3b58b6350b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:08.074996 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d190d-0f74-4cb5-a86b-4a4f728aa1d5 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:08.081237 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-157d190d-0f74-4cb5-a86b-4a4f728aa1d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:08.087787 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5709950d-ab88-47e9-bcdd-7d6281ef8eb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ee4423cd17540c2b72d3f3b58b6350b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:08.088257 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5709950d-ab88-47e9-bcdd-7d6281ef8eb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ee4423cd17540c2b72d3f3b58b6350b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:08.106904 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:08.130172 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d190d-0f74-4cb5-a86b-4a4f728aa1d5 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:08.150617 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce30fc-4d7a-4871-b69f-81ea493649d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:08.151605 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce30fc-4d7a-4871-b69f-81ea493649d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:08.152197 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce30fc-4d7a-4871-b69f-81ea493649d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:08.152634 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce30fc-4d7a-4871-b69f-81ea493649d1 admin admin] PATH_INFO: `/v3/users/c960ff998e92413e87cef7a6d48dfa1a` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:08.154011 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ce30fc-4d7a-4871-b69f-81ea493649d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c960ff998e92413e87cef7a6d48dfa1a)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:08.156097 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ce30fc-4d7a-4871-b69f-81ea493649d1 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:08.172062 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 891/1779] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:28:07 2022] DELETE /identity/v3/users/5ee4423cd17540c2b72d3f3b58b6350b => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:08.242240 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a509d8b-f8e8-44de-8df1-86cbcd553f2f None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:08.243376 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a509d8b-f8e8-44de-8df1-86cbcd553f2f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:08.243991 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a509d8b-f8e8-44de-8df1-86cbcd553f2f None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:08.246221 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 892/1780] 10.222.0.36 () {54 vars in 921 bytes} [Mon Aug 29 22:28:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:28:08.265450 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6703c-8294-421d-927b-673220c3c29d None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:08.266406 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6703c-8294-421d-927b-673220c3c29d None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:08.267412 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6703c-8294-421d-927b-673220c3c29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:08.378291 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-1ae6703c-8294-421d-927b-673220c3c29d None None] MFA Rules not processed for user `90b7213b7111456a93e294ce40b95b21`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:08.381614 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-1ae6703c-8294-421d-927b-673220c3c29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:08.441169 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-c8ce30fc-4d7a-4871-b69f-81ea493649d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c960ff998e92413e87cef7a6d48dfa1a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:08.470203 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-c8ce30fc-4d7a-4871-b69f-81ea493649d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c960ff998e92413e87cef7a6d48dfa1a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:08.498528 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-c8ce30fc-4d7a-4871-b69f-81ea493649d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c960ff998e92413e87cef7a6d48dfa1a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:08.500840 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-c8ce30fc-4d7a-4871-b69f-81ea493649d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c960ff998e92413e87cef7a6d48dfa1a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:08.559341 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=81,keystone:INSERT=3,keystone:DELETE=16 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:08.590340 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-c8ce30fc-4d7a-4871-b69f-81ea493649d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c960ff998e92413e87cef7a6d48dfa1a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:08.590663 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 893/1781] 10.222.0.36 () {58 vars in 1018 bytes} [Mon Aug 29 22:28:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:08.606138 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 889/1782] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:28:08 2022] DELETE /identity/v3/users/c960ff998e92413e87cef7a6d48dfa1a => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:08.610627 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31fa94e-8370-416a-ba97-a20c499dceb6 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:08.611258 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31fa94e-8370-416a-ba97-a20c499dceb6 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:08.611258 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31fa94e-8370-416a-ba97-a20c499dceb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:08.647843 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-d31fa94e-8370-416a-ba97-a20c499dceb6 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:08.652708 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d31fa94e-8370-416a-ba97-a20c499dceb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:08.785844 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce30fc-4d7a-4871-b69f-81ea493649d1 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:08.787926 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c8ce30fc-4d7a-4871-b69f-81ea493649d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:08.834084 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 894/1783] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:08.947258 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31fa94e-8370-416a-ba97-a20c499dceb6 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:08.949608 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d31fa94e-8370-416a-ba97-a20c499dceb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:08.982258 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce30fc-4d7a-4871-b69f-81ea493649d1 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:08.989297 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d8287c-4dde-47f7-9310-8e687a4d4244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:08.989297 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8287c-4dde-47f7-9310-8e687a4d4244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:08.989605 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8287c-4dde-47f7-9310-8e687a4d4244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:08.989705 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8287c-4dde-47f7-9310-8e687a4d4244 admin admin] PATH_INFO: `/v3/projects/b6097a0798ca46a18721a4b85d0a0a06` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:08.990919 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d8287c-4dde-47f7-9310-8e687a4d4244 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6097a0798ca46a18721a4b85d0a0a06)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:08.992972 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d8287c-4dde-47f7-9310-8e687a4d4244 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:09.123771 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31fa94e-8370-416a-ba97-a20c499dceb6 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:09.134806 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-34d8287c-4dde-47f7-9310-8e687a4d4244 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6097a0798ca46a18721a4b85d0a0a06', 'request_id': 'req-34d8287c-4dde-47f7-9310-8e687a4d4244'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:09.165437 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-34d8287c-4dde-47f7-9310-8e687a4d4244 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6097a0798ca46a18721a4b85d0a0a06', 'request_id': 'req-34d8287c-4dde-47f7-9310-8e687a4d4244'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:09.200272 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-34d8287c-4dde-47f7-9310-8e687a4d4244 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6097a0798ca46a18721a4b85d0a0a06', 'request_id': 'req-34d8287c-4dde-47f7-9310-8e687a4d4244'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:09.227980 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-34d8287c-4dde-47f7-9310-8e687a4d4244 admin admin] The token cache is being invalidate because project b6097a0798ca46a18721a4b85d0a0a06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:28:09.228693 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:09.230525 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-34d8287c-4dde-47f7-9310-8e687a4d4244 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:09.233491 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-34d8287c-4dde-47f7-9310-8e687a4d4244 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:09.242289 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 890/1784] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:28:08 2022] DELETE /identity/v3/projects/b6097a0798ca46a18721a4b85d0a0a06 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:28:09.250551 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36eb7b-f728-4f1c-b598-49fad0f0d39b None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:09.254615 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36eb7b-f728-4f1c-b598-49fad0f0d39b None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:09.256753 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36eb7b-f728-4f1c-b598-49fad0f0d39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:09.349242 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27278409-e652-4f12-952f-3c4fcdbb26dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:09.349912 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27278409-e652-4f12-952f-3c4fcdbb26dc service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:09.350194 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27278409-e652-4f12-952f-3c4fcdbb26dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:09.350469 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27278409-e652-4f12-952f-3c4fcdbb26dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:09.355647 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-27278409-e652-4f12-952f-3c4fcdbb26dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:09.381428 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-9c36eb7b-f728-4f1c-b598-49fad0f0d39b None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:09.386808 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-9c36eb7b-f728-4f1c-b598-49fad0f0d39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:09.564162 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 891/1785] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:09.565707 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c36eb7b-f728-4f1c-b598-49fad0f0d39b None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:09.568344 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-9c36eb7b-f728-4f1c-b598-49fad0f0d39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:09.577157 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27278409-e652-4f12-952f-3c4fcdbb26dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:09.579073 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27278409-e652-4f12-952f-3c4fcdbb26dc service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:09.600927 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 895/1786] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:28:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 654 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:28:09.602107 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c36eb7b-f728-4f1c-b598-49fad0f0d39b None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:09.603273 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843ec6e-b00a-4123-a32b-cad70bfae3e0 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:09.603710 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843ec6e-b00a-4123-a32b-cad70bfae3e0 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:09.604709 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843ec6e-b00a-4123-a32b-cad70bfae3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:09.613386 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e305a5e4-14e2-4ee7-aa4e-9ada84e1c69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:09.614625 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305a5e4-14e2-4ee7-aa4e-9ada84e1c69b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:09.614625 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305a5e4-14e2-4ee7-aa4e-9ada84e1c69b admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:09.617164 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305a5e4-14e2-4ee7-aa4e-9ada84e1c69b admin admin] PATH_INFO: `/v3/projects/fbed0cc7bb6349418fac6cb5fcf1b295` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:09.622090 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e305a5e4-14e2-4ee7-aa4e-9ada84e1c69b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbed0cc7bb6349418fac6cb5fcf1b295)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:09.627656 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-8843ec6e-b00a-4123-a32b-cad70bfae3e0 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:09.629118 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-8843ec6e-b00a-4123-a32b-cad70bfae3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:09.629987 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e305a5e4-14e2-4ee7-aa4e-9ada84e1c69b admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:09.638449 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 896/1787] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:09.651807 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843ec6e-b00a-4123-a32b-cad70bfae3e0 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:09.663922 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843ec6e-b00a-4123-a32b-cad70bfae3e0 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:09.671875 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3aeaf9-b6ee-4bdf-be0f-28a8fe9422d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:09.675530 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3aeaf9-b6ee-4bdf-be0f-28a8fe9422d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:09.676194 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3aeaf9-b6ee-4bdf-be0f-28a8fe9422d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:09.676903 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3aeaf9-b6ee-4bdf-be0f-28a8fe9422d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:09.678360 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3aeaf9-b6ee-4bdf-be0f-28a8fe9422d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:28:09.679140 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3aeaf9-b6ee-4bdf-be0f-28a8fe9422d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:09.682458 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3aeaf9-b6ee-4bdf-be0f-28a8fe9422d7 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:09.694619 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:09.724658 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 897/1788] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:28:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:28:09.729112 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3aeaf9-b6ee-4bdf-be0f-28a8fe9422d7 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:09.761177 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3aeaf9-b6ee-4bdf-be0f-28a8fe9422d7 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:09.845033 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e305a5e4-14e2-4ee7-aa4e-9ada84e1c69b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbed0cc7bb6349418fac6cb5fcf1b295', 'request_id': 'req-e305a5e4-14e2-4ee7-aa4e-9ada84e1c69b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:09.871846 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e305a5e4-14e2-4ee7-aa4e-9ada84e1c69b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbed0cc7bb6349418fac6cb5fcf1b295', 'request_id': 'req-e305a5e4-14e2-4ee7-aa4e-9ada84e1c69b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:09.897001 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e305a5e4-14e2-4ee7-aa4e-9ada84e1c69b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbed0cc7bb6349418fac6cb5fcf1b295', 'request_id': 'req-e305a5e4-14e2-4ee7-aa4e-9ada84e1c69b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:09.931029 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e305a5e4-14e2-4ee7-aa4e-9ada84e1c69b admin admin] The token cache is being invalidate because project fbed0cc7bb6349418fac6cb5fcf1b295 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:28:09.931531 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e305a5e4-14e2-4ee7-aa4e-9ada84e1c69b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:09.934102 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e305a5e4-14e2-4ee7-aa4e-9ada84e1c69b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:09.937491 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee4d9e-5386-441c-945b-9d37a469148e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:09.938250 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee4d9e-5386-441c-945b-9d37a469148e admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:09.938406 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee4d9e-5386-441c-945b-9d37a469148e admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:09.938688 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee4d9e-5386-441c-945b-9d37a469148e admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:09.939516 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee4d9e-5386-441c-945b-9d37a469148e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:09.943442 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 892/1789] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:28:09 2022] DELETE /identity/v3/projects/fbed0cc7bb6349418fac6cb5fcf1b295 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:09.943619 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee4d9e-5386-441c-945b-9d37a469148e admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:09.944753 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e305a5e4-14e2-4ee7-aa4e-9ada84e1c69b admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:09.947331 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e305a5e4-14e2-4ee7-aa4e-9ada84e1c69b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:09.986217 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e305a5e4-14e2-4ee7-aa4e-9ada84e1c69b admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:09.998105 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82632fa2-0814-4c16-9378-8b6ba8278249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:10.000203 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82632fa2-0814-4c16-9378-8b6ba8278249 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:10.000478 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82632fa2-0814-4c16-9378-8b6ba8278249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:10.000767 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82632fa2-0814-4c16-9378-8b6ba8278249 admin admin] PATH_INFO: `/v3/users/063af6124c6847368e6bfc7e5ed35fdc` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:10.024785 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82632fa2-0814-4c16-9378-8b6ba8278249 admin admin] RBAC: Authorizing `identity:delete_user(user_id=063af6124c6847368e6bfc7e5ed35fdc)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:10.027270 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 898/1790] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:28:09 2022] POST /identity/v3/projects => generated 387 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:10.037273 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82632fa2-0814-4c16-9378-8b6ba8278249 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:10.042490 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee4d9e-5386-441c-945b-9d37a469148e admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:10.045915 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b3ee4d9e-5386-441c-945b-9d37a469148e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:10.234073 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:10.234587 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-82632fa2-0814-4c16-9378-8b6ba8278249 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '063af6124c6847368e6bfc7e5ed35fdc'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:10.272269 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-82632fa2-0814-4c16-9378-8b6ba8278249 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '063af6124c6847368e6bfc7e5ed35fdc'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:10.284812 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee4d9e-5386-441c-945b-9d37a469148e admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:10.297787 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-82632fa2-0814-4c16-9378-8b6ba8278249 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '063af6124c6847368e6bfc7e5ed35fdc'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:10.300042 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-82632fa2-0814-4c16-9378-8b6ba8278249 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '063af6124c6847368e6bfc7e5ed35fdc'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:10.313193 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd51c389-fb54-4ead-a252-2a07595ba609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:10.315564 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51c389-fb54-4ead-a252-2a07595ba609 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:10.317448 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51c389-fb54-4ead-a252-2a07595ba609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:10.319452 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51c389-fb54-4ead-a252-2a07595ba609 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:10.323290 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd51c389-fb54-4ead-a252-2a07595ba609 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:10.331909 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd51c389-fb54-4ead-a252-2a07595ba609 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:10.384703 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-82632fa2-0814-4c16-9378-8b6ba8278249 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '063af6124c6847368e6bfc7e5ed35fdc'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:10.414217 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 893/1791] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:28:09 2022] DELETE /identity/v3/users/063af6124c6847368e6bfc7e5ed35fdc => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:10.415519 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82632fa2-0814-4c16-9378-8b6ba8278249 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:10.426309 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 899/1792] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:28:10 2022] POST /identity/v3/users => generated 294 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:10.430523 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd51c389-fb54-4ead-a252-2a07595ba609 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:10.432832 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-82632fa2-0814-4c16-9378-8b6ba8278249 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:10.433750 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-fd51c389-fb54-4ead-a252-2a07595ba609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:10.454808 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd51c389-fb54-4ead-a252-2a07595ba609 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:10.575142 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8212ffb-211d-49b3-9a46-bb8eedea7e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:10.576398 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8212ffb-211d-49b3-9a46-bb8eedea7e6a admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:10.576759 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8212ffb-211d-49b3-9a46-bb8eedea7e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:10.577049 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8212ffb-211d-49b3-9a46-bb8eedea7e6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:10.578031 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8212ffb-211d-49b3-9a46-bb8eedea7e6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:10.580566 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8212ffb-211d-49b3-9a46-bb8eedea7e6a admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:10.601576 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 900/1793] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:10 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:10.623014 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8212ffb-211d-49b3-9a46-bb8eedea7e6a admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:10.665485 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8212ffb-211d-49b3-9a46-bb8eedea7e6a admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:10.669929 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82632fa2-0814-4c16-9378-8b6ba8278249 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:10.691254 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f50b4c-0e1f-4123-a4b8-9b73a1e28608 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b7213b7111456a93e294ce40b95b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:10.692855 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f50b4c-0e1f-4123-a4b8-9b73a1e28608 service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:10.692855 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f50b4c-0e1f-4123-a4b8-9b73a1e28608 service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:10.693175 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f50b4c-0e1f-4123-a4b8-9b73a1e28608 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:10.706255 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccab5f06-ed0a-4315-a845-17a80b8a6026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:10.708991 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab5f06-ed0a-4315-a845-17a80b8a6026 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:10.717374 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-90f50b4c-0e1f-4123-a4b8-9b73a1e28608 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:10.717859 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab5f06-ed0a-4315-a845-17a80b8a6026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:10.717859 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab5f06-ed0a-4315-a845-17a80b8a6026 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:10.717859 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccab5f06-ed0a-4315-a845-17a80b8a6026 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:10.720537 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccab5f06-ed0a-4315-a845-17a80b8a6026 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:10.757578 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 901/1794] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:10 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:10.763458 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccab5f06-ed0a-4315-a845-17a80b8a6026 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:10.777865 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f50b4c-0e1f-4123-a4b8-9b73a1e28608 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:10.796587 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f50b4c-0e1f-4123-a4b8-9b73a1e28608 service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:10.815935 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccab5f06-ed0a-4315-a845-17a80b8a6026 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:10.819766 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:10.833113 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6832cb-3132-4f97-b64f-7e162d141d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:10.834961 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6832cb-3132-4f97-b64f-7e162d141d5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:10.835471 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6832cb-3132-4f97-b64f-7e162d141d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:10.835963 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6832cb-3132-4f97-b64f-7e162d141d5c admin admin] PATH_INFO: `/v3/projects/41596bd1a44847ee85ff66ab08b11c62/users/930f8a8177524f11bcabbdf73e5a04e6/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:10.843802 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 894/1795] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:28:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:28:10.878453 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6832cb-3132-4f97-b64f-7e162d141d5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=41596bd1a44847ee85ff66ab08b11c62, user_id=930f8a8177524f11bcabbdf73e5a04e6, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:10.883266 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6832cb-3132-4f97-b64f-7e162d141d5c admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:10.947644 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 902/1796] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:28:10 2022] PUT /identity/v3/projects/41596bd1a44847ee85ff66ab08b11c62/users/930f8a8177524f11bcabbdf73e5a04e6/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:28:10.961428 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4e189-0b8b-4b0c-9016-c1cf9ea3c6d5 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:10.962313 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4e189-0b8b-4b0c-9016-c1cf9ea3c6d5 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:10.963333 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4e189-0b8b-4b0c-9016-c1cf9ea3c6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:11.051651 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-00d4e189-0b8b-4b0c-9016-c1cf9ea3c6d5 None None] MFA Rules not processed for user `930f8a8177524f11bcabbdf73e5a04e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:11.052973 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-00d4e189-0b8b-4b0c-9016-c1cf9ea3c6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:11.232212 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 895/1797] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:10 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:11.238296 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6832cb-3132-4f97-b64f-7e162d141d5c admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:11.380613 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6832cb-3132-4f97-b64f-7e162d141d5c admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:11.397755 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db47b44-4297-41f2-a903-70c2497c4e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:11.398710 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db47b44-4297-41f2-a903-70c2497c4e31 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:11.399150 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db47b44-4297-41f2-a903-70c2497c4e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:11.400188 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db47b44-4297-41f2-a903-70c2497c4e31 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:11.401046 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db47b44-4297-41f2-a903-70c2497c4e31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:11.406166 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db47b44-4297-41f2-a903-70c2497c4e31 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:11.488490 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 903/1798] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:28:11 2022] POST /identity/v3/projects => generated 387 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:28:11.491894 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4e189-0b8b-4b0c-9016-c1cf9ea3c6d5 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:11.507180 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4e189-0b8b-4b0c-9016-c1cf9ea3c6d5 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:11.620036 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666638c9-f526-4d4a-8cea-a21fac28a6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:11.620791 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666638c9-f526-4d4a-8cea-a21fac28a6c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:11.621169 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666638c9-f526-4d4a-8cea-a21fac28a6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:11.621578 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666638c9-f526-4d4a-8cea-a21fac28a6c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:11.622336 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666638c9-f526-4d4a-8cea-a21fac28a6c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:11.624488 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666638c9-f526-4d4a-8cea-a21fac28a6c3 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:11.633979 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db47b44-4297-41f2-a903-70c2497c4e31 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:11.637027 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-0db47b44-4297-41f2-a903-70c2497c4e31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:11.657997 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db47b44-4297-41f2-a903-70c2497c4e31 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:11.684277 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a456d-be1b-44bf-9752-f955d27a1871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:11.685574 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a456d-be1b-44bf-9752-f955d27a1871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:11.688232 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a456d-be1b-44bf-9752-f955d27a1871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:11.688866 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a456d-be1b-44bf-9752-f955d27a1871 admin admin] PATH_INFO: `/v3/projects/84a5e18477384261ac68bd5e752647ee` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:11.692666 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a456d-be1b-44bf-9752-f955d27a1871 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84a5e18477384261ac68bd5e752647ee)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:11.698007 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a456d-be1b-44bf-9752-f955d27a1871 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:11.699004 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 896/1799] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:28:11 2022] POST /identity/v3/users => generated 300 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:28:11.715696 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666638c9-f526-4d4a-8cea-a21fac28a6c3 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:11.731123 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666638c9-f526-4d4a-8cea-a21fac28a6c3 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:11.744800 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6bc2d0-5986-4894-ab29-c7afe87b5e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:11.745770 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6bc2d0-5986-4894-ab29-c7afe87b5e43 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:11.746149 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6bc2d0-5986-4894-ab29-c7afe87b5e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:11.746517 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6bc2d0-5986-4894-ab29-c7afe87b5e43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:11.749116 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6bc2d0-5986-4894-ab29-c7afe87b5e43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:11.750870 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:11.752068 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6bc2d0-5986-4894-ab29-c7afe87b5e43 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:11.774900 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 897/1800] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:11 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:11.781111 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6bc2d0-5986-4894-ab29-c7afe87b5e43 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:11.804906 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6bc2d0-5986-4894-ab29-c7afe87b5e43 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:11.832781 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8a5a456d-be1b-44bf-9752-f955d27a1871 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84a5e18477384261ac68bd5e752647ee', 'request_id': 'req-8a5a456d-be1b-44bf-9752-f955d27a1871'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:11.862087 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8a5a456d-be1b-44bf-9752-f955d27a1871 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84a5e18477384261ac68bd5e752647ee', 'request_id': 'req-8a5a456d-be1b-44bf-9752-f955d27a1871'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:11.886698 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8a5a456d-be1b-44bf-9752-f955d27a1871 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84a5e18477384261ac68bd5e752647ee', 'request_id': 'req-8a5a456d-be1b-44bf-9752-f955d27a1871'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:11.906994 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8a5a456d-be1b-44bf-9752-f955d27a1871 admin admin] The token cache is being invalidate because project 84a5e18477384261ac68bd5e752647ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:28:11.907321 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8a5a456d-be1b-44bf-9752-f955d27a1871 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:11.908755 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8a5a456d-be1b-44bf-9752-f955d27a1871 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:11.910764 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 904/1801] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:28:11 2022] DELETE /identity/v3/projects/84a5e18477384261ac68bd5e752647ee => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:11.911740 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a456d-be1b-44bf-9752-f955d27a1871 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:11.915736 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-8a5a456d-be1b-44bf-9752-f955d27a1871 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:12.041213 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a456d-be1b-44bf-9752-f955d27a1871 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:12.041769 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2f93f-a469-468f-8497-ba73a5f0d863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:12.042479 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2f93f-a469-468f-8497-ba73a5f0d863 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:12.042754 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2f93f-a469-468f-8497-ba73a5f0d863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:12.043704 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2f93f-a469-468f-8497-ba73a5f0d863 admin admin] PATH_INFO: `/v3/projects/0da6f3f19ba447728ee6350bb5006977/users/afbad079017a47eab404494e2d70751e/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:12.054151 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c284a51-a231-419d-8de1-cc0dc6199116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:12.055118 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c284a51-a231-419d-8de1-cc0dc6199116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:12.055544 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c284a51-a231-419d-8de1-cc0dc6199116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:12.055804 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c284a51-a231-419d-8de1-cc0dc6199116 admin admin] PATH_INFO: `/v3/projects/2865af5f1b834eff8e5551b9c4ce7f69` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:12.057079 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c284a51-a231-419d-8de1-cc0dc6199116 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2865af5f1b834eff8e5551b9c4ce7f69)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:12.059644 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c284a51-a231-419d-8de1-cc0dc6199116 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:12.089159 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:12.100070 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd2f93f-a469-468f-8497-ba73a5f0d863 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0da6f3f19ba447728ee6350bb5006977, user_id=afbad079017a47eab404494e2d70751e, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:12.102828 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd2f93f-a469-468f-8497-ba73a5f0d863 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:12.138495 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 898/1802] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:28:11 2022] PUT /identity/v3/projects/0da6f3f19ba447728ee6350bb5006977/users/afbad079017a47eab404494e2d70751e/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:12.138973 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836aad3-4b6c-4d22-8a68-b86ec0d68cd1 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:12.139261 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836aad3-4b6c-4d22-8a68-b86ec0d68cd1 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:12.139551 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836aad3-4b6c-4d22-8a68-b86ec0d68cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:12.181384 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-7836aad3-4b6c-4d22-8a68-b86ec0d68cd1 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:12.182701 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-7836aad3-4b6c-4d22-8a68-b86ec0d68cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:12.229704 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-1c284a51-a231-419d-8de1-cc0dc6199116 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2865af5f1b834eff8e5551b9c4ce7f69', 'request_id': 'req-1c284a51-a231-419d-8de1-cc0dc6199116'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:12.239516 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-1c284a51-a231-419d-8de1-cc0dc6199116 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2865af5f1b834eff8e5551b9c4ce7f69', 'request_id': 'req-1c284a51-a231-419d-8de1-cc0dc6199116'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:12.264387 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-1c284a51-a231-419d-8de1-cc0dc6199116 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2865af5f1b834eff8e5551b9c4ce7f69', 'request_id': 'req-1c284a51-a231-419d-8de1-cc0dc6199116'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:12.299674 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-1c284a51-a231-419d-8de1-cc0dc6199116 admin admin] The token cache is being invalidate because project 2865af5f1b834eff8e5551b9c4ce7f69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:28:12.300058 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-1c284a51-a231-419d-8de1-cc0dc6199116 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:12.301792 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-1c284a51-a231-419d-8de1-cc0dc6199116 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:12.304310 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 905/1803] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:28:11 2022] DELETE /identity/v3/projects/2865af5f1b834eff8e5551b9c4ce7f69 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:12.305156 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c284a51-a231-419d-8de1-cc0dc6199116 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:12.320123 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-1c284a51-a231-419d-8de1-cc0dc6199116 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:12.379372 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 899/1804] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:12.381607 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7836aad3-4b6c-4d22-8a68-b86ec0d68cd1 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:12.383784 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-7836aad3-4b6c-4d22-8a68-b86ec0d68cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:12.403490 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:12.408579 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7836aad3-4b6c-4d22-8a68-b86ec0d68cd1 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:12.421760 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b43c63-02c7-4252-8a36-ea9e381d2e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:12.422405 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b43c63-02c7-4252-8a36-ea9e381d2e01 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:12.422695 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b43c63-02c7-4252-8a36-ea9e381d2e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:12.422961 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b43c63-02c7-4252-8a36-ea9e381d2e01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:12.423950 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b43c63-02c7-4252-8a36-ea9e381d2e01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:12.426186 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b43c63-02c7-4252-8a36-ea9e381d2e01 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:12.458834 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 900/1805] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:12.461208 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5faaa41-7d82-42cb-a5e9-b4d266fcbef5 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:12.461506 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5faaa41-7d82-42cb-a5e9-b4d266fcbef5 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:12.461912 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5faaa41-7d82-42cb-a5e9-b4d266fcbef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:12.471412 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c284a51-a231-419d-8de1-cc0dc6199116 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:12.479995 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2bb98e-b3ab-4810-94fb-333cd86eb011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:12.480999 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2bb98e-b3ab-4810-94fb-333cd86eb011 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:12.481494 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2bb98e-b3ab-4810-94fb-333cd86eb011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:12.482014 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2bb98e-b3ab-4810-94fb-333cd86eb011 admin admin] PATH_INFO: `/v3/projects/dcf3d90a4a35472d861fc6b338f7538a` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:12.483523 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2bb98e-b3ab-4810-94fb-333cd86eb011 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcf3d90a4a35472d861fc6b338f7538a)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:12.485568 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2bb98e-b3ab-4810-94fb-333cd86eb011 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:12.521284 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-d5faaa41-7d82-42cb-a5e9-b4d266fcbef5 None None] MFA Rules not processed for user `f687db21c04d47e4a1da394c1b413caa`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:12.523102 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-d5faaa41-7d82-42cb-a5e9-b4d266fcbef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:12.604633 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-db2bb98e-b3ab-4810-94fb-333cd86eb011 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcf3d90a4a35472d861fc6b338f7538a', 'request_id': 'req-db2bb98e-b3ab-4810-94fb-333cd86eb011'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:12.618632 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-db2bb98e-b3ab-4810-94fb-333cd86eb011 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcf3d90a4a35472d861fc6b338f7538a', 'request_id': 'req-db2bb98e-b3ab-4810-94fb-333cd86eb011'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:12.641130 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-db2bb98e-b3ab-4810-94fb-333cd86eb011 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcf3d90a4a35472d861fc6b338f7538a', 'request_id': 'req-db2bb98e-b3ab-4810-94fb-333cd86eb011'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:12.656821 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-db2bb98e-b3ab-4810-94fb-333cd86eb011 admin admin] The token cache is being invalidate because project dcf3d90a4a35472d861fc6b338f7538a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:28:12.657112 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-db2bb98e-b3ab-4810-94fb-333cd86eb011 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:12.657851 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-db2bb98e-b3ab-4810-94fb-333cd86eb011 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:12.662602 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 906/1806] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:28:12 2022] DELETE /identity/v3/projects/dcf3d90a4a35472d861fc6b338f7538a => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:12.663934 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4596a9a-c735-4cf4-ba7f-6b2f723ccaa6 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:12.665334 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4596a9a-c735-4cf4-ba7f-6b2f723ccaa6 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:12.665334 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4596a9a-c735-4cf4-ba7f-6b2f723ccaa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:12.670075 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 901/1807] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:12 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:12.670852 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec05b6e-fddf-4e47-ac7c-4512574eb2f0 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:12.673114 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec05b6e-fddf-4e47-ac7c-4512574eb2f0 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:12.673609 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec05b6e-fddf-4e47-ac7c-4512574eb2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:12.692785 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-c4596a9a-c735-4cf4-ba7f-6b2f723ccaa6 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:12.694036 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c4596a9a-c735-4cf4-ba7f-6b2f723ccaa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:12.701832 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-cec05b6e-fddf-4e47-ac7c-4512574eb2f0 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:12.703049 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-cec05b6e-fddf-4e47-ac7c-4512574eb2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:12.781924 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 902/1808] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:12.783095 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec05b6e-fddf-4e47-ac7c-4512574eb2f0 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:12.784513 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-cec05b6e-fddf-4e47-ac7c-4512574eb2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:12.792955 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 907/1809] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:12.794650 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4596a9a-c735-4cf4-ba7f-6b2f723ccaa6 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:12.796258 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c4596a9a-c735-4cf4-ba7f-6b2f723ccaa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:12.797596 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec05b6e-fddf-4e47-ac7c-4512574eb2f0 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:12.802765 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af1054-744e-49ee-a7d7-671ef02e5aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:12.803545 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af1054-744e-49ee-a7d7-671ef02e5aa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:12.803887 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af1054-744e-49ee-a7d7-671ef02e5aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:12.804225 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af1054-744e-49ee-a7d7-671ef02e5aa2 admin admin] PATH_INFO: `/v3/projects/0da6f3f19ba447728ee6350bb5006977/users/afbad079017a47eab404494e2d70751e/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:12.806581 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80af1054-744e-49ee-a7d7-671ef02e5aa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0da6f3f19ba447728ee6350bb5006977, user_id=afbad079017a47eab404494e2d70751e, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:12.809541 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80af1054-744e-49ee-a7d7-671ef02e5aa2 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:12.812141 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:12.816220 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4596a9a-c735-4cf4-ba7f-6b2f723ccaa6 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:12.834256 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 903/1810] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:28:12 2022] PUT /identity/v3/projects/0da6f3f19ba447728ee6350bb5006977/users/afbad079017a47eab404494e2d70751e/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:12.835242 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af1054-744e-49ee-a7d7-671ef02e5aa2 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:12.901968 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df37a5e7-b142-413a-bc86-84f87cb0db18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:12.903384 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37a5e7-b142-413a-bc86-84f87cb0db18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:12.903757 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37a5e7-b142-413a-bc86-84f87cb0db18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:12.904833 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37a5e7-b142-413a-bc86-84f87cb0db18 admin admin] PATH_INFO: `/v3/users/dc7228df6faf4219b1fe85cd37c70d16` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:12.905752 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df37a5e7-b142-413a-bc86-84f87cb0db18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc7228df6faf4219b1fe85cd37c70d16)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:12.908274 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df37a5e7-b142-413a-bc86-84f87cb0db18 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:12.916512 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:12.937236 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af1054-744e-49ee-a7d7-671ef02e5aa2 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:12.943674 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b2ed3a-64e5-4b6e-aef3-9bf1b46636d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:12.944292 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2ed3a-64e5-4b6e-aef3-9bf1b46636d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:12.944821 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2ed3a-64e5-4b6e-aef3-9bf1b46636d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:12.945004 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2ed3a-64e5-4b6e-aef3-9bf1b46636d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:12.946310 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b2ed3a-64e5-4b6e-aef3-9bf1b46636d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:28:12.946625 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b2ed3a-64e5-4b6e-aef3-9bf1b46636d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:12.948367 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b2ed3a-64e5-4b6e-aef3-9bf1b46636d9 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:12.969348 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 904/1811] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:28:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:28:12.969348 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac745819-8392-4734-b602-6a7493be9f9f None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:12.969348 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac745819-8392-4734-b602-6a7493be9f9f None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:12.969348 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac745819-8392-4734-b602-6a7493be9f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:12.980182 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-df37a5e7-b142-413a-bc86-84f87cb0db18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc7228df6faf4219b1fe85cd37c70d16'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:12.990505 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-ac745819-8392-4734-b602-6a7493be9f9f None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:12.991535 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-ac745819-8392-4734-b602-6a7493be9f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:12.998219 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-df37a5e7-b142-413a-bc86-84f87cb0db18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc7228df6faf4219b1fe85cd37c70d16'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:13.003378 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 905/1812] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:13.003378 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf202c-8acf-4e1c-8064-81c240fab07a None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:13.003378 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf202c-8acf-4e1c-8064-81c240fab07a None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:13.003378 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf202c-8acf-4e1c-8064-81c240fab07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:13.005019 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-df37a5e7-b142-413a-bc86-84f87cb0db18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc7228df6faf4219b1fe85cd37c70d16'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:13.018006 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-df37a5e7-b142-413a-bc86-84f87cb0db18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc7228df6faf4219b1fe85cd37c70d16'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:13.018920 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-df37a5e7-b142-413a-bc86-84f87cb0db18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc7228df6faf4219b1fe85cd37c70d16'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:13.039910 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 908/1813] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:28:12 2022] DELETE /identity/v3/users/dc7228df6faf4219b1fe85cd37c70d16 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:13.040600 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df37a5e7-b142-413a-bc86-84f87cb0db18 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:13.041990 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-df37a5e7-b142-413a-bc86-84f87cb0db18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:13.046499 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-dccf202c-8acf-4e1c-8064-81c240fab07a None None] MFA Rules not processed for user `afbad079017a47eab404494e2d70751e`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:13.049094 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-dccf202c-8acf-4e1c-8064-81c240fab07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:13.128203 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df37a5e7-b142-413a-bc86-84f87cb0db18 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:13.134372 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27292d77-c96a-4677-9d1b-c6beb6208683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:13.134985 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27292d77-c96a-4677-9d1b-c6beb6208683 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:13.135271 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27292d77-c96a-4677-9d1b-c6beb6208683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:13.135544 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27292d77-c96a-4677-9d1b-c6beb6208683 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:13.136191 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27292d77-c96a-4677-9d1b-c6beb6208683 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:13.138431 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27292d77-c96a-4677-9d1b-c6beb6208683 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:13.163826 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 906/1814] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:12 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:13.169042 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf202c-8acf-4e1c-8064-81c240fab07a None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:13.171775 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-dccf202c-8acf-4e1c-8064-81c240fab07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:13.188557 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 909/1815] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:28:13 2022] POST /identity/v3/projects => generated 365 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:13.189208 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf202c-8acf-4e1c-8064-81c240fab07a None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:13.190083 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27292d77-c96a-4677-9d1b-c6beb6208683 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:13.192012 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-27292d77-c96a-4677-9d1b-c6beb6208683 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:13.263132 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8597c-49e7-4670-ae56-8cab1f264a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:13.265900 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8597c-49e7-4670-ae56-8cab1f264a40 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:13.278497 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8597c-49e7-4670-ae56-8cab1f264a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:13.278804 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8597c-49e7-4670-ae56-8cab1f264a40 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:13.280364 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc8597c-49e7-4670-ae56-8cab1f264a40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:28:13.280701 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc8597c-49e7-4670-ae56-8cab1f264a40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:13.287738 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc8597c-49e7-4670-ae56-8cab1f264a40 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:13.294380 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27292d77-c96a-4677-9d1b-c6beb6208683 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:13.310615 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:13.312354 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da944e92-9d33-402f-9a42-94bf33d29235 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:13.313049 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da944e92-9d33-402f-9a42-94bf33d29235 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:13.313334 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da944e92-9d33-402f-9a42-94bf33d29235 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:13.318203 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da944e92-9d33-402f-9a42-94bf33d29235 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:13.320666 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 907/1816] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:28:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:28:13.323731 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8597c-49e7-4670-ae56-8cab1f264a40 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:13.342568 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8597c-49e7-4670-ae56-8cab1f264a40 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:13.350358 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c00cd7-c171-4f03-99c9-8b15c9d7f21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:13.350996 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c00cd7-c171-4f03-99c9-8b15c9d7f21e admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:13.351274 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c00cd7-c171-4f03-99c9-8b15c9d7f21e admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:13.351545 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c00cd7-c171-4f03-99c9-8b15c9d7f21e admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:13.352181 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c00cd7-c171-4f03-99c9-8b15c9d7f21e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:13.354649 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c00cd7-c171-4f03-99c9-8b15c9d7f21e admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:13.410489 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 908/1817] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:28:13 2022] POST /identity/v3/users => generated 283 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:13.411819 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c00cd7-c171-4f03-99c9-8b15c9d7f21e admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:13.418319 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:13.433470 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c00cd7-c171-4f03-99c9-8b15c9d7f21e admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:13.442945 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e636d4-1cbe-4428-b629-ea80ede1cb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:13.443967 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e636d4-1cbe-4428-b629-ea80ede1cb96 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:13.444495 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e636d4-1cbe-4428-b629-ea80ede1cb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:13.444990 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e636d4-1cbe-4428-b629-ea80ede1cb96 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:13.446077 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e636d4-1cbe-4428-b629-ea80ede1cb96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:13.448509 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e636d4-1cbe-4428-b629-ea80ede1cb96 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:13.478806 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da944e92-9d33-402f-9a42-94bf33d29235 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:13.480767 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da944e92-9d33-402f-9a42-94bf33d29235 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:13.494724 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 910/1818] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:28:13 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:28:13.495952 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da944e92-9d33-402f-9a42-94bf33d29235 service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:13.508679 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 909/1819] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:28:13 2022] POST /identity/v3/projects => generated 367 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:13.512733 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e636d4-1cbe-4428-b629-ea80ede1cb96 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:13.523470 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da944e92-9d33-402f-9a42-94bf33d29235 service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:13.633300 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c4ab29-5ffe-40aa-a2e0-517f43b0f3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:13.634366 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c4ab29-5ffe-40aa-a2e0-517f43b0f3a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:13.634815 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c4ab29-5ffe-40aa-a2e0-517f43b0f3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:13.635237 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c4ab29-5ffe-40aa-a2e0-517f43b0f3a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:13.636074 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c4ab29-5ffe-40aa-a2e0-517f43b0f3a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:13.638062 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c4ab29-5ffe-40aa-a2e0-517f43b0f3a9 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:13.667824 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e636d4-1cbe-4428-b629-ea80ede1cb96 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:13.668870 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 911/1820] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:13.669835 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c4ab29-5ffe-40aa-a2e0-517f43b0f3a9 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:13.672642 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-44c4ab29-5ffe-40aa-a2e0-517f43b0f3a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:13.687658 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c4ab29-5ffe-40aa-a2e0-517f43b0f3a9 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:13.692439 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b203e-8ef4-4672-b07f-2ab2b4d2ecbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:13.693398 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9208c4-d768-4d36-8b0d-447b683247c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:13.694281 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9208c4-d768-4d36-8b0d-447b683247c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:13.694747 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9208c4-d768-4d36-8b0d-447b683247c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:13.695215 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9208c4-d768-4d36-8b0d-447b683247c3 admin admin] PATH_INFO: `/v3/users/930f8a8177524f11bcabbdf73e5a04e6` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:13.696704 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9208c4-d768-4d36-8b0d-447b683247c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=930f8a8177524f11bcabbdf73e5a04e6)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:13.699029 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9208c4-d768-4d36-8b0d-447b683247c3 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:13.706974 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b203e-8ef4-4672-b07f-2ab2b4d2ecbb admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:13.712208 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b203e-8ef4-4672-b07f-2ab2b4d2ecbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:13.712415 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b203e-8ef4-4672-b07f-2ab2b4d2ecbb admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:13.713652 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144b203e-8ef4-4672-b07f-2ab2b4d2ecbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:13.723360 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144b203e-8ef4-4672-b07f-2ab2b4d2ecbb admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:13.756613 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4a9208c4-d768-4d36-8b0d-447b683247c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '930f8a8177524f11bcabbdf73e5a04e6'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:13.766690 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4a9208c4-d768-4d36-8b0d-447b683247c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '930f8a8177524f11bcabbdf73e5a04e6'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:13.770709 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4a9208c4-d768-4d36-8b0d-447b683247c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '930f8a8177524f11bcabbdf73e5a04e6'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:13.776189 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 910/1821] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:28:13 2022] POST /identity/v3/users => generated 284 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:28:13.777407 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b203e-8ef4-4672-b07f-2ab2b4d2ecbb admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:13.797773 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4a9208c4-d768-4d36-8b0d-447b683247c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '930f8a8177524f11bcabbdf73e5a04e6'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:13.798962 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b203e-8ef4-4672-b07f-2ab2b4d2ecbb admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:13.800976 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4a9208c4-d768-4d36-8b0d-447b683247c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '930f8a8177524f11bcabbdf73e5a04e6'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:13.804241 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac0d8f3-ea79-42bb-90df-b606a26d34a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:13.805747 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac0d8f3-ea79-42bb-90df-b606a26d34a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:13.805747 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac0d8f3-ea79-42bb-90df-b606a26d34a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:13.805747 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac0d8f3-ea79-42bb-90df-b606a26d34a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:13.806757 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac0d8f3-ea79-42bb-90df-b606a26d34a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:13.808680 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac0d8f3-ea79-42bb-90df-b606a26d34a3 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:13.835668 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 912/1822] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:28:13 2022] DELETE /identity/v3/users/930f8a8177524f11bcabbdf73e5a04e6 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:13.837086 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9208c4-d768-4d36-8b0d-447b683247c3 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:13.840203 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 911/1823] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:13.841557 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-4a9208c4-d768-4d36-8b0d-447b683247c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:13.850955 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac0d8f3-ea79-42bb-90df-b606a26d34a3 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:13.855516 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-7ac0d8f3-ea79-42bb-90df-b606a26d34a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:13.870788 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac0d8f3-ea79-42bb-90df-b606a26d34a3 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:13.897166 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:13.946538 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d7430-3f3a-47e7-bf23-46c48cc2cf6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:13.947698 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d7430-3f3a-47e7-bf23-46c48cc2cf6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:13.948116 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d7430-3f3a-47e7-bf23-46c48cc2cf6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:13.948576 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d7430-3f3a-47e7-bf23-46c48cc2cf6c admin admin] PATH_INFO: `/v3/projects/6f0484e9671a4d3ea67baf0e25e70ae2/users/35d863256ec54d53b3d8b9e8cf9c9705/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:13.956503 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9208c4-d768-4d36-8b0d-447b683247c3 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:13.962726 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92efe349-ab5c-43f8-a859-1f51e8d4425f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:13.963539 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efe349-ab5c-43f8-a859-1f51e8d4425f admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:13.964002 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efe349-ab5c-43f8-a859-1f51e8d4425f admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:13.964995 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efe349-ab5c-43f8-a859-1f51e8d4425f admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:13.966093 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92efe349-ab5c-43f8-a859-1f51e8d4425f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:13.967939 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92efe349-ab5c-43f8-a859-1f51e8d4425f admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:13.968731 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d7430-3f3a-47e7-bf23-46c48cc2cf6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f0484e9671a4d3ea67baf0e25e70ae2, user_id=35d863256ec54d53b3d8b9e8cf9c9705, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:13.972667 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d7430-3f3a-47e7-bf23-46c48cc2cf6c admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:13.987988 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 913/1824] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:13.987988 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a4def-9a94-414a-910c-885decde18c9 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:13.987988 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a4def-9a94-414a-910c-885decde18c9 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:13.987988 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a4def-9a94-414a-910c-885decde18c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:14.000533 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 912/1825] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:28:13 2022] PUT /identity/v3/projects/6f0484e9671a4d3ea67baf0e25e70ae2/users/35d863256ec54d53b3d8b9e8cf9c9705/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:14.001684 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d7430-3f3a-47e7-bf23-46c48cc2cf6c admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:14.009611 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-780a4def-9a94-414a-910c-885decde18c9 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:14.011132 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-780a4def-9a94-414a-910c-885decde18c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:14.037764 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:14.111519 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d7430-3f3a-47e7-bf23-46c48cc2cf6c admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:14.116953 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e338da-4c93-41b0-9556-aa8ca871a81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:14.117768 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e338da-4c93-41b0-9556-aa8ca871a81e admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:14.118094 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e338da-4c93-41b0-9556-aa8ca871a81e admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:14.118379 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e338da-4c93-41b0-9556-aa8ca871a81e admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:14.119091 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e338da-4c93-41b0-9556-aa8ca871a81e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:14.120980 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e338da-4c93-41b0-9556-aa8ca871a81e admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:14.132962 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 913/1826] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:14.134895 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab7cad-47f0-470b-9c9e-cd208e7401b1 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:14.135246 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab7cad-47f0-470b-9c9e-cd208e7401b1 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:14.135521 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab7cad-47f0-470b-9c9e-cd208e7401b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:14.139316 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 914/1827] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:14.140536 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a4def-9a94-414a-910c-885decde18c9 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:14.153087 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a4def-9a94-414a-910c-885decde18c9 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:14.165182 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6ba52-e212-4891-acbf-7055cb1b607e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:14.167341 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6ba52-e212-4891-acbf-7055cb1b607e admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:14.167742 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6ba52-e212-4891-acbf-7055cb1b607e admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:14.168116 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6ba52-e212-4891-acbf-7055cb1b607e admin admin] PATH_INFO: `/v3/projects/784b5f13a90a438090cd85ccad40349a/users/b58fa6b212584c90aee8216cad64c6bf/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:14.173778 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-e9ab7cad-47f0-470b-9c9e-cd208e7401b1 None None] MFA Rules not processed for user `35d863256ec54d53b3d8b9e8cf9c9705`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:14.175101 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e9ab7cad-47f0-470b-9c9e-cd208e7401b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:14.192076 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b6ba52-e212-4891-acbf-7055cb1b607e admin admin] RBAC: Authorizing `identity:create_grant(project_id=784b5f13a90a438090cd85ccad40349a, user_id=b58fa6b212584c90aee8216cad64c6bf, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:14.197235 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b6ba52-e212-4891-acbf-7055cb1b607e admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:14.231007 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 915/1828] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:28:14 2022] PUT /identity/v3/projects/784b5f13a90a438090cd85ccad40349a/users/b58fa6b212584c90aee8216cad64c6bf/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:14.250833 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6ba52-e212-4891-acbf-7055cb1b607e admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:14.253285 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-18b6ba52-e212-4891-acbf-7055cb1b607e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:14.332476 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 914/1829] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:14.334851 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17424017-a261-498d-ada5-46d732186f3d None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:14.335649 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17424017-a261-498d-ada5-46d732186f3d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:14.336172 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17424017-a261-498d-ada5-46d732186f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:14.390929 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6ba52-e212-4891-acbf-7055cb1b607e admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:14.404360 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-17424017-a261-498d-ada5-46d732186f3d None None] MFA Rules not processed for user `b58fa6b212584c90aee8216cad64c6bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:14.405967 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950f1cf-e399-4afe-bbde-8a6f327f7bf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:14.406413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-17424017-a261-498d-ada5-46d732186f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:14.409917 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950f1cf-e399-4afe-bbde-8a6f327f7bf9 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:14.410218 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950f1cf-e399-4afe-bbde-8a6f327f7bf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:14.410493 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950f1cf-e399-4afe-bbde-8a6f327f7bf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:14.547552 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 915/1830] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:14.549195 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:14.549644 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25402c9-5d2e-4476-bdbe-2acf16da1d47 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:14.550561 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25402c9-5d2e-4476-bdbe-2acf16da1d47 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:14.551054 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25402c9-5d2e-4476-bdbe-2acf16da1d47 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:14.555566 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 916/1831] 10.222.0.36 () {54 vars in 921 bytes} [Mon Aug 29 22:28:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:28:14.558879 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25402c9-5d2e-4476-bdbe-2acf16da1d47 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:14.569472 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b950f1cf-e399-4afe-bbde-8a6f327f7bf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:14.571006 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b950f1cf-e399-4afe-bbde-8a6f327f7bf9 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:14.593975 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25402c9-5d2e-4476-bdbe-2acf16da1d47 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:14.599912 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 916/1832] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:28:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:28:14.601498 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950f1cf-e399-4afe-bbde-8a6f327f7bf9 service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:14.604598 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b950f1cf-e399-4afe-bbde-8a6f327f7bf9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:14.605909 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430799c-dd7c-45d5-a72d-fca798655630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:14.606930 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430799c-dd7c-45d5-a72d-fca798655630 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:14.608326 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430799c-dd7c-45d5-a72d-fca798655630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:14.608704 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430799c-dd7c-45d5-a72d-fca798655630 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:14.609440 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1430799c-dd7c-45d5-a72d-fca798655630 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:14.614761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1430799c-dd7c-45d5-a72d-fca798655630 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:14.632482 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950f1cf-e399-4afe-bbde-8a6f327f7bf9 service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:14.653105 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d48bca-9407-4177-b794-cb0b42b24ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:14.654155 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d48bca-9407-4177-b794-cb0b42b24ae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:14.654620 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d48bca-9407-4177-b794-cb0b42b24ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:14.655236 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d48bca-9407-4177-b794-cb0b42b24ae8 admin admin] PATH_INFO: `/v3/projects/97a40c465a2f43159d8811afc8744562` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:14.659687 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d48bca-9407-4177-b794-cb0b42b24ae8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97a40c465a2f43159d8811afc8744562)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:14.663527 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d48bca-9407-4177-b794-cb0b42b24ae8 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:14.671354 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 917/1833] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:28:14 2022] POST /identity/v3/projects => generated 363 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:14.673014 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430799c-dd7c-45d5-a72d-fca798655630 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:14.713258 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:14.739099 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-21d48bca-9407-4177-b794-cb0b42b24ae8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97a40c465a2f43159d8811afc8744562', 'request_id': 'req-21d48bca-9407-4177-b794-cb0b42b24ae8'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:14.746830 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-21d48bca-9407-4177-b794-cb0b42b24ae8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97a40c465a2f43159d8811afc8744562', 'request_id': 'req-21d48bca-9407-4177-b794-cb0b42b24ae8'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:14.775631 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-21d48bca-9407-4177-b794-cb0b42b24ae8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97a40c465a2f43159d8811afc8744562', 'request_id': 'req-21d48bca-9407-4177-b794-cb0b42b24ae8'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:14.795403 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-21d48bca-9407-4177-b794-cb0b42b24ae8 admin admin] The token cache is being invalidate because project 97a40c465a2f43159d8811afc8744562 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:28:14.795757 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-21d48bca-9407-4177-b794-cb0b42b24ae8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:14.797650 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-21d48bca-9407-4177-b794-cb0b42b24ae8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:14.801479 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 917/1834] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:28:14 2022] DELETE /identity/v3/projects/97a40c465a2f43159d8811afc8744562 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:14.802766 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d48bca-9407-4177-b794-cb0b42b24ae8 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:14.805291 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-21d48bca-9407-4177-b794-cb0b42b24ae8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:14.819185 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430799c-dd7c-45d5-a72d-fca798655630 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:14.941705 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad3aa6-f3bb-4bec-953b-e782d88d03a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:14.942521 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad3aa6-f3bb-4bec-953b-e782d88d03a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:14.942894 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad3aa6-f3bb-4bec-953b-e782d88d03a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:14.943264 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad3aa6-f3bb-4bec-953b-e782d88d03a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:14.944255 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ad3aa6-f3bb-4bec-953b-e782d88d03a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:14.946535 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ad3aa6-f3bb-4bec-953b-e782d88d03a1 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:14.970176 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d48bca-9407-4177-b794-cb0b42b24ae8 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:14.975978 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dbd864-9c83-4646-a9d0-5ef8fc228d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:14.976828 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dbd864-9c83-4646-a9d0-5ef8fc228d41 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:14.977259 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dbd864-9c83-4646-a9d0-5ef8fc228d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:14.977680 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dbd864-9c83-4646-a9d0-5ef8fc228d41 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:14.978432 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dbd864-9c83-4646-a9d0-5ef8fc228d41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:14.978600 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 918/1835] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:28:14 2022] POST /identity/v3/projects => generated 363 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:14.980076 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a0bd2-5f0f-4852-99b9-5e493ebd2767 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:14.980497 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a0bd2-5f0f-4852-99b9-5e493ebd2767 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:14.980843 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a0bd2-5f0f-4852-99b9-5e493ebd2767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:14.981505 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dbd864-9c83-4646-a9d0-5ef8fc228d41 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:15.009264 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-6e3a0bd2-5f0f-4852-99b9-5e493ebd2767 None None] MFA Rules not processed for user `bce3d9397cca4ae58e14c8a5ae844f8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:15.010616 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-6e3a0bd2-5f0f-4852-99b9-5e493ebd2767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:15.011979 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 918/1836] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:28:14 2022] POST /identity/v3/users => generated 288 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:15.013615 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737bf65-f18a-4d68-99bc-89036080e25f None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:15.013966 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737bf65-f18a-4d68-99bc-89036080e25f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:15.014374 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737bf65-f18a-4d68-99bc-89036080e25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:15.041686 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-b737bf65-f18a-4d68-99bc-89036080e25f None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:15.043075 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b737bf65-f18a-4d68-99bc-89036080e25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:15.123640 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 919/1837] 10.222.0.36 () {58 vars in 1018 bytes} [Mon Aug 29 22:28:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:15.124500 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a0bd2-5f0f-4852-99b9-5e493ebd2767 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:15.125877 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-6e3a0bd2-5f0f-4852-99b9-5e493ebd2767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:15.145345 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 919/1838] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:15.146998 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b737bf65-f18a-4d68-99bc-89036080e25f None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:15.163787 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:15.168792 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b737bf65-f18a-4d68-99bc-89036080e25f None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:15.178443 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d7842c-5b3c-48f0-bc2f-50011742c4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:15.179480 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7842c-5b3c-48f0-bc2f-50011742c4fb admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:15.180937 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7842c-5b3c-48f0-bc2f-50011742c4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:15.181307 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7842c-5b3c-48f0-bc2f-50011742c4fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:15.182053 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d7842c-5b3c-48f0-bc2f-50011742c4fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:15.184211 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d7842c-5b3c-48f0-bc2f-50011742c4fb admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:15.203237 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 920/1839] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:15.205361 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e3433-c002-47a3-aeb3-e36a9e89d9f2 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:15.205730 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e3433-c002-47a3-aeb3-e36a9e89d9f2 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:15.206448 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e3433-c002-47a3-aeb3-e36a9e89d9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:15.211920 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:15.238843 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-632e3433-c002-47a3-aeb3-e36a9e89d9f2 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:15.240274 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-632e3433-c002-47a3-aeb3-e36a9e89d9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:15.250534 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 921/1840] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:15.252023 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8827d-958a-472d-ae4f-47c26326c687 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:15.252366 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8827d-958a-472d-ae4f-47c26326c687 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:15.252795 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a0bd2-5f0f-4852-99b9-5e493ebd2767 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:15.254888 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8827d-958a-472d-ae4f-47c26326c687 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:15.264565 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b85e3fd-e4d5-4ae0-8251-a472eff40c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:15.265387 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85e3fd-e4d5-4ae0-8251-a472eff40c3c admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:15.265675 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85e3fd-e4d5-4ae0-8251-a472eff40c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:15.265948 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85e3fd-e4d5-4ae0-8251-a472eff40c3c admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:15.266635 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b85e3fd-e4d5-4ae0-8251-a472eff40c3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:15.268950 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b85e3fd-e4d5-4ae0-8251-a472eff40c3c admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:15.275294 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 922/1841] 10.222.0.36 () {54 vars in 961 bytes} [Mon Aug 29 22:28:15 2022] GET /identity => generated 270 bytes in 24 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:28:15.279234 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c8827d-958a-472d-ae4f-47c26326c687 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:15.305010 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c8827d-958a-472d-ae4f-47c26326c687 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:15.312198 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c652d488-3465-42a9-9a7b-59dba7f6193a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:15.313143 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c652d488-3465-42a9-9a7b-59dba7f6193a admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:15.313724 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c652d488-3465-42a9-9a7b-59dba7f6193a admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:15.313954 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c652d488-3465-42a9-9a7b-59dba7f6193a admin admin] PATH_INFO: `/v3/projects/48453b41a76a4b90b266118b0153221d/users/aa2d28322feb4739b1fe9a2b2d60440d/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:15.314791 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 920/1842] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:28:15 2022] POST /identity/v3/users => generated 288 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:15.317907 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b85e3fd-e4d5-4ae0-8251-a472eff40c3c admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:15.334754 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c652d488-3465-42a9-9a7b-59dba7f6193a admin admin] RBAC: Authorizing `identity:create_grant(project_id=48453b41a76a4b90b266118b0153221d, user_id=aa2d28322feb4739b1fe9a2b2d60440d, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:15.336051 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b85e3fd-e4d5-4ae0-8251-a472eff40c3c admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:15.338567 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c652d488-3465-42a9-9a7b-59dba7f6193a admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:15.346780 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48581977-e891-4d6c-97d0-e733d9ce3c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:15.347680 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48581977-e891-4d6c-97d0-e733d9ce3c44 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:15.347988 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48581977-e891-4d6c-97d0-e733d9ce3c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:15.348265 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48581977-e891-4d6c-97d0-e733d9ce3c44 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:15.349995 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48581977-e891-4d6c-97d0-e733d9ce3c44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:28:15.350310 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48581977-e891-4d6c-97d0-e733d9ce3c44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:15.352082 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48581977-e891-4d6c-97d0-e733d9ce3c44 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:15.364859 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 923/1843] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:28:15 2022] PUT /identity/v3/projects/48453b41a76a4b90b266118b0153221d/users/aa2d28322feb4739b1fe9a2b2d60440d/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:15.366569 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a74c1-7dc6-4361-a50d-ef9c287fb8a3 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:15.367094 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a74c1-7dc6-4361-a50d-ef9c287fb8a3 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:15.367561 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a74c1-7dc6-4361-a50d-ef9c287fb8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:15.373948 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 921/1844] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:28:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:28:15.374936 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48581977-e891-4d6c-97d0-e733d9ce3c44 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:15.393918 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48581977-e891-4d6c-97d0-e733d9ce3c44 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:15.397398 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-df4a74c1-7dc6-4361-a50d-ef9c287fb8a3 None None] MFA Rules not processed for user `bce3d9397cca4ae58e14c8a5ae844f8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:15.398968 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-df4a74c1-7dc6-4361-a50d-ef9c287fb8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:15.483645 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f7508-2360-4689-92d4-424a77a78c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:15.484319 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f7508-2360-4689-92d4-424a77a78c86 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:15.484670 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f7508-2360-4689-92d4-424a77a78c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:15.484945 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f7508-2360-4689-92d4-424a77a78c86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:15.485619 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0f7508-2360-4689-92d4-424a77a78c86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:15.487363 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0f7508-2360-4689-92d4-424a77a78c86 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:15.489787 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 924/1845] 10.222.0.36 () {58 vars in 1058 bytes} [Mon Aug 29 22:28:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:15.490844 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4a74c1-7dc6-4361-a50d-ef9c287fb8a3 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:15.528653 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4a74c1-7dc6-4361-a50d-ef9c287fb8a3 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:15.531073 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 922/1846] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:15.532205 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f7508-2360-4689-92d4-424a77a78c86 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:15.533813 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e08127-a121-4438-875e-f59ed13e95f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:15.534779 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e08127-a121-4438-875e-f59ed13e95f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:15.535127 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e08127-a121-4438-875e-f59ed13e95f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:15.535458 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e08127-a121-4438-875e-f59ed13e95f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:15.536173 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e08127-a121-4438-875e-f59ed13e95f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:15.537882 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e08127-a121-4438-875e-f59ed13e95f4 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:15.546909 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f7508-2360-4689-92d4-424a77a78c86 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:15.554449 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 925/1847] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:15.555319 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a80dd3-2fd3-4b09-8a36-666e4acc19bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:15.556076 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e08127-a121-4438-875e-f59ed13e95f4 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:15.556401 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a80dd3-2fd3-4b09-8a36-666e4acc19bd admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:15.556859 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a80dd3-2fd3-4b09-8a36-666e4acc19bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:15.557341 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a80dd3-2fd3-4b09-8a36-666e4acc19bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:15.558547 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-95e08127-a121-4438-875e-f59ed13e95f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:15.559618 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a80dd3-2fd3-4b09-8a36-666e4acc19bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:15.562032 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a80dd3-2fd3-4b09-8a36-666e4acc19bd admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:15.572976 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e08127-a121-4438-875e-f59ed13e95f4 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:15.580302 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd42c92-b361-449d-bae1-77e9519cc959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:15.581125 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd42c92-b361-449d-bae1-77e9519cc959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:15.581515 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd42c92-b361-449d-bae1-77e9519cc959 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:15.582545 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd42c92-b361-449d-bae1-77e9519cc959 admin admin] PATH_INFO: `/v3/projects/41596bd1a44847ee85ff66ab08b11c62` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:15.585099 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd42c92-b361-449d-bae1-77e9519cc959 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41596bd1a44847ee85ff66ab08b11c62)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:15.588168 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd42c92-b361-449d-bae1-77e9519cc959 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:15.604519 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 923/1848] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:28:15 2022] POST /identity/v3/projects => generated 381 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:15.606700 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a80dd3-2fd3-4b09-8a36-666e4acc19bd admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:15.684432 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8cd42c92-b361-449d-bae1-77e9519cc959 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41596bd1a44847ee85ff66ab08b11c62', 'request_id': 'req-8cd42c92-b361-449d-bae1-77e9519cc959'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:15.694608 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8cd42c92-b361-449d-bae1-77e9519cc959 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41596bd1a44847ee85ff66ab08b11c62', 'request_id': 'req-8cd42c92-b361-449d-bae1-77e9519cc959'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:15.713155 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8cd42c92-b361-449d-bae1-77e9519cc959 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41596bd1a44847ee85ff66ab08b11c62', 'request_id': 'req-8cd42c92-b361-449d-bae1-77e9519cc959'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:15.713928 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a80dd3-2fd3-4b09-8a36-666e4acc19bd admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:15.735900 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8cd42c92-b361-449d-bae1-77e9519cc959 admin admin] The token cache is being invalidate because project 41596bd1a44847ee85ff66ab08b11c62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:28:15.736869 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8cd42c92-b361-449d-bae1-77e9519cc959 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:15.739006 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8cd42c92-b361-449d-bae1-77e9519cc959 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:15.745799 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 926/1849] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:28:15 2022] DELETE /identity/v3/projects/41596bd1a44847ee85ff66ab08b11c62 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:15.749818 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd42c92-b361-449d-bae1-77e9519cc959 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:15.753403 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-8cd42c92-b361-449d-bae1-77e9519cc959 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:15.775815 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:15.811758 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:15.834409 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c895225-080c-4b68-be2d-399eb66463cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce3d9397cca4ae58e14c8a5ae844f8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:15.834409 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c895225-080c-4b68-be2d-399eb66463cb service placement] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:15.834409 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c895225-080c-4b68-be2d-399eb66463cb service placement] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:15.834409 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c895225-080c-4b68-be2d-399eb66463cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:15.835805 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-9c895225-080c-4b68-be2d-399eb66463cb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:15.848024 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c895225-080c-4b68-be2d-399eb66463cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:15.849842 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c895225-080c-4b68-be2d-399eb66463cb service placement] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:15.862117 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd42c92-b361-449d-bae1-77e9519cc959 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:15.863180 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 924/1850] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:28:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:28:15.863840 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c895225-080c-4b68-be2d-399eb66463cb service placement] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:15.865346 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-9c895225-080c-4b68-be2d-399eb66463cb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:15.867235 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361cbb9-6d06-4bc6-a810-6995a444fc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:15.867990 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361cbb9-6d06-4bc6-a810-6995a444fc23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:15.868339 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361cbb9-6d06-4bc6-a810-6995a444fc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:15.868713 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361cbb9-6d06-4bc6-a810-6995a444fc23 admin admin] PATH_INFO: `/v3/projects/94134057948f4337ba89ac1d32fede8b/users/e160796d4a634974b25ffb527c855398/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:15.886518 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c895225-080c-4b68-be2d-399eb66463cb service placement] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:15.887257 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361cbb9-6d06-4bc6-a810-6995a444fc23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94134057948f4337ba89ac1d32fede8b, user_id=e160796d4a634974b25ffb527c855398, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:15.890366 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361cbb9-6d06-4bc6-a810-6995a444fc23 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:15.913426 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 927/1851] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:28:15 2022] PUT /identity/v3/projects/94134057948f4337ba89ac1d32fede8b/users/e160796d4a634974b25ffb527c855398/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:15.914491 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361cbb9-6d06-4bc6-a810-6995a444fc23 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:15.914606 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e1e91-ea8e-4ecf-ba7d-da5e5df40687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:15.915496 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e1e91-ea8e-4ecf-ba7d-da5e5df40687 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:15.915737 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e1e91-ea8e-4ecf-ba7d-da5e5df40687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:15.916013 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e1e91-ea8e-4ecf-ba7d-da5e5df40687 admin admin] PATH_INFO: `/v3/projects/48453b41a76a4b90b266118b0153221d/users/aa2d28322feb4739b1fe9a2b2d60440d/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:15.916317 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f361cbb9-6d06-4bc6-a810-6995a444fc23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:15.919433 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e1e91-ea8e-4ecf-ba7d-da5e5df40687 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48453b41a76a4b90b266118b0153221d, user_id=aa2d28322feb4739b1fe9a2b2d60440d, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:15.923015 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e1e91-ea8e-4ecf-ba7d-da5e5df40687 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:15.947634 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 925/1852] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:28:15 2022] PUT /identity/v3/projects/48453b41a76a4b90b266118b0153221d/users/aa2d28322feb4739b1fe9a2b2d60440d/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:15.947634 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918838eb-c35f-4ec0-951a-fbd2ac42a512 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:15.947634 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918838eb-c35f-4ec0-951a-fbd2ac42a512 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:15.947634 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918838eb-c35f-4ec0-951a-fbd2ac42a512 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:15.947634 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 926/1853] 10.222.0.36 () {54 vars in 921 bytes} [Mon Aug 29 22:28:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:28:15.947634 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918838eb-c35f-4ec0-951a-fbd2ac42a512 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:15.948285 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-918838eb-c35f-4ec0-951a-fbd2ac42a512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:16.016375 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361cbb9-6d06-4bc6-a810-6995a444fc23 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:16.057842 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918838eb-c35f-4ec0-951a-fbd2ac42a512 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:16.064049 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf3ec4-c8b3-479e-a07f-dbc2dd7eac0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:16.064902 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf3ec4-c8b3-479e-a07f-dbc2dd7eac0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:16.065623 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf3ec4-c8b3-479e-a07f-dbc2dd7eac0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:16.065890 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf3ec4-c8b3-479e-a07f-dbc2dd7eac0d admin admin] PATH_INFO: `/v3/users/afbad079017a47eab404494e2d70751e` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:16.068294 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bf3ec4-c8b3-479e-a07f-dbc2dd7eac0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=afbad079017a47eab404494e2d70751e)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:16.070241 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bf3ec4-c8b3-479e-a07f-dbc2dd7eac0d admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:16.114895 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada1f9c2-6c06-4a5c-883f-2cb08d950fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:16.115747 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1f9c2-6c06-4a5c-883f-2cb08d950fd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:16.116135 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1f9c2-6c06-4a5c-883f-2cb08d950fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:16.116603 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1f9c2-6c06-4a5c-883f-2cb08d950fd5 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:16.118747 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada1f9c2-6c06-4a5c-883f-2cb08d950fd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:16.121272 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada1f9c2-6c06-4a5c-883f-2cb08d950fd5 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:16.160795 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f4bf3ec4-c8b3-479e-a07f-dbc2dd7eac0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afbad079017a47eab404494e2d70751e'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:16.165121 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 928/1854] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:28:15 2022] POST /identity/v3/users => generated 291 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:16.165121 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada1f9c2-6c06-4a5c-883f-2cb08d950fd5 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:16.170032 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ada1f9c2-6c06-4a5c-883f-2cb08d950fd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:16.178607 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f4bf3ec4-c8b3-479e-a07f-dbc2dd7eac0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afbad079017a47eab404494e2d70751e'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:16.191006 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f4bf3ec4-c8b3-479e-a07f-dbc2dd7eac0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afbad079017a47eab404494e2d70751e'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:16.191933 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada1f9c2-6c06-4a5c-883f-2cb08d950fd5 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:16.192694 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f4bf3ec4-c8b3-479e-a07f-dbc2dd7eac0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afbad079017a47eab404494e2d70751e'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:16.200091 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1214a56b-e406-4343-bd2b-e7822a27dc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:16.201584 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1214a56b-e406-4343-bd2b-e7822a27dc40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:16.201862 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1214a56b-e406-4343-bd2b-e7822a27dc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:16.202145 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1214a56b-e406-4343-bd2b-e7822a27dc40 admin admin] PATH_INFO: `/v3/users/52ceb68d67dd47a3ac2abc533744e3ba` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:16.203682 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1214a56b-e406-4343-bd2b-e7822a27dc40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52ceb68d67dd47a3ac2abc533744e3ba)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:16.209329 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1214a56b-e406-4343-bd2b-e7822a27dc40 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:16.213973 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f4bf3ec4-c8b3-479e-a07f-dbc2dd7eac0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afbad079017a47eab404494e2d70751e'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:16.227671 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 927/1855] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:28:15 2022] DELETE /identity/v3/users/afbad079017a47eab404494e2d70751e => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:16.229013 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf3ec4-c8b3-479e-a07f-dbc2dd7eac0d admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:16.230687 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f4bf3ec4-c8b3-479e-a07f-dbc2dd7eac0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:16.293910 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:16.297106 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-1214a56b-e406-4343-bd2b-e7822a27dc40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52ceb68d67dd47a3ac2abc533744e3ba'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:16.304222 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:16.313412 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-1214a56b-e406-4343-bd2b-e7822a27dc40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52ceb68d67dd47a3ac2abc533744e3ba'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:16.315119 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-1214a56b-e406-4343-bd2b-e7822a27dc40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52ceb68d67dd47a3ac2abc533744e3ba'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:16.330895 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-1214a56b-e406-4343-bd2b-e7822a27dc40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52ceb68d67dd47a3ac2abc533744e3ba'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:16.331949 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-1214a56b-e406-4343-bd2b-e7822a27dc40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52ceb68d67dd47a3ac2abc533744e3ba'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:16.366370 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 929/1856] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:28:16 2022] DELETE /identity/v3/users/52ceb68d67dd47a3ac2abc533744e3ba => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:16.368378 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba816e78-e238-49e6-9605-83bc70ee6a38 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:16.368917 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba816e78-e238-49e6-9605-83bc70ee6a38 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:16.369355 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba816e78-e238-49e6-9605-83bc70ee6a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:16.369866 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf3ec4-c8b3-479e-a07f-dbc2dd7eac0d admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:16.401462 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-ba816e78-e238-49e6-9605-83bc70ee6a38 None None] MFA Rules not processed for user `bce3d9397cca4ae58e14c8a5ae844f8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:16.403452 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ba816e78-e238-49e6-9605-83bc70ee6a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:16.492909 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6490c3b-4a19-4563-90c1-7c45f5e673dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:16.493540 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6490c3b-4a19-4563-90c1-7c45f5e673dc admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:16.493823 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6490c3b-4a19-4563-90c1-7c45f5e673dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:16.494098 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6490c3b-4a19-4563-90c1-7c45f5e673dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:16.494806 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6490c3b-4a19-4563-90c1-7c45f5e673dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:16.498742 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6490c3b-4a19-4563-90c1-7c45f5e673dc admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:16.515996 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 928/1857] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:16.521918 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f801ef-3ee5-4b11-aee9-bdb45e54369e None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:16.521918 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f801ef-3ee5-4b11-aee9-bdb45e54369e None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:16.521918 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f801ef-3ee5-4b11-aee9-bdb45e54369e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:16.544407 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 930/1858] 10.222.0.36 () {58 vars in 1018 bytes} [Mon Aug 29 22:28:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:16.545748 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406ea70-2cf9-4dfd-bb0e-510ad058d7db None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:16.546032 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406ea70-2cf9-4dfd-bb0e-510ad058d7db None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:16.546303 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406ea70-2cf9-4dfd-bb0e-510ad058d7db None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:16.547879 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 931/1859] 10.222.0.36 () {54 vars in 921 bytes} [Mon Aug 29 22:28:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:28:16.549414 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406ea70-2cf9-4dfd-bb0e-510ad058d7db None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:16.551420 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-4406ea70-2cf9-4dfd-bb0e-510ad058d7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:16.566491 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-97f801ef-3ee5-4b11-aee9-bdb45e54369e None None] MFA Rules not processed for user `aa2d28322feb4739b1fe9a2b2d60440d`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:16.568244 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-97f801ef-3ee5-4b11-aee9-bdb45e54369e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:16.569611 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406ea70-2cf9-4dfd-bb0e-510ad058d7db None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:16.579880 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df67504-49ab-404a-92ad-f3e35ff1a14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:16.580935 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df67504-49ab-404a-92ad-f3e35ff1a14d admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:16.581325 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df67504-49ab-404a-92ad-f3e35ff1a14d admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:16.581737 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df67504-49ab-404a-92ad-f3e35ff1a14d admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:16.582553 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df67504-49ab-404a-92ad-f3e35ff1a14d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:16.584954 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df67504-49ab-404a-92ad-f3e35ff1a14d admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:16.600888 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 932/1860] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:16.603561 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df67504-49ab-404a-92ad-f3e35ff1a14d admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:16.610041 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-2df67504-49ab-404a-92ad-f3e35ff1a14d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:16.629132 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df67504-49ab-404a-92ad-f3e35ff1a14d admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:16.636817 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc0e3a9-8419-463c-bfa7-100664a0b7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:16.638246 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc0e3a9-8419-463c-bfa7-100664a0b7c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:16.638853 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc0e3a9-8419-463c-bfa7-100664a0b7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:16.639333 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc0e3a9-8419-463c-bfa7-100664a0b7c2 admin admin] PATH_INFO: `/v3/projects/94134057948f4337ba89ac1d32fede8b/users/e160796d4a634974b25ffb527c855398/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:16.641696 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc0e3a9-8419-463c-bfa7-100664a0b7c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94134057948f4337ba89ac1d32fede8b, user_id=e160796d4a634974b25ffb527c855398, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:16.646148 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc0e3a9-8419-463c-bfa7-100664a0b7c2 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:16.661064 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 933/1861] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:28:16 2022] PUT /identity/v3/projects/94134057948f4337ba89ac1d32fede8b/users/e160796d4a634974b25ffb527c855398/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:16.662581 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc0e3a9-8419-463c-bfa7-100664a0b7c2 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:16.684515 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 929/1862] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:16 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:16.686380 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f801ef-3ee5-4b11-aee9-bdb45e54369e None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:16.691109 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-97f801ef-3ee5-4b11-aee9-bdb45e54369e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:16.713404 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f801ef-3ee5-4b11-aee9-bdb45e54369e None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:16.800441 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:16.807829 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc0e3a9-8419-463c-bfa7-100664a0b7c2 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:16.809315 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc58b0-42de-4346-949c-41bfa035aaea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce3d9397cca4ae58e14c8a5ae844f8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:16.810020 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc58b0-42de-4346-949c-41bfa035aaea service placement] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:16.810313 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc58b0-42de-4346-949c-41bfa035aaea service placement] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:16.810554 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc58b0-42de-4346-949c-41bfa035aaea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:16.822243 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b5d64-4d1c-4aa4-8771-800c047f30be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:16.823119 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b5d64-4d1c-4aa4-8771-800c047f30be admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:16.823655 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b5d64-4d1c-4aa4-8771-800c047f30be admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:16.823793 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fc58b0-42de-4346-949c-41bfa035aaea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:16.824300 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b5d64-4d1c-4aa4-8771-800c047f30be admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:16.825405 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320b5d64-4d1c-4aa4-8771-800c047f30be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:16.828050 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fc58b0-42de-4346-949c-41bfa035aaea service placement] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:16.828372 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320b5d64-4d1c-4aa4-8771-800c047f30be admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:16.845604 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 934/1863] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:16.851706 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb423ab-d53c-4300-b996-a14d00e7a44c None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:16.852261 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb423ab-d53c-4300-b996-a14d00e7a44c None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:16.852751 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb423ab-d53c-4300-b996-a14d00e7a44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:16.860479 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 930/1864] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:28:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:28:16.862384 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32321278-6cf3-44af-bd5f-935e2633c1d5 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:16.866085 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32321278-6cf3-44af-bd5f-935e2633c1d5 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:16.866465 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32321278-6cf3-44af-bd5f-935e2633c1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:16.887351 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-6cb423ab-d53c-4300-b996-a14d00e7a44c None None] MFA Rules not processed for user `90b7213b7111456a93e294ce40b95b21`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:16.887726 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-6cb423ab-d53c-4300-b996-a14d00e7a44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:16.930612 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-32321278-6cf3-44af-bd5f-935e2633c1d5 None None] MFA Rules not processed for user `e160796d4a634974b25ffb527c855398`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:16.932661 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-32321278-6cf3-44af-bd5f-935e2633c1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:16.961340 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:17.033100 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 935/1865] 10.222.0.36 () {58 vars in 1018 bytes} [Mon Aug 29 22:28:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:17.034462 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb423ab-d53c-4300-b996-a14d00e7a44c None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:17.035890 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-6cb423ab-d53c-4300-b996-a14d00e7a44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:17.044753 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 931/1866] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:16 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:17.046054 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32321278-6cf3-44af-bd5f-935e2633c1d5 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:17.058398 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32321278-6cf3-44af-bd5f-935e2633c1d5 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:17.067728 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4b27f-cb53-495e-92a2-5d581b01fb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:17.068702 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4b27f-cb53-495e-92a2-5d581b01fb5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:17.078348 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4b27f-cb53-495e-92a2-5d581b01fb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:17.078348 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4b27f-cb53-495e-92a2-5d581b01fb5f admin admin] PATH_INFO: `/v3/projects/5ed35a2860724a15949b44313b3816de/users/6f311a131c1244e494238a6470e79713/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:17.098396 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd4b27f-cb53-495e-92a2-5d581b01fb5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ed35a2860724a15949b44313b3816de, user_id=6f311a131c1244e494238a6470e79713, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:17.101347 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd4b27f-cb53-495e-92a2-5d581b01fb5f admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:17.132478 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 932/1867] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:28:17 2022] PUT /identity/v3/projects/5ed35a2860724a15949b44313b3816de/users/6f311a131c1244e494238a6470e79713/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:17.132478 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4b27f-cb53-495e-92a2-5d581b01fb5f admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:17.138344 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-9dd4b27f-cb53-495e-92a2-5d581b01fb5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:17.165768 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb423ab-d53c-4300-b996-a14d00e7a44c None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:17.248014 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32928a3-9e02-4f1a-9482-9783c40aead5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:17.249044 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32928a3-9e02-4f1a-9482-9783c40aead5 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:17.251147 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32928a3-9e02-4f1a-9482-9783c40aead5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:17.251450 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32928a3-9e02-4f1a-9482-9783c40aead5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:17.280557 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4b27f-cb53-495e-92a2-5d581b01fb5f admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:17.286752 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68f256-adc0-4be2-89af-84679f49379f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:17.287554 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68f256-adc0-4be2-89af-84679f49379f service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:17.288077 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68f256-adc0-4be2-89af-84679f49379f service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:17.288376 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68f256-adc0-4be2-89af-84679f49379f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:17.395879 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32928a3-9e02-4f1a-9482-9783c40aead5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:17.398203 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32928a3-9e02-4f1a-9482-9783c40aead5 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:17.413338 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 936/1868] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:28:17 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:28:17.414163 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32928a3-9e02-4f1a-9482-9783c40aead5 service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:17.415813 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-e32928a3-9e02-4f1a-9482-9783c40aead5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:17.420188 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a68f256-adc0-4be2-89af-84679f49379f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:17.421834 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a68f256-adc0-4be2-89af-84679f49379f service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:17.439236 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 933/1869] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:28:17 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:28:17.441050 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bafaf4-7181-4baa-bd41-a694942ac701 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:17.441610 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bafaf4-7181-4baa-bd41-a694942ac701 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:17.442087 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bafaf4-7181-4baa-bd41-a694942ac701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:17.451415 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:17.492044 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:17.506253 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-b0bafaf4-7181-4baa-bd41-a694942ac701 None None] MFA Rules not processed for user `6f311a131c1244e494238a6470e79713`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:17.511221 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b0bafaf4-7181-4baa-bd41-a694942ac701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:17.599556 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32928a3-9e02-4f1a-9482-9783c40aead5 service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:17.614035 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0515d262-8a42-4bd8-9c1c-6e27a8486fca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b7213b7111456a93e294ce40b95b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:17.615161 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515d262-8a42-4bd8-9c1c-6e27a8486fca service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:17.616317 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515d262-8a42-4bd8-9c1c-6e27a8486fca service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:17.616864 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515d262-8a42-4bd8-9c1c-6e27a8486fca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:17.634872 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0515d262-8a42-4bd8-9c1c-6e27a8486fca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:17.641157 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0515d262-8a42-4bd8-9c1c-6e27a8486fca service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:17.653690 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 934/1870] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:17.654650 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bafaf4-7181-4baa-bd41-a694942ac701 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:17.661216 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b0bafaf4-7181-4baa-bd41-a694942ac701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:17.663171 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 937/1871] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:28:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:28:17.675719 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0515d262-8a42-4bd8-9c1c-6e27a8486fca service nova] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:17.699292 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0515d262-8a42-4bd8-9c1c-6e27a8486fca service nova] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:17.703503 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5efb0ff-6e0c-407b-8bda-4954a0d086fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:17.704314 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5efb0ff-6e0c-407b-8bda-4954a0d086fa service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:17.704670 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5efb0ff-6e0c-407b-8bda-4954a0d086fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:17.705014 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5efb0ff-6e0c-407b-8bda-4954a0d086fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:17.706862 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d5efb0ff-6e0c-407b-8bda-4954a0d086fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:17.780935 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bafaf4-7181-4baa-bd41-a694942ac701 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:17.788915 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf5ec56-7f88-40a3-adaf-3d1fde2e2c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:17.790236 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5efb0ff-6e0c-407b-8bda-4954a0d086fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:17.790531 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5ec56-7f88-40a3-adaf-3d1fde2e2c7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:17.790816 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5ec56-7f88-40a3-adaf-3d1fde2e2c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:17.791091 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5ec56-7f88-40a3-adaf-3d1fde2e2c7f admin admin] PATH_INFO: `/v3/projects/5a8593cb30f546b08abcdcfb00d2dbf3` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:17.792202 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5efb0ff-6e0c-407b-8bda-4954a0d086fa service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:17.792524 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf5ec56-7f88-40a3-adaf-3d1fde2e2c7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a8593cb30f546b08abcdcfb00d2dbf3)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:17.795539 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf5ec56-7f88-40a3-adaf-3d1fde2e2c7f admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:17.805165 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 938/1872] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:28:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:28:17.806590 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5efb0ff-6e0c-407b-8bda-4954a0d086fa service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:17.819240 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5efb0ff-6e0c-407b-8bda-4954a0d086fa service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:17.827772 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0d8b9-8d4a-4260-96bc-f7618285ec8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:17.828988 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0d8b9-8d4a-4260-96bc-f7618285ec8c service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:17.830993 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0d8b9-8d4a-4260-96bc-f7618285ec8c service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:17.831915 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0d8b9-8d4a-4260-96bc-f7618285ec8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:17.838666 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-72b0d8b9-8d4a-4260-96bc-f7618285ec8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:17.914507 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-daf5ec56-7f88-40a3-adaf-3d1fde2e2c7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a8593cb30f546b08abcdcfb00d2dbf3', 'request_id': 'req-daf5ec56-7f88-40a3-adaf-3d1fde2e2c7f'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:17.922021 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-daf5ec56-7f88-40a3-adaf-3d1fde2e2c7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a8593cb30f546b08abcdcfb00d2dbf3', 'request_id': 'req-daf5ec56-7f88-40a3-adaf-3d1fde2e2c7f'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:17.930273 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-daf5ec56-7f88-40a3-adaf-3d1fde2e2c7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a8593cb30f546b08abcdcfb00d2dbf3', 'request_id': 'req-daf5ec56-7f88-40a3-adaf-3d1fde2e2c7f'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:17.958188 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-daf5ec56-7f88-40a3-adaf-3d1fde2e2c7f admin admin] The token cache is being invalidate because project 5a8593cb30f546b08abcdcfb00d2dbf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:28:17.958492 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-daf5ec56-7f88-40a3-adaf-3d1fde2e2c7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:17.959476 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-daf5ec56-7f88-40a3-adaf-3d1fde2e2c7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:17.968320 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 935/1873] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:28:17 2022] DELETE /identity/v3/projects/5a8593cb30f546b08abcdcfb00d2dbf3 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:17.968320 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf5ec56-7f88-40a3-adaf-3d1fde2e2c7f admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:17.968563 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b0d8b9-8d4a-4260-96bc-f7618285ec8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:17.968926 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-daf5ec56-7f88-40a3-adaf-3d1fde2e2c7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:17.969843 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b0d8b9-8d4a-4260-96bc-f7618285ec8c service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:17.996905 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 939/1874] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:28:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:28:17.998018 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0d8b9-8d4a-4260-96bc-f7618285ec8c service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:18.029623 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0d8b9-8d4a-4260-96bc-f7618285ec8c service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:18.038676 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:18.177349 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf5ec56-7f88-40a3-adaf-3d1fde2e2c7f admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:18.186519 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8042d6e-0571-4027-8d8d-365e6495c45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:18.187287 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8042d6e-0571-4027-8d8d-365e6495c45b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:18.187642 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8042d6e-0571-4027-8d8d-365e6495c45b admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:18.187978 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8042d6e-0571-4027-8d8d-365e6495c45b admin admin] PATH_INFO: `/v3/projects/0da6f3f19ba447728ee6350bb5006977` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:18.193454 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8042d6e-0571-4027-8d8d-365e6495c45b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0da6f3f19ba447728ee6350bb5006977)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:18.196115 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8042d6e-0571-4027-8d8d-365e6495c45b admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:18.203621 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:18.236377 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87026c7-fcbb-485b-b945-da0a03847a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:18.237164 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87026c7-fcbb-485b-b945-da0a03847a19 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:18.237639 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87026c7-fcbb-485b-b945-da0a03847a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:18.237930 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87026c7-fcbb-485b-b945-da0a03847a19 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:18.238679 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87026c7-fcbb-485b-b945-da0a03847a19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:18.241802 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87026c7-fcbb-485b-b945-da0a03847a19 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:18.312331 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 940/1875] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:28:17 2022] POST /identity/v3/projects => generated 383 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:18.314165 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87026c7-fcbb-485b-b945-da0a03847a19 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:18.317012 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f8042d6e-0571-4027-8d8d-365e6495c45b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0da6f3f19ba447728ee6350bb5006977', 'request_id': 'req-f8042d6e-0571-4027-8d8d-365e6495c45b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:18.317546 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f87026c7-fcbb-485b-b945-da0a03847a19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:18.332137 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f8042d6e-0571-4027-8d8d-365e6495c45b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0da6f3f19ba447728ee6350bb5006977', 'request_id': 'req-f8042d6e-0571-4027-8d8d-365e6495c45b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:18.342997 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f8042d6e-0571-4027-8d8d-365e6495c45b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0da6f3f19ba447728ee6350bb5006977', 'request_id': 'req-f8042d6e-0571-4027-8d8d-365e6495c45b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:18.370400 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f8042d6e-0571-4027-8d8d-365e6495c45b admin admin] The token cache is being invalidate because project 0da6f3f19ba447728ee6350bb5006977 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:28:18.370892 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f8042d6e-0571-4027-8d8d-365e6495c45b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:18.373840 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f8042d6e-0571-4027-8d8d-365e6495c45b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:18.379911 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 936/1876] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:28:17 2022] DELETE /identity/v3/projects/0da6f3f19ba447728ee6350bb5006977 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:18.379911 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8042d6e-0571-4027-8d8d-365e6495c45b admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:18.385924 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f8042d6e-0571-4027-8d8d-365e6495c45b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:18.471544 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87026c7-fcbb-485b-b945-da0a03847a19 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:18.483876 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8707f59-261e-4348-8752-02bd5e2809e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:18.484767 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8707f59-261e-4348-8752-02bd5e2809e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:18.485049 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8707f59-261e-4348-8752-02bd5e2809e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:18.485324 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8707f59-261e-4348-8752-02bd5e2809e7 admin admin] PATH_INFO: `/v3/users/f687db21c04d47e4a1da394c1b413caa` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:18.487172 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8707f59-261e-4348-8752-02bd5e2809e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f687db21c04d47e4a1da394c1b413caa)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:18.489266 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8707f59-261e-4348-8752-02bd5e2809e7 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:18.573525 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-a8707f59-261e-4348-8752-02bd5e2809e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f687db21c04d47e4a1da394c1b413caa'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:18.591355 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-a8707f59-261e-4348-8752-02bd5e2809e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f687db21c04d47e4a1da394c1b413caa'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:18.592264 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-a8707f59-261e-4348-8752-02bd5e2809e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f687db21c04d47e4a1da394c1b413caa'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:18.597680 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8042d6e-0571-4027-8d8d-365e6495c45b admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:18.606858 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-a8707f59-261e-4348-8752-02bd5e2809e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f687db21c04d47e4a1da394c1b413caa'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:18.607860 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-a8707f59-261e-4348-8752-02bd5e2809e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f687db21c04d47e4a1da394c1b413caa'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:18.608113 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb851ce5-7bb5-4621-8a69-0ecf9d24019b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:18.608767 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb851ce5-7bb5-4621-8a69-0ecf9d24019b admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:18.609052 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb851ce5-7bb5-4621-8a69-0ecf9d24019b admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:18.609325 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb851ce5-7bb5-4621-8a69-0ecf9d24019b admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:18.609972 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb851ce5-7bb5-4621-8a69-0ecf9d24019b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:18.613507 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb851ce5-7bb5-4621-8a69-0ecf9d24019b admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:18.640914 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 941/1877] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:28:18 2022] DELETE /identity/v3/users/f687db21c04d47e4a1da394c1b413caa => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:18.642754 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd0465-7d71-400b-a84b-4f44c3a2dec4 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:18.643266 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 937/1878] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:28:18 2022] POST /identity/v3/users => generated 298 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:18.643420 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd0465-7d71-400b-a84b-4f44c3a2dec4 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:18.643714 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd0465-7d71-400b-a84b-4f44c3a2dec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:18.646985 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb851ce5-7bb5-4621-8a69-0ecf9d24019b admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:18.648952 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-eb851ce5-7bb5-4621-8a69-0ecf9d24019b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:18.666479 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb851ce5-7bb5-4621-8a69-0ecf9d24019b admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:18.667886 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-adfd0465-7d71-400b-a84b-4f44c3a2dec4 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:18.669482 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-adfd0465-7d71-400b-a84b-4f44c3a2dec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:18.730423 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:18.741005 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:18.755313 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f66ed56-25cf-4b94-82da-83ca14513439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:18.756257 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66ed56-25cf-4b94-82da-83ca14513439 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:18.756570 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66ed56-25cf-4b94-82da-83ca14513439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:18.756840 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66ed56-25cf-4b94-82da-83ca14513439 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:18.757491 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f66ed56-25cf-4b94-82da-83ca14513439 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:18.759771 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f66ed56-25cf-4b94-82da-83ca14513439 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:18.766831 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 942/1879] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:18.769063 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b512e98d-73e7-4aff-9504-8affe74f6ed1 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:18.769425 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b512e98d-73e7-4aff-9504-8affe74f6ed1 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:18.769765 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b512e98d-73e7-4aff-9504-8affe74f6ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:18.774935 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 938/1880] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:18.776014 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f66ed56-25cf-4b94-82da-83ca14513439 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:18.788188 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f66ed56-25cf-4b94-82da-83ca14513439 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:18.793297 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ffd15-4ae9-4505-8c4c-3ed54b33bb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:18.793907 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ffd15-4ae9-4505-8c4c-3ed54b33bb96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:18.794189 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ffd15-4ae9-4505-8c4c-3ed54b33bb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:18.794464 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ffd15-4ae9-4505-8c4c-3ed54b33bb96 admin admin] PATH_INFO: `/v3/projects/afb4f0e42da849e18f8a5db436bf1bc1/users/b74896ef679c45b5b4fe653929117242/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:18.808090 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-b512e98d-73e7-4aff-9504-8affe74f6ed1 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:18.810802 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7ffd15-4ae9-4505-8c4c-3ed54b33bb96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afb4f0e42da849e18f8a5db436bf1bc1, user_id=b74896ef679c45b5b4fe653929117242, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:18.811600 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b512e98d-73e7-4aff-9504-8affe74f6ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:18.814146 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7ffd15-4ae9-4505-8c4c-3ed54b33bb96 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:18.833821 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 943/1882] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:28:18.836148 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 939/1882] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:28:18 2022] PUT /identity/v3/projects/afb4f0e42da849e18f8a5db436bf1bc1/users/b74896ef679c45b5b4fe653929117242/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:18.838485 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b512e98d-73e7-4aff-9504-8affe74f6ed1 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:18.838638 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ffd15-4ae9-4505-8c4c-3ed54b33bb96 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:18.852963 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b512e98d-73e7-4aff-9504-8affe74f6ed1 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:18.925184 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ffd15-4ae9-4505-8c4c-3ed54b33bb96 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:18.933475 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b392903e-754f-43c3-984e-0ec80d2a3acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:18.934306 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392903e-754f-43c3-984e-0ec80d2a3acf admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:18.934687 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392903e-754f-43c3-984e-0ec80d2a3acf admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:18.935057 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392903e-754f-43c3-984e-0ec80d2a3acf admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:18.935891 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b392903e-754f-43c3-984e-0ec80d2a3acf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:18.937666 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f1bf3-904e-4897-b785-a59e003cc902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:18.937884 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b392903e-754f-43c3-984e-0ec80d2a3acf admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:18.938702 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f1bf3-904e-4897-b785-a59e003cc902 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:18.939233 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f1bf3-904e-4897-b785-a59e003cc902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:18.939808 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f1bf3-904e-4897-b785-a59e003cc902 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:18.940676 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62f1bf3-904e-4897-b785-a59e003cc902 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:28:18.941012 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62f1bf3-904e-4897-b785-a59e003cc902 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:18.943319 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62f1bf3-904e-4897-b785-a59e003cc902 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:18.959453 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 940/1883] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:28:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:28:18.959679 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 944/1884] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:18.963692 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f1bf3-904e-4897-b785-a59e003cc902 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:18.964831 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b392903e-754f-43c3-984e-0ec80d2a3acf admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:18.976828 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b392903e-754f-43c3-984e-0ec80d2a3acf admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:18.983663 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886c7cac-c746-4f16-b62f-29722d05e0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:18.984475 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c7cac-c746-4f16-b62f-29722d05e0b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:18.984888 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c7cac-c746-4f16-b62f-29722d05e0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:18.985372 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c7cac-c746-4f16-b62f-29722d05e0b4 admin admin] PATH_INFO: `/v3/projects/afb4f0e42da849e18f8a5db436bf1bc1/users/b74896ef679c45b5b4fe653929117242/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:18.986792 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f1bf3-904e-4897-b785-a59e003cc902 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:18.987975 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886c7cac-c746-4f16-b62f-29722d05e0b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afb4f0e42da849e18f8a5db436bf1bc1, user_id=b74896ef679c45b5b4fe653929117242, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:18.990993 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886c7cac-c746-4f16-b62f-29722d05e0b4 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:18.993004 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e291e73-0c29-4fb2-a68d-8b28091a1472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:18.994066 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e291e73-0c29-4fb2-a68d-8b28091a1472 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:18.994352 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e291e73-0c29-4fb2-a68d-8b28091a1472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:18.995409 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e291e73-0c29-4fb2-a68d-8b28091a1472 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:18.996247 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e291e73-0c29-4fb2-a68d-8b28091a1472 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:19.000080 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e291e73-0c29-4fb2-a68d-8b28091a1472 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:19.012565 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 945/1885] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:28:18 2022] PUT /identity/v3/projects/afb4f0e42da849e18f8a5db436bf1bc1/users/b74896ef679c45b5b4fe653929117242/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:19.013877 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886c7cac-c746-4f16-b62f-29722d05e0b4 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:19.015981 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-886c7cac-c746-4f16-b62f-29722d05e0b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:19.039114 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 941/1886] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:28:18 2022] POST /identity/v3/projects => generated 381 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:19.041220 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee924f8-1bfd-49b2-9671-626c6fed273d None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:19.041781 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee924f8-1bfd-49b2-9671-626c6fed273d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:19.042147 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee924f8-1bfd-49b2-9671-626c6fed273d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:19.086605 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-0ee924f8-1bfd-49b2-9671-626c6fed273d None None] MFA Rules not processed for user `b74896ef679c45b5b4fe653929117242`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:19.088078 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-0ee924f8-1bfd-49b2-9671-626c6fed273d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:19.094897 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886c7cac-c746-4f16-b62f-29722d05e0b4 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:19.166226 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 942/1887] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:19 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:19.167061 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee924f8-1bfd-49b2-9671-626c6fed273d None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:19.170641 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e729b746-4311-425b-8b8f-b086199c3240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:19.171301 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729b746-4311-425b-8b8f-b086199c3240 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:19.172018 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729b746-4311-425b-8b8f-b086199c3240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:19.172018 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729b746-4311-425b-8b8f-b086199c3240 admin admin] PATH_INFO: `/v3/projects/096054c778214bf9842acc238a1442e4` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:19.173773 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e729b746-4311-425b-8b8f-b086199c3240 admin admin] RBAC: Authorizing `identity:delete_project(project_id=096054c778214bf9842acc238a1442e4)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:19.176932 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e729b746-4311-425b-8b8f-b086199c3240 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:19.182755 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee924f8-1bfd-49b2-9671-626c6fed273d None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:19.187454 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831325a-0cab-41a1-aba4-5128299c346b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:19.188073 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831325a-0cab-41a1-aba4-5128299c346b admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:19.188350 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831325a-0cab-41a1-aba4-5128299c346b admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:19.188656 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831325a-0cab-41a1-aba4-5128299c346b admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:19.189481 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3831325a-0cab-41a1-aba4-5128299c346b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:19.191423 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3831325a-0cab-41a1-aba4-5128299c346b admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:19.202063 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:19.204851 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:19.221079 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 943/1888] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:28:19 2022] POST /identity/v3/users => generated 291 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:19.222079 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831325a-0cab-41a1-aba4-5128299c346b admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:19.223748 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3831325a-0cab-41a1-aba4-5128299c346b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:19.241522 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e729b746-4311-425b-8b8f-b086199c3240 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '096054c778214bf9842acc238a1442e4', 'request_id': 'req-e729b746-4311-425b-8b8f-b086199c3240'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:19.250337 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e729b746-4311-425b-8b8f-b086199c3240 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '096054c778214bf9842acc238a1442e4', 'request_id': 'req-e729b746-4311-425b-8b8f-b086199c3240'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:19.262760 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e729b746-4311-425b-8b8f-b086199c3240 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '096054c778214bf9842acc238a1442e4', 'request_id': 'req-e729b746-4311-425b-8b8f-b086199c3240'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:19.284240 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e729b746-4311-425b-8b8f-b086199c3240 admin admin] The token cache is being invalidate because project 096054c778214bf9842acc238a1442e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:28:19.284681 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e729b746-4311-425b-8b8f-b086199c3240 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:19.285568 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e729b746-4311-425b-8b8f-b086199c3240 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:19.287396 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 946/1889] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:28:19 2022] DELETE /identity/v3/projects/096054c778214bf9842acc238a1442e4 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:19.288255 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e729b746-4311-425b-8b8f-b086199c3240 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:19.289913 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-e729b746-4311-425b-8b8f-b086199c3240 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:19.299218 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831325a-0cab-41a1-aba4-5128299c346b admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:19.365283 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d4988-7bd0-41b6-bf69-785312d6bef9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:19.366261 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d4988-7bd0-41b6-bf69-785312d6bef9 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:19.366703 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d4988-7bd0-41b6-bf69-785312d6bef9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:19.367100 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d4988-7bd0-41b6-bf69-785312d6bef9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:19.370721 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-9e3d4988-7bd0-41b6-bf69-785312d6bef9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:19.397776 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e729b746-4311-425b-8b8f-b086199c3240 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:19.409650 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5182b-60cb-4d7c-baed-3e9f9fd95431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:19.410547 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5182b-60cb-4d7c-baed-3e9f9fd95431 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:19.411051 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5182b-60cb-4d7c-baed-3e9f9fd95431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:19.411731 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5182b-60cb-4d7c-baed-3e9f9fd95431 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:19.412578 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c5182b-60cb-4d7c-baed-3e9f9fd95431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:19.432776 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c5182b-60cb-4d7c-baed-3e9f9fd95431 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:19.453008 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 947/1890] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:19.454325 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2d9c9-47e0-4842-b73e-eabec6540600 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:19.454698 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2d9c9-47e0-4842-b73e-eabec6540600 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:19.454980 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2d9c9-47e0-4842-b73e-eabec6540600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:19.505454 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-8dc2d9c9-47e0-4842-b73e-eabec6540600 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:19.506501 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-8dc2d9c9-47e0-4842-b73e-eabec6540600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:19.528728 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 948/1891] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:19.541311 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2d9c9-47e0-4842-b73e-eabec6540600 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:19.546953 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3d4988-7bd0-41b6-bf69-785312d6bef9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:19.553837 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3d4988-7bd0-41b6-bf69-785312d6bef9 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:19.569246 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2d9c9-47e0-4842-b73e-eabec6540600 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:19.579037 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 944/1892] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:28:19 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:28:19.581837 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b436729-8f1e-439f-943a-7b2df2248d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:19.583372 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b436729-8f1e-439f-943a-7b2df2248d30 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:19.583662 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b436729-8f1e-439f-943a-7b2df2248d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:19.584328 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b436729-8f1e-439f-943a-7b2df2248d30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:19.584639 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b436729-8f1e-439f-943a-7b2df2248d30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:19.585795 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e3e08-0fb2-457f-a814-410a2bb138db None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:19.586256 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e3e08-0fb2-457f-a814-410a2bb138db None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:19.586536 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e3e08-0fb2-457f-a814-410a2bb138db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:19.589064 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b436729-8f1e-439f-943a-7b2df2248d30 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:19.614590 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 949/1893] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:19.619918 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b436729-8f1e-439f-943a-7b2df2248d30 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:19.629988 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-898e3e08-0fb2-457f-a814-410a2bb138db None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:19.640800 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-898e3e08-0fb2-457f-a814-410a2bb138db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:19.641358 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b436729-8f1e-439f-943a-7b2df2248d30 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:19.649894 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbff18b-d485-455f-8208-dff312fa9d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:19.650596 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbff18b-d485-455f-8208-dff312fa9d88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:19.656045 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 945/1894] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:19.669451 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e3e08-0fb2-457f-a814-410a2bb138db None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:19.669816 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbff18b-d485-455f-8208-dff312fa9d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:19.669816 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbff18b-d485-455f-8208-dff312fa9d88 admin admin] PATH_INFO: `/v3/projects/fda1284a44704d0085ff025d55e4b02e/users/bd97e4a2db64427c82f725b54caebe51/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:19.685139 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e3e08-0fb2-457f-a814-410a2bb138db None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:19.693914 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55954bef-6441-4d12-87e5-7e518cff1330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:19.694552 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55954bef-6441-4d12-87e5-7e518cff1330 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:19.695575 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55954bef-6441-4d12-87e5-7e518cff1330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:19.695861 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55954bef-6441-4d12-87e5-7e518cff1330 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:19.698783 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55954bef-6441-4d12-87e5-7e518cff1330 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:28:19.699120 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55954bef-6441-4d12-87e5-7e518cff1330 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:19.700895 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbff18b-d485-455f-8208-dff312fa9d88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fda1284a44704d0085ff025d55e4b02e, user_id=bd97e4a2db64427c82f725b54caebe51, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:19.703356 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbff18b-d485-455f-8208-dff312fa9d88 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:19.706774 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55954bef-6441-4d12-87e5-7e518cff1330 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:19.734642 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 950/1895] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:28:19 2022] PUT /identity/v3/projects/fda1284a44704d0085ff025d55e4b02e/users/bd97e4a2db64427c82f725b54caebe51/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:19.736347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1fa606-a3e8-42f9-a4e9-5b39de4a6327 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:19.736869 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1fa606-a3e8-42f9-a4e9-5b39de4a6327 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:19.741512 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1fa606-a3e8-42f9-a4e9-5b39de4a6327 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:19.742248 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 946/1896] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:28:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:28:19.744956 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55954bef-6441-4d12-87e5-7e518cff1330 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:19.746398 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 951/1897] 10.222.0.36 () {54 vars in 921 bytes} [Mon Aug 29 22:28:19 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:28:19.747929 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44d00b-2292-47a8-95ed-e89b75a5dbe0 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:19.748218 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44d00b-2292-47a8-95ed-e89b75a5dbe0 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:19.748686 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44d00b-2292-47a8-95ed-e89b75a5dbe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:19.769345 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55954bef-6441-4d12-87e5-7e518cff1330 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:19.808200 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-0b44d00b-2292-47a8-95ed-e89b75a5dbe0 None None] MFA Rules not processed for user `bd97e4a2db64427c82f725b54caebe51`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:19.809761 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-0b44d00b-2292-47a8-95ed-e89b75a5dbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:19.882515 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:19.911086 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61335c2-1007-42a5-9120-217ea2b995cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:19.912486 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61335c2-1007-42a5-9120-217ea2b995cc admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:19.912937 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61335c2-1007-42a5-9120-217ea2b995cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:19.913613 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61335c2-1007-42a5-9120-217ea2b995cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:19.914602 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61335c2-1007-42a5-9120-217ea2b995cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:19.917192 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61335c2-1007-42a5-9120-217ea2b995cc admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:19.959624 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:19.971667 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 947/1898] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:28:19 2022] POST /identity/v3/projects => generated 373 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:19.971667 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15544a3a-fe7c-40cc-b5fe-fbcae51e2875 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:19.971667 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15544a3a-fe7c-40cc-b5fe-fbcae51e2875 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:19.971667 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15544a3a-fe7c-40cc-b5fe-fbcae51e2875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:19.982661 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 952/1899] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:19.983606 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b44d00b-2292-47a8-95ed-e89b75a5dbe0 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:20.011313 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b44d00b-2292-47a8-95ed-e89b75a5dbe0 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:20.018295 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-15544a3a-fe7c-40cc-b5fe-fbcae51e2875 None None] MFA Rules not processed for user `90b7213b7111456a93e294ce40b95b21`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:20.019514 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-15544a3a-fe7c-40cc-b5fe-fbcae51e2875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:20.138419 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9f9f8-db70-4b6d-88a5-1c844346095c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:20.139265 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9f9f8-db70-4b6d-88a5-1c844346095c admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:20.139497 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9f9f8-db70-4b6d-88a5-1c844346095c admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:20.139806 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9f9f8-db70-4b6d-88a5-1c844346095c admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:20.141249 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e9f9f8-db70-4b6d-88a5-1c844346095c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:20.143384 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e9f9f8-db70-4b6d-88a5-1c844346095c admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:20.182863 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 953/1900] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:28:19 2022] POST /identity/v3/users => generated 287 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:20.184757 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9f9f8-db70-4b6d-88a5-1c844346095c admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:20.187096 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-19e9f9f8-db70-4b6d-88a5-1c844346095c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:20.191456 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 948/1901] 10.222.0.36 () {58 vars in 1018 bytes} [Mon Aug 29 22:28:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:20.192312 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15544a3a-fe7c-40cc-b5fe-fbcae51e2875 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:20.215636 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15544a3a-fe7c-40cc-b5fe-fbcae51e2875 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:20.221256 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2724b70-a554-4ad2-8519-80678bbb9d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:20.221890 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2724b70-a554-4ad2-8519-80678bbb9d8f admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:20.222170 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2724b70-a554-4ad2-8519-80678bbb9d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:20.222435 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2724b70-a554-4ad2-8519-80678bbb9d8f admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:20.223078 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2724b70-a554-4ad2-8519-80678bbb9d8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:20.225231 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2724b70-a554-4ad2-8519-80678bbb9d8f admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:20.272961 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 949/1902] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:28:20 2022] POST /identity/v3/projects => generated 379 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:20.274155 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2724b70-a554-4ad2-8519-80678bbb9d8f admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:20.317850 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9f9f8-db70-4b6d-88a5-1c844346095c admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:20.374928 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2724b70-a554-4ad2-8519-80678bbb9d8f admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:20.382872 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a161500-0f1b-4448-81f6-dcde949edc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:20.384033 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a161500-0f1b-4448-81f6-dcde949edc12 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:20.384316 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a161500-0f1b-4448-81f6-dcde949edc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:20.384730 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a161500-0f1b-4448-81f6-dcde949edc12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:20.385551 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a161500-0f1b-4448-81f6-dcde949edc12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:20.388357 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a161500-0f1b-4448-81f6-dcde949edc12 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:20.413152 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 950/1903] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:20.413152 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a161500-0f1b-4448-81f6-dcde949edc12 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:20.424823 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a161500-0f1b-4448-81f6-dcde949edc12 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:20.426087 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97709eef-2eef-4d8d-952d-19eaef81d46b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:20.427910 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97709eef-2eef-4d8d-952d-19eaef81d46b service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:20.430132 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97709eef-2eef-4d8d-952d-19eaef81d46b service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:20.430691 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97709eef-2eef-4d8d-952d-19eaef81d46b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:20.433236 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c3136b-7fef-4150-b9af-9f3906465b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:20.433548 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-97709eef-2eef-4d8d-952d-19eaef81d46b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:20.434346 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3136b-7fef-4150-b9af-9f3906465b81 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:20.435078 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3136b-7fef-4150-b9af-9f3906465b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:20.435521 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3136b-7fef-4150-b9af-9f3906465b81 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:20.436428 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c3136b-7fef-4150-b9af-9f3906465b81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:20.439200 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c3136b-7fef-4150-b9af-9f3906465b81 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:20.481222 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 951/1904] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:28:20 2022] POST /identity/v3/users => generated 296 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:20.484566 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c3136b-7fef-4150-b9af-9f3906465b81 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:20.488018 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-15c3136b-7fef-4150-b9af-9f3906465b81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:20.512641 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:20.530727 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:20.535927 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97709eef-2eef-4d8d-952d-19eaef81d46b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:20.554362 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97709eef-2eef-4d8d-952d-19eaef81d46b service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:20.581103 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 954/1905] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:28:20 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:28:20.597387 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c3136b-7fef-4150-b9af-9f3906465b81 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:20.603031 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b9416-a7a5-4d0d-ab77-9e86c08d67b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b7213b7111456a93e294ce40b95b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:20.603836 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97709eef-2eef-4d8d-952d-19eaef81d46b service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:20.603990 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b9416-a7a5-4d0d-ab77-9e86c08d67b1 service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:20.604274 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b9416-a7a5-4d0d-ab77-9e86c08d67b1 service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:20.604813 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b9416-a7a5-4d0d-ab77-9e86c08d67b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:20.622661 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97709eef-2eef-4d8d-952d-19eaef81d46b service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:20.627473 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920b9416-a7a5-4d0d-ab77-9e86c08d67b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:20.627820 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d8339f-9d86-464a-a93e-feabd45e0db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:20.628479 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8339f-9d86-464a-a93e-feabd45e0db1 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:20.628894 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8339f-9d86-464a-a93e-feabd45e0db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:20.629135 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920b9416-a7a5-4d0d-ab77-9e86c08d67b1 service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:20.629237 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8339f-9d86-464a-a93e-feabd45e0db1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:20.629816 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d8339f-9d86-464a-a93e-feabd45e0db1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:20.631702 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d8339f-9d86-464a-a93e-feabd45e0db1 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:20.641266 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 952/1906] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:28:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:28:20.649472 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 955/1907] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:20.650470 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d8339f-9d86-464a-a93e-feabd45e0db1 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:20.653194 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b9416-a7a5-4d0d-ab77-9e86c08d67b1 service nova] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:20.661838 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d8339f-9d86-464a-a93e-feabd45e0db1 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:20.666948 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235006bd-44a4-48c7-bbd7-695431eeb10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:20.667613 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235006bd-44a4-48c7-bbd7-695431eeb10d admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:20.667922 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235006bd-44a4-48c7-bbd7-695431eeb10d admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:20.668272 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235006bd-44a4-48c7-bbd7-695431eeb10d admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:20.668968 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235006bd-44a4-48c7-bbd7-695431eeb10d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:20.671046 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235006bd-44a4-48c7-bbd7-695431eeb10d admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:20.676685 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b9416-a7a5-4d0d-ab77-9e86c08d67b1 service nova] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:20.689112 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0cff56-fe36-4137-ab9a-9adf64902938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:20.689867 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0cff56-fe36-4137-ab9a-9adf64902938 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:20.690178 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0cff56-fe36-4137-ab9a-9adf64902938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:20.690432 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0cff56-fe36-4137-ab9a-9adf64902938 admin admin] PATH_INFO: `/v3/projects/48f0b4b095314819933698415eb0ca93/users/9302d17c8ea947d6a44440f7556d23ac/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:20.714444 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 956/1908] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:20.715508 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235006bd-44a4-48c7-bbd7-695431eeb10d admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:20.716772 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0cff56-fe36-4137-ab9a-9adf64902938 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48f0b4b095314819933698415eb0ca93, user_id=9302d17c8ea947d6a44440f7556d23ac, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:20.719765 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0cff56-fe36-4137-ab9a-9adf64902938 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:20.742199 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 953/1909] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:28:20 2022] PUT /identity/v3/projects/48f0b4b095314819933698415eb0ca93/users/9302d17c8ea947d6a44440f7556d23ac/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:20.747525 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235006bd-44a4-48c7-bbd7-695431eeb10d admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:20.757466 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b8af9-dd73-42a1-9681-a107268d3030 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:20.757761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b8af9-dd73-42a1-9681-a107268d3030 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:20.758144 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b8af9-dd73-42a1-9681-a107268d3030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:20.795046 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-0e2b8af9-dd73-42a1-9681-a107268d3030 None None] MFA Rules not processed for user `9302d17c8ea947d6a44440f7556d23ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:20.796442 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-0e2b8af9-dd73-42a1-9681-a107268d3030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:20.889527 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5592c425-2921-46e7-bab5-05538973cbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:20.890797 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592c425-2921-46e7-bab5-05538973cbe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:20.891334 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592c425-2921-46e7-bab5-05538973cbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:20.891636 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592c425-2921-46e7-bab5-05538973cbe2 admin admin] PATH_INFO: `/v3/projects/0d7bb821242f4faba7a87bbbb987a36a/users/301b555ee804477f8617c7745310ec2b/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:20.914829 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 954/1910] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:20.916347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5592c425-2921-46e7-bab5-05538973cbe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d7bb821242f4faba7a87bbbb987a36a, user_id=301b555ee804477f8617c7745310ec2b, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:20.917574 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2b8af9-dd73-42a1-9681-a107268d3030 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:20.920376 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5592c425-2921-46e7-bab5-05538973cbe2 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:20.939664 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2b8af9-dd73-42a1-9681-a107268d3030 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:20.942545 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 957/1911] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:28:20 2022] PUT /identity/v3/projects/0d7bb821242f4faba7a87bbbb987a36a/users/301b555ee804477f8617c7745310ec2b/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:20.949413 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5592c425-2921-46e7-bab5-05538973cbe2 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:21.039507 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23bc21a-4647-4ebf-9a43-656681249fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:21.040069 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5592c425-2921-46e7-bab5-05538973cbe2 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:21.044277 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bc21a-4647-4ebf-9a43-656681249fb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:21.045707 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597c553-b4ab-40f7-b2b5-3264d2893650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:21.045935 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bc21a-4647-4ebf-9a43-656681249fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:21.046367 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bc21a-4647-4ebf-9a43-656681249fb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:21.046824 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597c553-b4ab-40f7-b2b5-3264d2893650 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:21.047274 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597c553-b4ab-40f7-b2b5-3264d2893650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:21.047640 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597c553-b4ab-40f7-b2b5-3264d2893650 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:21.048118 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23bc21a-4647-4ebf-9a43-656681249fb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:21.048604 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4597c553-b4ab-40f7-b2b5-3264d2893650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:21.050356 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4597c553-b4ab-40f7-b2b5-3264d2893650 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:21.051081 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23bc21a-4647-4ebf-9a43-656681249fb2 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:21.062247 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 958/1912] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:21.066308 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:21.067712 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597c553-b4ab-40f7-b2b5-3264d2893650 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:21.082229 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597c553-b4ab-40f7-b2b5-3264d2893650 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:21.087475 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb79a1c-aaab-4858-a8fb-3abc40ef44d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:21.088312 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb79a1c-aaab-4858-a8fb-3abc40ef44d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:21.088626 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb79a1c-aaab-4858-a8fb-3abc40ef44d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:21.088969 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb79a1c-aaab-4858-a8fb-3abc40ef44d8 admin admin] PATH_INFO: `/v3/projects/0d7bb821242f4faba7a87bbbb987a36a/users/301b555ee804477f8617c7745310ec2b/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:21.091141 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb79a1c-aaab-4858-a8fb-3abc40ef44d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d7bb821242f4faba7a87bbbb987a36a, user_id=301b555ee804477f8617c7745310ec2b, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:21.094020 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb79a1c-aaab-4858-a8fb-3abc40ef44d8 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:21.099482 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 955/1913] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:28:20 2022] POST /identity/v3/projects => generated 373 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:21.106488 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 959/1914] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:28:21 2022] PUT /identity/v3/projects/0d7bb821242f4faba7a87bbbb987a36a/users/301b555ee804477f8617c7745310ec2b/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:21.119857 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23bc21a-4647-4ebf-9a43-656681249fb2 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:21.120079 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b0625-695a-411b-99a3-2f30c5965655 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:21.120079 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b0625-695a-411b-99a3-2f30c5965655 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:21.120079 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b0625-695a-411b-99a3-2f30c5965655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:21.153434 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-654b0625-695a-411b-99a3-2f30c5965655 None None] MFA Rules not processed for user `301b555ee804477f8617c7745310ec2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:21.155719 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-654b0625-695a-411b-99a3-2f30c5965655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:21.215202 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23bc21a-4647-4ebf-9a43-656681249fb2 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:21.216266 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:21.284610 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 960/1915] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:21 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:28:21.294361 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654b0625-695a-411b-99a3-2f30c5965655 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:21.296628 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f549b28-d1a6-4743-a50c-c084eafeb4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:21.300596 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f549b28-d1a6-4743-a50c-c084eafeb4c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:21.300948 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f549b28-d1a6-4743-a50c-c084eafeb4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:21.304273 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f549b28-d1a6-4743-a50c-c084eafeb4c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:21.304815 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f549b28-d1a6-4743-a50c-c084eafeb4c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:21.306793 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f549b28-d1a6-4743-a50c-c084eafeb4c7 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:21.340884 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 956/1916] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:28:21 2022] POST /identity/v3/users => generated 293 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:21.344601 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f549b28-d1a6-4743-a50c-c084eafeb4c7 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:21.362976 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f549b28-d1a6-4743-a50c-c084eafeb4c7 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:21.369628 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654b0625-695a-411b-99a3-2f30c5965655 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:21.374025 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d75b1-7c42-4339-8b70-b3a621a06bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:21.374680 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d01e095-8403-4032-b12c-e08dc9242cb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:21.374813 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d75b1-7c42-4339-8b70-b3a621a06bb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:21.375053 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d75b1-7c42-4339-8b70-b3a621a06bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:21.375330 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d75b1-7c42-4339-8b70-b3a621a06bb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:21.375925 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01e095-8403-4032-b12c-e08dc9242cb6 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:21.376037 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0d75b1-7c42-4339-8b70-b3a621a06bb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:21.376495 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01e095-8403-4032-b12c-e08dc9242cb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:21.376978 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01e095-8403-4032-b12c-e08dc9242cb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:21.377808 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0d75b1-7c42-4339-8b70-b3a621a06bb9 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:21.391542 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d01e095-8403-4032-b12c-e08dc9242cb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:21.394383 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d01e095-8403-4032-b12c-e08dc9242cb6 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:21.400204 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 957/1917] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:21 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:21.404727 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d75b1-7c42-4339-8b70-b3a621a06bb9 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:21.407329 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 961/1918] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:28:21 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:28:21.422725 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d75b1-7c42-4339-8b70-b3a621a06bb9 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:21.439787 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0908d327-95e0-4c33-aac7-4c9705334692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:21.440908 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0908d327-95e0-4c33-aac7-4c9705334692 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:21.441368 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0908d327-95e0-4c33-aac7-4c9705334692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:21.441639 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0908d327-95e0-4c33-aac7-4c9705334692 admin admin] PATH_INFO: `/v3/projects/d0de856323314942b8ccdbbae1fc4765/users/f60dcd23b3e24a0ea77e12b629f2ddcf/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:21.488441 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0908d327-95e0-4c33-aac7-4c9705334692 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0de856323314942b8ccdbbae1fc4765, user_id=f60dcd23b3e24a0ea77e12b629f2ddcf, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:21.491707 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0908d327-95e0-4c33-aac7-4c9705334692 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:21.544034 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 958/1919] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:28:21 2022] PUT /identity/v3/projects/d0de856323314942b8ccdbbae1fc4765/users/f60dcd23b3e24a0ea77e12b629f2ddcf/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:21.547992 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d01e095-8403-4032-b12c-e08dc9242cb6 service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:21.573377 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d01e095-8403-4032-b12c-e08dc9242cb6 service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:21.749500 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd9151-160f-4cb5-85b4-44f4b748830e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:21.750253 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd9151-160f-4cb5-85b4-44f4b748830e admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:21.750434 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd9151-160f-4cb5-85b4-44f4b748830e admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:21.750717 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd9151-160f-4cb5-85b4-44f4b748830e admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:21.751407 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafd9151-160f-4cb5-85b4-44f4b748830e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:21.754430 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafd9151-160f-4cb5-85b4-44f4b748830e admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:21.774274 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 962/1920] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:21 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:21.775754 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0908d327-95e0-4c33-aac7-4c9705334692 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:21.803756 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0908d327-95e0-4c33-aac7-4c9705334692 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:21.815878 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acec963-7c44-4c83-9f15-b3c8f8292209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:21.815878 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acec963-7c44-4c83-9f15-b3c8f8292209 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:21.815878 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acec963-7c44-4c83-9f15-b3c8f8292209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:21.815878 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acec963-7c44-4c83-9f15-b3c8f8292209 admin admin] PATH_INFO: `/v3/projects/d0de856323314942b8ccdbbae1fc4765/users/f60dcd23b3e24a0ea77e12b629f2ddcf/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:21.816701 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acec963-7c44-4c83-9f15-b3c8f8292209 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0de856323314942b8ccdbbae1fc4765, user_id=f60dcd23b3e24a0ea77e12b629f2ddcf, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:21.818088 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acec963-7c44-4c83-9f15-b3c8f8292209 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:21.835734 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 959/1921] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:28:21 2022] PUT /identity/v3/projects/d0de856323314942b8ccdbbae1fc4765/users/f60dcd23b3e24a0ea77e12b629f2ddcf/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:21.856950 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60ecf7-1bed-49c2-9f09-bd1cf63596c1 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:21.856950 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60ecf7-1bed-49c2-9f09-bd1cf63596c1 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:21.856950 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60ecf7-1bed-49c2-9f09-bd1cf63596c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:21.957672 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-ef60ecf7-1bed-49c2-9f09-bd1cf63596c1 None None] MFA Rules not processed for user `f60dcd23b3e24a0ea77e12b629f2ddcf`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:21.958967 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ef60ecf7-1bed-49c2-9f09-bd1cf63596c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:22.068607 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:22.115640 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 963/1922] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:21 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:22.158123 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acec963-7c44-4c83-9f15-b3c8f8292209 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:22.225656 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:22.248004 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acec963-7c44-4c83-9f15-b3c8f8292209 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:22.253244 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd4476-26c5-411e-9ed2-5437946abeb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:22.254362 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd4476-26c5-411e-9ed2-5437946abeb7 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:22.254885 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd4476-26c5-411e-9ed2-5437946abeb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:22.255280 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd4476-26c5-411e-9ed2-5437946abeb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:22.275359 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cd4476-26c5-411e-9ed2-5437946abeb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:22.282039 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cd4476-26c5-411e-9ed2-5437946abeb7 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:22.294411 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 960/1923] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:28:22 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:28:22.526066 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60ecf7-1bed-49c2-9f09-bd1cf63596c1 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:22.623573 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd4476-26c5-411e-9ed2-5437946abeb7 service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:22.625438 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-66cd4476-26c5-411e-9ed2-5437946abeb7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:22.652080 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60ecf7-1bed-49c2-9f09-bd1cf63596c1 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:22.658461 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207906e-8737-4511-81ca-d6de483f67b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:22.659675 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207906e-8737-4511-81ca-d6de483f67b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:22.660206 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207906e-8737-4511-81ca-d6de483f67b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:22.660613 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207906e-8737-4511-81ca-d6de483f67b2 admin admin] PATH_INFO: `/v3/users/bd97e4a2db64427c82f725b54caebe51` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:22.662527 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1207906e-8737-4511-81ca-d6de483f67b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd97e4a2db64427c82f725b54caebe51)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:22.665102 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1207906e-8737-4511-81ca-d6de483f67b2 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:22.671014 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd4476-26c5-411e-9ed2-5437946abeb7 service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:22.688647 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf449a-f911-4091-8400-db2b21118c33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:22.691207 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf449a-f911-4091-8400-db2b21118c33 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:22.692182 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf449a-f911-4091-8400-db2b21118c33 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:22.697120 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf449a-f911-4091-8400-db2b21118c33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:22.763212 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-1207906e-8737-4511-81ca-d6de483f67b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd97e4a2db64427c82f725b54caebe51'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:22.782401 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-1207906e-8737-4511-81ca-d6de483f67b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd97e4a2db64427c82f725b54caebe51'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:22.783701 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-1207906e-8737-4511-81ca-d6de483f67b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd97e4a2db64427c82f725b54caebe51'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:22.800420 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-1207906e-8737-4511-81ca-d6de483f67b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd97e4a2db64427c82f725b54caebe51'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:22.804114 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-1207906e-8737-4511-81ca-d6de483f67b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd97e4a2db64427c82f725b54caebe51'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:22.844906 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 964/1924] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:28:22 2022] DELETE /identity/v3/users/bd97e4a2db64427c82f725b54caebe51 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:22.851149 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb689a70-ed80-43e4-af57-0ec9d95341b6 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:22.851628 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb689a70-ed80-43e4-af57-0ec9d95341b6 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:22.860983 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb689a70-ed80-43e4-af57-0ec9d95341b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:22.895264 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cf449a-f911-4091-8400-db2b21118c33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:22.896619 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cf449a-f911-4091-8400-db2b21118c33 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:22.902318 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-fb689a70-ed80-43e4-af57-0ec9d95341b6 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:22.903686 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-fb689a70-ed80-43e4-af57-0ec9d95341b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:22.932867 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 961/1925] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:28:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:28:23.015173 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 965/1926] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:23.027562 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf449a-f911-4091-8400-db2b21118c33 service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:23.027562 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a4cf449a-f911-4091-8400-db2b21118c33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:23.091503 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf449a-f911-4091-8400-db2b21118c33 service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:23.175938 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c371f7e8-63e8-495e-9f62-1f6984b31a58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:23.176683 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c371f7e8-63e8-495e-9f62-1f6984b31a58 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:23.176974 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c371f7e8-63e8-495e-9f62-1f6984b31a58 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:23.177878 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c371f7e8-63e8-495e-9f62-1f6984b31a58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:23.191817 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c371f7e8-63e8-495e-9f62-1f6984b31a58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:23.193968 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c371f7e8-63e8-495e-9f62-1f6984b31a58 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:23.212543 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 962/1927] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:28:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:28:23.627317 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb689a70-ed80-43e4-af57-0ec9d95341b6 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:23.629868 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-fb689a70-ed80-43e4-af57-0ec9d95341b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:23.661959 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c371f7e8-63e8-495e-9f62-1f6984b31a58 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:23.663506 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c371f7e8-63e8-495e-9f62-1f6984b31a58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:23.663754 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb689a70-ed80-43e4-af57-0ec9d95341b6 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:23.669091 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab4de9b-d84b-4608-aeb7-4ad3760fdfb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:23.669999 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4de9b-d84b-4608-aeb7-4ad3760fdfb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:23.670285 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4de9b-d84b-4608-aeb7-4ad3760fdfb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:23.670563 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4de9b-d84b-4608-aeb7-4ad3760fdfb6 admin admin] PATH_INFO: `/v3/projects/fda1284a44704d0085ff025d55e4b02e` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:23.671709 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab4de9b-d84b-4608-aeb7-4ad3760fdfb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fda1284a44704d0085ff025d55e4b02e)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:23.673833 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab4de9b-d84b-4608-aeb7-4ad3760fdfb6 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:23.676858 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:23.683864 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c371f7e8-63e8-495e-9f62-1f6984b31a58 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:23.690425 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feed13c-9cb2-4bda-8eaf-44134c8b8035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:23.691174 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feed13c-9cb2-4bda-8eaf-44134c8b8035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:23.691527 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feed13c-9cb2-4bda-8eaf-44134c8b8035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:23.691792 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feed13c-9cb2-4bda-8eaf-44134c8b8035 admin admin] PATH_INFO: `/v3/users/b58fa6b212584c90aee8216cad64c6bf` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:23.693045 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feed13c-9cb2-4bda-8eaf-44134c8b8035 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b58fa6b212584c90aee8216cad64c6bf)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:23.694885 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feed13c-9cb2-4bda-8eaf-44134c8b8035 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:23.737637 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:23.738986 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-fab4de9b-d84b-4608-aeb7-4ad3760fdfb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fda1284a44704d0085ff025d55e4b02e', 'request_id': 'req-fab4de9b-d84b-4608-aeb7-4ad3760fdfb6'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:23.747923 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-fab4de9b-d84b-4608-aeb7-4ad3760fdfb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fda1284a44704d0085ff025d55e4b02e', 'request_id': 'req-fab4de9b-d84b-4608-aeb7-4ad3760fdfb6'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:23.758118 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-3feed13c-9cb2-4bda-8eaf-44134c8b8035 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b58fa6b212584c90aee8216cad64c6bf'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:23.759691 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-fab4de9b-d84b-4608-aeb7-4ad3760fdfb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fda1284a44704d0085ff025d55e4b02e', 'request_id': 'req-fab4de9b-d84b-4608-aeb7-4ad3760fdfb6'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:23.770381 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-3feed13c-9cb2-4bda-8eaf-44134c8b8035 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b58fa6b212584c90aee8216cad64c6bf'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:23.773631 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-fab4de9b-d84b-4608-aeb7-4ad3760fdfb6 admin admin] The token cache is being invalidate because project fda1284a44704d0085ff025d55e4b02e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:28:23.773984 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-fab4de9b-d84b-4608-aeb7-4ad3760fdfb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:23.774700 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-fab4de9b-d84b-4608-aeb7-4ad3760fdfb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:23.779448 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 966/1928] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:28:23 2022] DELETE /identity/v3/projects/fda1284a44704d0085ff025d55e4b02e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:23.780157 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-3feed13c-9cb2-4bda-8eaf-44134c8b8035 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b58fa6b212584c90aee8216cad64c6bf'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:23.780564 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab4de9b-d84b-4608-aeb7-4ad3760fdfb6 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:23.781412 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-3feed13c-9cb2-4bda-8eaf-44134c8b8035 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b58fa6b212584c90aee8216cad64c6bf'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:23.781941 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-fab4de9b-d84b-4608-aeb7-4ad3760fdfb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:23.797074 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-3feed13c-9cb2-4bda-8eaf-44134c8b8035 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b58fa6b212584c90aee8216cad64c6bf'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:23.805431 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 963/1929] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:28:23 2022] DELETE /identity/v3/users/b58fa6b212584c90aee8216cad64c6bf => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:23.810607 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbb093-40a4-4867-b092-cbb834919255 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:23.811074 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbb093-40a4-4867-b092-cbb834919255 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:23.811673 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbb093-40a4-4867-b092-cbb834919255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:23.834366 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-8bbbb093-40a4-4867-b092-cbb834919255 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:23.835644 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-8bbbb093-40a4-4867-b092-cbb834919255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:23.887869 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab4de9b-d84b-4608-aeb7-4ad3760fdfb6 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:23.983356 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 964/1930] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:28:23.991008 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbbb093-40a4-4867-b092-cbb834919255 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:23.993411 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-8bbbb093-40a4-4867-b092-cbb834919255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:24.006294 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ea864-4c5b-412c-a417-b38c7ef57a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:24.007298 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ea864-4c5b-412c-a417-b38c7ef57a2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:24.007608 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ea864-4c5b-412c-a417-b38c7ef57a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:24.008725 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ea864-4c5b-412c-a417-b38c7ef57a2f admin admin] PATH_INFO: `/v3/users/301b555ee804477f8617c7745310ec2b` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:24.010266 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848ea864-4c5b-412c-a417-b38c7ef57a2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=301b555ee804477f8617c7745310ec2b)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:24.013242 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848ea864-4c5b-412c-a417-b38c7ef57a2f admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:24.096875 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:24.098447 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbbb093-40a4-4867-b092-cbb834919255 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:24.106155 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f42ca82-875f-4359-9d94-bde298792b51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:24.106907 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42ca82-875f-4359-9d94-bde298792b51 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:24.108095 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42ca82-875f-4359-9d94-bde298792b51 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:24.108780 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42ca82-875f-4359-9d94-bde298792b51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:24.111731 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-848ea864-4c5b-412c-a417-b38c7ef57a2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '301b555ee804477f8617c7745310ec2b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:24.121241 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-848ea864-4c5b-412c-a417-b38c7ef57a2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '301b555ee804477f8617c7745310ec2b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:24.122809 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f42ca82-875f-4359-9d94-bde298792b51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:24.123897 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-848ea864-4c5b-412c-a417-b38c7ef57a2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '301b555ee804477f8617c7745310ec2b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:24.125131 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f42ca82-875f-4359-9d94-bde298792b51 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:24.139195 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 965/1931] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:28:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:28:24.145225 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-848ea864-4c5b-412c-a417-b38c7ef57a2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '301b555ee804477f8617c7745310ec2b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:24.146171 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-848ea864-4c5b-412c-a417-b38c7ef57a2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '301b555ee804477f8617c7745310ec2b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:24.173105 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 967/1932] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:28:23 2022] DELETE /identity/v3/users/301b555ee804477f8617c7745310ec2b => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:28:24.703412 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f42ca82-875f-4359-9d94-bde298792b51 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:24.705325 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-8f42ca82-875f-4359-9d94-bde298792b51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:24.723524 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ea864-4c5b-412c-a417-b38c7ef57a2f admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:24.725183 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-848ea864-4c5b-412c-a417-b38c7ef57a2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:24.739835 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f42ca82-875f-4359-9d94-bde298792b51 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:24.865136 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:24.880011 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23bd143-8c94-4587-975e-3b7c83c158c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:24.881551 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23bd143-8c94-4587-975e-3b7c83c158c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:24.882046 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23bd143-8c94-4587-975e-3b7c83c158c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:24.882421 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23bd143-8c94-4587-975e-3b7c83c158c1 admin admin] PATH_INFO: `/v3/users/6f311a131c1244e494238a6470e79713` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:24.885016 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23bd143-8c94-4587-975e-3b7c83c158c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f311a131c1244e494238a6470e79713)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:24.889376 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23bd143-8c94-4587-975e-3b7c83c158c1 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:24.890556 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ea864-4c5b-412c-a417-b38c7ef57a2f admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:24.905920 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d0619-1bcb-4dd5-a443-9440d80f299b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:24.906549 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d0619-1bcb-4dd5-a443-9440d80f299b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:24.906832 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d0619-1bcb-4dd5-a443-9440d80f299b admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:24.907120 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d0619-1bcb-4dd5-a443-9440d80f299b admin admin] PATH_INFO: `/v3/projects/784b5f13a90a438090cd85ccad40349a` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:24.909358 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531d0619-1bcb-4dd5-a443-9440d80f299b admin admin] RBAC: Authorizing `identity:delete_project(project_id=784b5f13a90a438090cd85ccad40349a)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:24.911488 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531d0619-1bcb-4dd5-a443-9440d80f299b admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:24.994651 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b23bd143-8c94-4587-975e-3b7c83c158c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f311a131c1244e494238a6470e79713'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:25.009849 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-531d0619-1bcb-4dd5-a443-9440d80f299b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '784b5f13a90a438090cd85ccad40349a', 'request_id': 'req-531d0619-1bcb-4dd5-a443-9440d80f299b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:25.011064 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b23bd143-8c94-4587-975e-3b7c83c158c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f311a131c1244e494238a6470e79713'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:25.017441 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-531d0619-1bcb-4dd5-a443-9440d80f299b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '784b5f13a90a438090cd85ccad40349a', 'request_id': 'req-531d0619-1bcb-4dd5-a443-9440d80f299b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:25.020971 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b23bd143-8c94-4587-975e-3b7c83c158c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f311a131c1244e494238a6470e79713'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:25.021968 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b23bd143-8c94-4587-975e-3b7c83c158c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f311a131c1244e494238a6470e79713'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:25.028275 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-531d0619-1bcb-4dd5-a443-9440d80f299b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '784b5f13a90a438090cd85ccad40349a', 'request_id': 'req-531d0619-1bcb-4dd5-a443-9440d80f299b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:25.045872 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-531d0619-1bcb-4dd5-a443-9440d80f299b admin admin] The token cache is being invalidate because project 784b5f13a90a438090cd85ccad40349a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:28:25.046874 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-531d0619-1bcb-4dd5-a443-9440d80f299b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:25.047640 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-531d0619-1bcb-4dd5-a443-9440d80f299b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:25.052187 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 968/1933] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:28:24 2022] DELETE /identity/v3/projects/784b5f13a90a438090cd85ccad40349a => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:28:25.054130 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d0619-1bcb-4dd5-a443-9440d80f299b admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:25.057944 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-531d0619-1bcb-4dd5-a443-9440d80f299b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:25.063522 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b23bd143-8c94-4587-975e-3b7c83c158c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f311a131c1244e494238a6470e79713'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:25.090377 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 966/1934] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:28:24 2022] DELETE /identity/v3/users/6f311a131c1244e494238a6470e79713 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:25.090377 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23bd143-8c94-4587-975e-3b7c83c158c1 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:25.091779 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b23bd143-8c94-4587-975e-3b7c83c158c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:25.150170 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:25.172417 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d0619-1bcb-4dd5-a443-9440d80f299b admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:25.203363 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23bd143-8c94-4587-975e-3b7c83c158c1 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:25.209530 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a726413d-e6e2-47a4-9018-2f472edbf907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:25.210411 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726413d-e6e2-47a4-9018-2f472edbf907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:25.210750 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726413d-e6e2-47a4-9018-2f472edbf907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:25.211086 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726413d-e6e2-47a4-9018-2f472edbf907 admin admin] PATH_INFO: `/v3/users/e160796d4a634974b25ffb527c855398` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:25.212390 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a726413d-e6e2-47a4-9018-2f472edbf907 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e160796d4a634974b25ffb527c855398)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:25.214449 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a726413d-e6e2-47a4-9018-2f472edbf907 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:25.248157 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8146cd63-01f9-4db8-8200-9c70a9b6aaf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:25.248905 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146cd63-01f9-4db8-8200-9c70a9b6aaf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:25.249232 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146cd63-01f9-4db8-8200-9c70a9b6aaf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:25.249506 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146cd63-01f9-4db8-8200-9c70a9b6aaf2 admin admin] PATH_INFO: `/v3/projects/0d7bb821242f4faba7a87bbbb987a36a` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:25.250817 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8146cd63-01f9-4db8-8200-9c70a9b6aaf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d7bb821242f4faba7a87bbbb987a36a)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:25.253090 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8146cd63-01f9-4db8-8200-9c70a9b6aaf2 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:25.278654 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a726413d-e6e2-47a4-9018-2f472edbf907 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e160796d4a634974b25ffb527c855398'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:25.292386 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a726413d-e6e2-47a4-9018-2f472edbf907 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e160796d4a634974b25ffb527c855398'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:25.304953 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a726413d-e6e2-47a4-9018-2f472edbf907 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e160796d4a634974b25ffb527c855398'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:25.306248 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a726413d-e6e2-47a4-9018-2f472edbf907 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e160796d4a634974b25ffb527c855398'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:25.317579 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8146cd63-01f9-4db8-8200-9c70a9b6aaf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d7bb821242f4faba7a87bbbb987a36a', 'request_id': 'req-8146cd63-01f9-4db8-8200-9c70a9b6aaf2'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:25.337591 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8146cd63-01f9-4db8-8200-9c70a9b6aaf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d7bb821242f4faba7a87bbbb987a36a', 'request_id': 'req-8146cd63-01f9-4db8-8200-9c70a9b6aaf2'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:25.351897 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:25.363487 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8146cd63-01f9-4db8-8200-9c70a9b6aaf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d7bb821242f4faba7a87bbbb987a36a', 'request_id': 'req-8146cd63-01f9-4db8-8200-9c70a9b6aaf2'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:25.368616 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a726413d-e6e2-47a4-9018-2f472edbf907 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e160796d4a634974b25ffb527c855398'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:25.384334 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8146cd63-01f9-4db8-8200-9c70a9b6aaf2 admin admin] The token cache is being invalidate because project 0d7bb821242f4faba7a87bbbb987a36a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:28:25.384869 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8146cd63-01f9-4db8-8200-9c70a9b6aaf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:25.386549 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8146cd63-01f9-4db8-8200-9c70a9b6aaf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:25.392557 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 967/1935] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:28:25 2022] DELETE /identity/v3/users/e160796d4a634974b25ffb527c855398 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:25.392557 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275bc7a-d01f-4dec-99ea-3db17088f7ab None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:25.392557 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275bc7a-d01f-4dec-99ea-3db17088f7ab None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:25.392557 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275bc7a-d01f-4dec-99ea-3db17088f7ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:25.394687 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 969/1936] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:28:25 2022] DELETE /identity/v3/projects/0d7bb821242f4faba7a87bbbb987a36a => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:25.396792 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a5e10-87bc-4375-926f-33ee22ab9ee5 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:25.397082 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a5e10-87bc-4375-926f-33ee22ab9ee5 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:25.400167 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a5e10-87bc-4375-926f-33ee22ab9ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:25.435642 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-e275bc7a-d01f-4dec-99ea-3db17088f7ab None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:25.437392 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e275bc7a-d01f-4dec-99ea-3db17088f7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:25.453147 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-c63a5e10-87bc-4375-926f-33ee22ab9ee5 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:25.455778 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c63a5e10-87bc-4375-926f-33ee22ab9ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:25.567522 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 968/1937] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:25.586592 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e275bc7a-d01f-4dec-99ea-3db17088f7ab None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:25.588151 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e275bc7a-d01f-4dec-99ea-3db17088f7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:25.613171 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 970/1938] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:25.615872 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb3886-8dcb-4a55-8a3f-7fd40822befe None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:25.616341 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb3886-8dcb-4a55-8a3f-7fd40822befe None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:25.616867 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb3886-8dcb-4a55-8a3f-7fd40822befe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:25.660293 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-c3fb3886-8dcb-4a55-8a3f-7fd40822befe None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:25.662062 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c3fb3886-8dcb-4a55-8a3f-7fd40822befe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:25.670324 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 971/1939] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:25.675610 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fb3886-8dcb-4a55-8a3f-7fd40822befe None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:25.679004 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e275bc7a-d01f-4dec-99ea-3db17088f7ab None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:25.682693 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91947ed6-6b07-4807-8577-2797e5e66b97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:25.683344 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91947ed6-6b07-4807-8577-2797e5e66b97 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:25.683633 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91947ed6-6b07-4807-8577-2797e5e66b97 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:25.683895 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91947ed6-6b07-4807-8577-2797e5e66b97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:25.687877 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fb3886-8dcb-4a55-8a3f-7fd40822befe None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:25.694467 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91947ed6-6b07-4807-8577-2797e5e66b97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:25.695938 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91947ed6-6b07-4807-8577-2797e5e66b97 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:25.696778 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dc5ed7-2b02-4b1f-96ac-d95194e525c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:25.697657 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc5ed7-2b02-4b1f-96ac-d95194e525c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:25.698151 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc5ed7-2b02-4b1f-96ac-d95194e525c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:25.698666 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc5ed7-2b02-4b1f-96ac-d95194e525c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:25.699573 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dc5ed7-2b02-4b1f-96ac-d95194e525c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:28:25.700420 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dc5ed7-2b02-4b1f-96ac-d95194e525c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:25.703273 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dc5ed7-2b02-4b1f-96ac-d95194e525c0 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:25.714070 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 969/1940] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:28:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:28:25.721549 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 972/1941] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:28:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:28:25.725988 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91947ed6-6b07-4807-8577-2797e5e66b97 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:25.737183 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91947ed6-6b07-4807-8577-2797e5e66b97 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:25.742407 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b5932f-4e23-4069-bb0d-10e27bc1f44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:25.743022 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5932f-4e23-4069-bb0d-10e27bc1f44b admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:25.743323 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5932f-4e23-4069-bb0d-10e27bc1f44b admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:25.743591 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5932f-4e23-4069-bb0d-10e27bc1f44b admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:25.744236 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b5932f-4e23-4069-bb0d-10e27bc1f44b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:25.746300 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b5932f-4e23-4069-bb0d-10e27bc1f44b admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:25.778853 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 970/1942] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:28:25 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:25.783472 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dc5ed7-2b02-4b1f-96ac-d95194e525c0 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:25.794250 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:25.800973 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dc5ed7-2b02-4b1f-96ac-d95194e525c0 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:25.900839 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6862da-2627-4af1-82b1-6ff620cfd304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:25.901714 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6862da-2627-4af1-82b1-6ff620cfd304 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:25.901839 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6862da-2627-4af1-82b1-6ff620cfd304 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:25.902075 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6862da-2627-4af1-82b1-6ff620cfd304 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:25.902898 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6862da-2627-4af1-82b1-6ff620cfd304 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:25.905749 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6862da-2627-4af1-82b1-6ff620cfd304 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:25.930490 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 973/1943] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:28:25 2022] POST /identity/v3/users => generated 293 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:25.935106 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b5932f-4e23-4069-bb0d-10e27bc1f44b admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:25.948192 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b5932f-4e23-4069-bb0d-10e27bc1f44b admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:25.953096 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debea496-4fed-4c97-a258-60cb9a86d8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:25.954085 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debea496-4fed-4c97-a258-60cb9a86d8b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:25.954598 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debea496-4fed-4c97-a258-60cb9a86d8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:25.954911 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debea496-4fed-4c97-a258-60cb9a86d8b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:25.955640 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debea496-4fed-4c97-a258-60cb9a86d8b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:25.957496 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debea496-4fed-4c97-a258-60cb9a86d8b6 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:26.032906 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6862da-2627-4af1-82b1-6ff620cfd304 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:26.049496 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6862da-2627-4af1-82b1-6ff620cfd304 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:26.059364 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 971/1944] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:26.062920 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a95ab2c-e55a-4933-8530-29cf9f73fa64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:26.063668 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95ab2c-e55a-4933-8530-29cf9f73fa64 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:26.064046 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debea496-4fed-4c97-a258-60cb9a86d8b6 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:26.064174 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95ab2c-e55a-4933-8530-29cf9f73fa64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:26.064435 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95ab2c-e55a-4933-8530-29cf9f73fa64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:26.065207 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a95ab2c-e55a-4933-8530-29cf9f73fa64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:26.067607 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a95ab2c-e55a-4933-8530-29cf9f73fa64 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:26.070640 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-debea496-4fed-4c97-a258-60cb9a86d8b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:26.094490 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 974/1945] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:26.098133 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a95ab2c-e55a-4933-8530-29cf9f73fa64 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:26.123040 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debea496-4fed-4c97-a258-60cb9a86d8b6 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:26.124728 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a95ab2c-e55a-4933-8530-29cf9f73fa64 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:26.137008 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe7618-f4b9-462d-a23a-2fb687bac258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:26.138500 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe7618-f4b9-462d-a23a-2fb687bac258 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:26.138781 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe7618-f4b9-462d-a23a-2fb687bac258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:26.139231 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe7618-f4b9-462d-a23a-2fb687bac258 admin admin] PATH_INFO: `/v3/projects/d207eb829bbd44ea9675cf92223e65c3/users/6386e828ab1749e9bf0eb2f9beda0f20/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:26.141228 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0109ed-c77b-41c8-8cba-8cb927df0c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:26.142533 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0109ed-c77b-41c8-8cba-8cb927df0c72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:26.142651 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0109ed-c77b-41c8-8cba-8cb927df0c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:26.143674 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0109ed-c77b-41c8-8cba-8cb927df0c72 admin admin] PATH_INFO: `/v3/projects/94134057948f4337ba89ac1d32fede8b` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:26.151956 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0109ed-c77b-41c8-8cba-8cb927df0c72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94134057948f4337ba89ac1d32fede8b)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:26.154755 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0109ed-c77b-41c8-8cba-8cb927df0c72 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:26.170538 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe7618-f4b9-462d-a23a-2fb687bac258 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d207eb829bbd44ea9675cf92223e65c3, user_id=6386e828ab1749e9bf0eb2f9beda0f20, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:26.176006 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe7618-f4b9-462d-a23a-2fb687bac258 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:26.197204 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 975/1946] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:28:26 2022] PUT /identity/v3/projects/d207eb829bbd44ea9675cf92223e65c3/users/6386e828ab1749e9bf0eb2f9beda0f20/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:26.208189 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b653c83-62e3-4557-8db1-bf1e6137dd35 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:26.208634 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b653c83-62e3-4557-8db1-bf1e6137dd35 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:26.209077 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b653c83-62e3-4557-8db1-bf1e6137dd35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:26.274342 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-1b653c83-62e3-4557-8db1-bf1e6137dd35 None None] MFA Rules not processed for user `6386e828ab1749e9bf0eb2f9beda0f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:26.277801 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-1b653c83-62e3-4557-8db1-bf1e6137dd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:26.280291 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-7d0109ed-c77b-41c8-8cba-8cb927df0c72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94134057948f4337ba89ac1d32fede8b', 'request_id': 'req-7d0109ed-c77b-41c8-8cba-8cb927df0c72'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:26.293091 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-7d0109ed-c77b-41c8-8cba-8cb927df0c72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94134057948f4337ba89ac1d32fede8b', 'request_id': 'req-7d0109ed-c77b-41c8-8cba-8cb927df0c72'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:26.296967 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:26.307808 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-7d0109ed-c77b-41c8-8cba-8cb927df0c72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94134057948f4337ba89ac1d32fede8b', 'request_id': 'req-7d0109ed-c77b-41c8-8cba-8cb927df0c72'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:26.336850 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-7d0109ed-c77b-41c8-8cba-8cb927df0c72 admin admin] The token cache is being invalidate because project 94134057948f4337ba89ac1d32fede8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:28:26.337215 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-7d0109ed-c77b-41c8-8cba-8cb927df0c72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:26.338758 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-7d0109ed-c77b-41c8-8cba-8cb927df0c72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:26.344194 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 972/1947] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:28:26 2022] DELETE /identity/v3/projects/94134057948f4337ba89ac1d32fede8b => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:26.350948 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b40cf2-6cc2-4501-acc0-dd9dde4ec2d4 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:26.351725 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b40cf2-6cc2-4501-acc0-dd9dde4ec2d4 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:26.352014 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b40cf2-6cc2-4501-acc0-dd9dde4ec2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:26.408867 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 976/1948] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:28:26.410428 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b653c83-62e3-4557-8db1-bf1e6137dd35 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:26.411869 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-10b40cf2-6cc2-4501-acc0-dd9dde4ec2d4 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:26.412997 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-1b653c83-62e3-4557-8db1-bf1e6137dd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:26.414464 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-10b40cf2-6cc2-4501-acc0-dd9dde4ec2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:26.488849 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:26.514296 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b653c83-62e3-4557-8db1-bf1e6137dd35 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:26.521800 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e483eb9-c232-488e-a2fc-0a42d19e57a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:26.522613 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e483eb9-c232-488e-a2fc-0a42d19e57a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:26.522895 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e483eb9-c232-488e-a2fc-0a42d19e57a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:26.523167 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e483eb9-c232-488e-a2fc-0a42d19e57a9 admin admin] PATH_INFO: `/v3/users/35d863256ec54d53b3d8b9e8cf9c9705` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:26.525629 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e483eb9-c232-488e-a2fc-0a42d19e57a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35d863256ec54d53b3d8b9e8cf9c9705)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:26.557813 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e483eb9-c232-488e-a2fc-0a42d19e57a9 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:26.558572 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 973/1949] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:26.559909 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b40cf2-6cc2-4501-acc0-dd9dde4ec2d4 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:26.561883 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-10b40cf2-6cc2-4501-acc0-dd9dde4ec2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:26.590093 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b40cf2-6cc2-4501-acc0-dd9dde4ec2d4 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:26.595970 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a0d531-56bf-4240-b68b-02cad4131017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:26.598852 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0d531-56bf-4240-b68b-02cad4131017 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:26.599317 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0d531-56bf-4240-b68b-02cad4131017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:26.599632 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0d531-56bf-4240-b68b-02cad4131017 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:26.600754 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a0d531-56bf-4240-b68b-02cad4131017 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:26.603231 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a0d531-56bf-4240-b68b-02cad4131017 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:26.646039 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 974/1950] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:28:26 2022] POST /identity/v3/projects => generated 383 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:26.650452 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a0d531-56bf-4240-b68b-02cad4131017 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:26.652279 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-09a0d531-56bf-4240-b68b-02cad4131017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:26.658474 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-3e483eb9-c232-488e-a2fc-0a42d19e57a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35d863256ec54d53b3d8b9e8cf9c9705'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:26.683235 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-3e483eb9-c232-488e-a2fc-0a42d19e57a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35d863256ec54d53b3d8b9e8cf9c9705'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:26.684255 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-3e483eb9-c232-488e-a2fc-0a42d19e57a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35d863256ec54d53b3d8b9e8cf9c9705'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:26.698736 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-3e483eb9-c232-488e-a2fc-0a42d19e57a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35d863256ec54d53b3d8b9e8cf9c9705'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:26.699479 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-3e483eb9-c232-488e-a2fc-0a42d19e57a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35d863256ec54d53b3d8b9e8cf9c9705'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:26.739142 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 977/1951] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:28:26 2022] DELETE /identity/v3/users/35d863256ec54d53b3d8b9e8cf9c9705 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:26.740681 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337f7aa-8314-4986-8451-115f75c54143 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:26.740975 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337f7aa-8314-4986-8451-115f75c54143 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:26.741248 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337f7aa-8314-4986-8451-115f75c54143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:26.742519 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a0d531-56bf-4240-b68b-02cad4131017 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:26.769284 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-3337f7aa-8314-4986-8451-115f75c54143 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:26.770512 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-3337f7aa-8314-4986-8451-115f75c54143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:26.846574 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf1b189-3873-4976-8cfa-e35777433bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:26.847263 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1b189-3873-4976-8cfa-e35777433bc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:26.847909 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1b189-3873-4976-8cfa-e35777433bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:26.848348 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1b189-3873-4976-8cfa-e35777433bc9 admin admin] PATH_INFO: `/v3/projects/5ed35a2860724a15949b44313b3816de` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:26.850365 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf1b189-3873-4976-8cfa-e35777433bc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ed35a2860724a15949b44313b3816de)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:26.852986 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf1b189-3873-4976-8cfa-e35777433bc9 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:26.887960 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:26.910174 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 978/1952] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:26.914021 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337f7aa-8314-4986-8451-115f75c54143 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:26.917926 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-3337f7aa-8314-4986-8451-115f75c54143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:26.935663 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337f7aa-8314-4986-8451-115f75c54143 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:26.950921 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-caf1b189-3873-4976-8cfa-e35777433bc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ed35a2860724a15949b44313b3816de', 'request_id': 'req-caf1b189-3873-4976-8cfa-e35777433bc9'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:26.957594 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-caf1b189-3873-4976-8cfa-e35777433bc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ed35a2860724a15949b44313b3816de', 'request_id': 'req-caf1b189-3873-4976-8cfa-e35777433bc9'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:26.964656 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-caf1b189-3873-4976-8cfa-e35777433bc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ed35a2860724a15949b44313b3816de', 'request_id': 'req-caf1b189-3873-4976-8cfa-e35777433bc9'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:26.982759 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-caf1b189-3873-4976-8cfa-e35777433bc9 admin admin] The token cache is being invalidate because project 5ed35a2860724a15949b44313b3816de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:28:26.983128 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-caf1b189-3873-4976-8cfa-e35777433bc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:26.983867 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-caf1b189-3873-4976-8cfa-e35777433bc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:26.985593 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 975/1953] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:28:26 2022] DELETE /identity/v3/projects/5ed35a2860724a15949b44313b3816de => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:26.989077 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83590dbf-2eba-4471-930a-2d821d9620e4 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:26.989369 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83590dbf-2eba-4471-930a-2d821d9620e4 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:26.989644 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83590dbf-2eba-4471-930a-2d821d9620e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:27.010335 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68824e54-002d-4022-8190-99ab00592556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:27.010972 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68824e54-002d-4022-8190-99ab00592556 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:27.011243 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68824e54-002d-4022-8190-99ab00592556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:27.011516 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68824e54-002d-4022-8190-99ab00592556 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:27.012150 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68824e54-002d-4022-8190-99ab00592556 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:27.013311 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-83590dbf-2eba-4471-930a-2d821d9620e4 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:27.014168 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68824e54-002d-4022-8190-99ab00592556 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:27.014812 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-83590dbf-2eba-4471-930a-2d821d9620e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:27.022897 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 976/1954] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:27.023859 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83590dbf-2eba-4471-930a-2d821d9620e4 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:27.027164 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-83590dbf-2eba-4471-930a-2d821d9620e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:27.033705 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:27.039406 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83590dbf-2eba-4471-930a-2d821d9620e4 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:27.045739 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 979/1955] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:28:26 2022] POST /identity/v3/users => generated 292 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:27.046376 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7789ef41-55ec-47f1-bb4c-f57727753d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:27.047078 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789ef41-55ec-47f1-bb4c-f57727753d26 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:27.047190 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68824e54-002d-4022-8190-99ab00592556 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:27.047417 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789ef41-55ec-47f1-bb4c-f57727753d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:27.047918 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789ef41-55ec-47f1-bb4c-f57727753d26 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:27.048757 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7789ef41-55ec-47f1-bb4c-f57727753d26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:28:27.049074 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7789ef41-55ec-47f1-bb4c-f57727753d26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:27.050262 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-68824e54-002d-4022-8190-99ab00592556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:27.050684 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7789ef41-55ec-47f1-bb4c-f57727753d26 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:27.064492 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68824e54-002d-4022-8190-99ab00592556 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:27.065337 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 977/1956] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:28:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:28:27.066682 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7789ef41-55ec-47f1-bb4c-f57727753d26 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:27.068274 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-7789ef41-55ec-47f1-bb4c-f57727753d26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:27.070876 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be177682-a4a0-47df-9e60-533a602cff34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:27.071576 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be177682-a4a0-47df-9e60-533a602cff34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:27.071866 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be177682-a4a0-47df-9e60-533a602cff34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:27.072130 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be177682-a4a0-47df-9e60-533a602cff34 admin admin] PATH_INFO: `/v3/users/b74896ef679c45b5b4fe653929117242` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:27.073331 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be177682-a4a0-47df-9e60-533a602cff34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b74896ef679c45b5b4fe653929117242)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:27.075301 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be177682-a4a0-47df-9e60-533a602cff34 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:27.128537 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-be177682-a4a0-47df-9e60-533a602cff34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b74896ef679c45b5b4fe653929117242'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:27.137629 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-be177682-a4a0-47df-9e60-533a602cff34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b74896ef679c45b5b4fe653929117242'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:27.138354 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-be177682-a4a0-47df-9e60-533a602cff34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b74896ef679c45b5b4fe653929117242'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:27.139739 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7789ef41-55ec-47f1-bb4c-f57727753d26 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:27.143928 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd8c996-10ae-4b1d-b8a3-9d2af0296032 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:27.144532 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd8c996-10ae-4b1d-b8a3-9d2af0296032 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:27.144834 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd8c996-10ae-4b1d-b8a3-9d2af0296032 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:27.145093 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd8c996-10ae-4b1d-b8a3-9d2af0296032 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:27.147968 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-be177682-a4a0-47df-9e60-533a602cff34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b74896ef679c45b5b4fe653929117242'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:27.149201 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-be177682-a4a0-47df-9e60-533a602cff34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b74896ef679c45b5b4fe653929117242'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:27.155866 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd8c996-10ae-4b1d-b8a3-9d2af0296032 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:27.157445 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd8c996-10ae-4b1d-b8a3-9d2af0296032 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:27.168493 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 978/1957] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:28:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:28:27.169316 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd8c996-10ae-4b1d-b8a3-9d2af0296032 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:27.170896 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-ccd8c996-10ae-4b1d-b8a3-9d2af0296032 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:27.176143 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 980/1958] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:28:27 2022] DELETE /identity/v3/users/b74896ef679c45b5b4fe653929117242 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:27.177227 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be177682-a4a0-47df-9e60-533a602cff34 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:27.179015 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-be177682-a4a0-47df-9e60-533a602cff34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:27.195117 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd8c996-10ae-4b1d-b8a3-9d2af0296032 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:27.289936 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be177682-a4a0-47df-9e60-533a602cff34 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:27.298270 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74256d4-a496-4e39-8468-54e036631642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:27.299237 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74256d4-a496-4e39-8468-54e036631642 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:27.300430 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74256d4-a496-4e39-8468-54e036631642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:27.300756 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74256d4-a496-4e39-8468-54e036631642 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:27.301479 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74256d4-a496-4e39-8468-54e036631642 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:27.304050 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74256d4-a496-4e39-8468-54e036631642 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:27.337591 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68120b83-4939-4ffe-9dd2-c937d54f6a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:27.338317 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68120b83-4939-4ffe-9dd2-c937d54f6a98 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:27.341129 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68120b83-4939-4ffe-9dd2-c937d54f6a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:27.341427 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68120b83-4939-4ffe-9dd2-c937d54f6a98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:27.342101 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68120b83-4939-4ffe-9dd2-c937d54f6a98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:27.342231 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 981/1959] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:28:27 2022] POST /identity/v3/projects => generated 381 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:27.346147 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74256d4-a496-4e39-8468-54e036631642 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:27.347704 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68120b83-4939-4ffe-9dd2-c937d54f6a98 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:27.396019 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 979/1960] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:27 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:27.399746 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68120b83-4939-4ffe-9dd2-c937d54f6a98 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:27.403755 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-68120b83-4939-4ffe-9dd2-c937d54f6a98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:27.445543 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68120b83-4939-4ffe-9dd2-c937d54f6a98 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:27.466361 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:27.481893 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74256d4-a496-4e39-8468-54e036631642 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:27.496072 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:27.497458 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e5933-b766-4a32-9aff-51ce4e19637a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:27.499939 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e5933-b766-4a32-9aff-51ce4e19637a admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:27.500241 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e5933-b766-4a32-9aff-51ce4e19637a admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:27.502654 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e5933-b766-4a32-9aff-51ce4e19637a admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:27.503368 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2e5933-b766-4a32-9aff-51ce4e19637a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:27.507135 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2e5933-b766-4a32-9aff-51ce4e19637a admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:27.564690 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 982/1961] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:28:27 2022] POST /identity/v3/users => generated 291 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:28:27.565650 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e5933-b766-4a32-9aff-51ce4e19637a admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:27.567396 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7d2e5933-b766-4a32-9aff-51ce4e19637a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:27.585142 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7151a0a-f8d7-4c67-abec-0db2e432be2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:27.585859 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7151a0a-f8d7-4c67-abec-0db2e432be2a admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:27.586044 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7151a0a-f8d7-4c67-abec-0db2e432be2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:27.586321 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7151a0a-f8d7-4c67-abec-0db2e432be2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:27.586983 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7151a0a-f8d7-4c67-abec-0db2e432be2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:27.588646 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7151a0a-f8d7-4c67-abec-0db2e432be2a admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:27.604594 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 980/1962] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:27 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:27.604594 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7151a0a-f8d7-4c67-abec-0db2e432be2a admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:27.606878 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e5933-b766-4a32-9aff-51ce4e19637a admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:27.616308 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7151a0a-f8d7-4c67-abec-0db2e432be2a admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:27.620015 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ced2851-ff7c-4a3d-9477-3afd37d5bf22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:27.620827 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced2851-ff7c-4a3d-9477-3afd37d5bf22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:27.621157 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced2851-ff7c-4a3d-9477-3afd37d5bf22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:27.621556 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced2851-ff7c-4a3d-9477-3afd37d5bf22 admin admin] PATH_INFO: `/v3/projects/afb4f0e42da849e18f8a5db436bf1bc1` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:27.625177 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ced2851-ff7c-4a3d-9477-3afd37d5bf22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afb4f0e42da849e18f8a5db436bf1bc1)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:27.628495 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ced2851-ff7c-4a3d-9477-3afd37d5bf22 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:27.634521 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e3084-12ba-49c4-8812-10df5f6829b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:27.636338 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e3084-12ba-49c4-8812-10df5f6829b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:27.639507 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e3084-12ba-49c4-8812-10df5f6829b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:27.642277 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e3084-12ba-49c4-8812-10df5f6829b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:27.645473 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08e3084-12ba-49c4-8812-10df5f6829b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:27.647714 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08e3084-12ba-49c4-8812-10df5f6829b6 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:27.682026 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 981/1963] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:27 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:27.683151 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e3084-12ba-49c4-8812-10df5f6829b6 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:27.708668 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e3084-12ba-49c4-8812-10df5f6829b6 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:27.723306 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5ced2851-ff7c-4a3d-9477-3afd37d5bf22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afb4f0e42da849e18f8a5db436bf1bc1', 'request_id': 'req-5ced2851-ff7c-4a3d-9477-3afd37d5bf22'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:27.730806 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5ced2851-ff7c-4a3d-9477-3afd37d5bf22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afb4f0e42da849e18f8a5db436bf1bc1', 'request_id': 'req-5ced2851-ff7c-4a3d-9477-3afd37d5bf22'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:27.742360 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5ced2851-ff7c-4a3d-9477-3afd37d5bf22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afb4f0e42da849e18f8a5db436bf1bc1', 'request_id': 'req-5ced2851-ff7c-4a3d-9477-3afd37d5bf22'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:27.757297 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5ced2851-ff7c-4a3d-9477-3afd37d5bf22 admin admin] The token cache is being invalidate because project afb4f0e42da849e18f8a5db436bf1bc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:28:27.757986 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5ced2851-ff7c-4a3d-9477-3afd37d5bf22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:27.758727 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5ced2851-ff7c-4a3d-9477-3afd37d5bf22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:27.760420 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 983/1964] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:28:27 2022] DELETE /identity/v3/projects/afb4f0e42da849e18f8a5db436bf1bc1 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:27.761446 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ced2851-ff7c-4a3d-9477-3afd37d5bf22 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:27.763013 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-5ced2851-ff7c-4a3d-9477-3afd37d5bf22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:27.808058 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aafcd6-069d-4613-86dc-8f8941c5d7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:27.809045 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aafcd6-069d-4613-86dc-8f8941c5d7e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:27.809333 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aafcd6-069d-4613-86dc-8f8941c5d7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:27.809612 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aafcd6-069d-4613-86dc-8f8941c5d7e3 admin admin] PATH_INFO: `/v3/projects/af5d726744f44374a4210e265b1fcb2d/users/283c8f4cc0fa43a68dc016fcb3037786/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:27.831797 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aafcd6-069d-4613-86dc-8f8941c5d7e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af5d726744f44374a4210e265b1fcb2d, user_id=283c8f4cc0fa43a68dc016fcb3037786, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:27.836248 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aafcd6-069d-4613-86dc-8f8941c5d7e3 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:27.857289 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 982/1965] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:28:27 2022] PUT /identity/v3/projects/af5d726744f44374a4210e265b1fcb2d/users/283c8f4cc0fa43a68dc016fcb3037786/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:27.859679 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aafcd6-069d-4613-86dc-8f8941c5d7e3 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:27.861451 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b7aafcd6-069d-4613-86dc-8f8941c5d7e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:27.864826 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ced2851-ff7c-4a3d-9477-3afd37d5bf22 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:27.937187 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ee34b-524b-49be-8fe1-76693fa30851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:27.937850 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ee34b-524b-49be-8fe1-76693fa30851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:27.938060 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ee34b-524b-49be-8fe1-76693fa30851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:27.938226 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aafcd6-069d-4613-86dc-8f8941c5d7e3 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:27.938327 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ee34b-524b-49be-8fe1-76693fa30851 admin admin] PATH_INFO: `/v3/projects/6f0484e9671a4d3ea67baf0e25e70ae2` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:27.940954 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3ee34b-524b-49be-8fe1-76693fa30851 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f0484e9671a4d3ea67baf0e25e70ae2)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:27.943093 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3ee34b-524b-49be-8fe1-76693fa30851 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:27.949564 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c46a1-446b-4db6-8a20-715afaf73f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:27.950356 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c46a1-446b-4db6-8a20-715afaf73f67 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:27.951046 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c46a1-446b-4db6-8a20-715afaf73f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:27.951702 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c46a1-446b-4db6-8a20-715afaf73f67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:27.952390 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7c46a1-446b-4db6-8a20-715afaf73f67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:27.958143 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7c46a1-446b-4db6-8a20-715afaf73f67 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:27.972281 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:27.975212 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 983/1966] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:27 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:27.976643 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bc66d-c8bd-404b-9737-6937bf43498d None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:27.976933 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bc66d-c8bd-404b-9737-6937bf43498d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:27.977212 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bc66d-c8bd-404b-9737-6937bf43498d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:27.999706 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-595bc66d-c8bd-404b-9737-6937bf43498d None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:28.000955 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-595bc66d-c8bd-404b-9737-6937bf43498d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:28.010084 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 984/1967] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:28.011452 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10539d-2e21-4d97-a939-3c83c73856ca None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:28.011747 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10539d-2e21-4d97-a939-3c83c73856ca None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:28.012016 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10539d-2e21-4d97-a939-3c83c73856ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:28.041508 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-2e3ee34b-524b-49be-8fe1-76693fa30851 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f0484e9671a4d3ea67baf0e25e70ae2', 'request_id': 'req-2e3ee34b-524b-49be-8fe1-76693fa30851'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:28.046304 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-4d10539d-2e21-4d97-a939-3c83c73856ca None None] MFA Rules not processed for user `283c8f4cc0fa43a68dc016fcb3037786`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:28.047841 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-4d10539d-2e21-4d97-a939-3c83c73856ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:28.050589 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-2e3ee34b-524b-49be-8fe1-76693fa30851 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f0484e9671a4d3ea67baf0e25e70ae2', 'request_id': 'req-2e3ee34b-524b-49be-8fe1-76693fa30851'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:28.055852 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:28.061137 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-2e3ee34b-524b-49be-8fe1-76693fa30851 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f0484e9671a4d3ea67baf0e25e70ae2', 'request_id': 'req-2e3ee34b-524b-49be-8fe1-76693fa30851'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:28.086055 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-2e3ee34b-524b-49be-8fe1-76693fa30851 admin admin] The token cache is being invalidate because project 6f0484e9671a4d3ea67baf0e25e70ae2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:28:28.086285 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-2e3ee34b-524b-49be-8fe1-76693fa30851 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:28.087246 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-2e3ee34b-524b-49be-8fe1-76693fa30851 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:28.090252 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 984/1968] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:28:27 2022] DELETE /identity/v3/projects/6f0484e9671a4d3ea67baf0e25e70ae2 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:28.091388 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ee34b-524b-49be-8fe1-76693fa30851 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:28.093130 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-2e3ee34b-524b-49be-8fe1-76693fa30851 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:28.136489 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 985/1969] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:28.140025 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ed31d-618f-49c4-bf1f-0b7a1578790a None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:28.140025 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ed31d-618f-49c4-bf1f-0b7a1578790a None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:28.140025 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ed31d-618f-49c4-bf1f-0b7a1578790a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:28.168632 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-d92ed31d-618f-49c4-bf1f-0b7a1578790a None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:28.169892 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-d92ed31d-618f-49c4-bf1f-0b7a1578790a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:28.170105 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ee34b-524b-49be-8fe1-76693fa30851 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:28.174841 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5523fb-5621-48b5-9b5c-8d3f64076e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:28.175506 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5523fb-5621-48b5-9b5c-8d3f64076e0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:28.175782 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5523fb-5621-48b5-9b5c-8d3f64076e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:28.176058 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5523fb-5621-48b5-9b5c-8d3f64076e0e admin admin] PATH_INFO: `/v3/projects/bb3b06a433544278a3a8401dcf1b5b3f/users/c17bb64209184c0c8e4d7447ab107af3/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:28.178151 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 986/1970] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:28.179639 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ed31d-618f-49c4-bf1f-0b7a1578790a None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:28.180039 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-d92ed31d-618f-49c4-bf1f-0b7a1578790a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:28.190441 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5523fb-5621-48b5-9b5c-8d3f64076e0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb3b06a433544278a3a8401dcf1b5b3f, user_id=c17bb64209184c0c8e4d7447ab107af3, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:28.191538 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ed31d-618f-49c4-bf1f-0b7a1578790a None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:28.193187 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5523fb-5621-48b5-9b5c-8d3f64076e0e admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:28.196110 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b81e3-cfd0-44ca-8576-1fb7df56ee62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:28.196790 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b81e3-cfd0-44ca-8576-1fb7df56ee62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:28.197056 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b81e3-cfd0-44ca-8576-1fb7df56ee62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:28.197330 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b81e3-cfd0-44ca-8576-1fb7df56ee62 admin admin] PATH_INFO: `/v3/users/aa2d28322feb4739b1fe9a2b2d60440d` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:28.198502 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236b81e3-cfd0-44ca-8576-1fb7df56ee62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa2d28322feb4739b1fe9a2b2d60440d)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:28.200526 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236b81e3-cfd0-44ca-8576-1fb7df56ee62 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:28.207363 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 985/1971] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:28:28 2022] PUT /identity/v3/projects/bb3b06a433544278a3a8401dcf1b5b3f/users/c17bb64209184c0c8e4d7447ab107af3/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:28.207868 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5523fb-5621-48b5-9b5c-8d3f64076e0e admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:28.209505 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-9b5523fb-5621-48b5-9b5c-8d3f64076e0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:28.250770 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-236b81e3-cfd0-44ca-8576-1fb7df56ee62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa2d28322feb4739b1fe9a2b2d60440d'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:28.259445 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-236b81e3-cfd0-44ca-8576-1fb7df56ee62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa2d28322feb4739b1fe9a2b2d60440d'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:28.267215 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-236b81e3-cfd0-44ca-8576-1fb7df56ee62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa2d28322feb4739b1fe9a2b2d60440d'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:28.267892 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-236b81e3-cfd0-44ca-8576-1fb7df56ee62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa2d28322feb4739b1fe9a2b2d60440d'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:28.274020 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5523fb-5621-48b5-9b5c-8d3f64076e0e admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:28.278754 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a8633-eb4f-4c59-94a2-79961134242e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:28.279681 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a8633-eb4f-4c59-94a2-79961134242e admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:28.279966 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a8633-eb4f-4c59-94a2-79961134242e admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:28.280069 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-236b81e3-cfd0-44ca-8576-1fb7df56ee62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa2d28322feb4739b1fe9a2b2d60440d'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:28.280244 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a8633-eb4f-4c59-94a2-79961134242e admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:28.280925 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6a8633-eb4f-4c59-94a2-79961134242e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:28.282906 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6a8633-eb4f-4c59-94a2-79961134242e admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:28.286720 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 987/1972] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:28:28 2022] DELETE /identity/v3/users/aa2d28322feb4739b1fe9a2b2d60440d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:28.287541 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b81e3-cfd0-44ca-8576-1fb7df56ee62 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:28.289014 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-236b81e3-cfd0-44ca-8576-1fb7df56ee62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:28.316035 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 986/1973] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:28:28 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:28.316035 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931d688-47d3-420b-b3ae-e5e7e98eb307 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:28.316035 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931d688-47d3-420b-b3ae-e5e7e98eb307 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:28.316035 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931d688-47d3-420b-b3ae-e5e7e98eb307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:28.342848 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:28.346884 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-a931d688-47d3-420b-b3ae-e5e7e98eb307 None None] MFA Rules not processed for user `c17bb64209184c0c8e4d7447ab107af3`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:28.349277 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-a931d688-47d3-420b-b3ae-e5e7e98eb307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:28.374270 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b81e3-cfd0-44ca-8576-1fb7df56ee62 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:28.395728 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:28.430138 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 987/1974] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:28.430804 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a931d688-47d3-420b-b3ae-e5e7e98eb307 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:28.432589 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-a931d688-47d3-420b-b3ae-e5e7e98eb307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:28.457293 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68aa552-57bd-482f-a2aa-cb12ad02f1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:28.458270 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68aa552-57bd-482f-a2aa-cb12ad02f1f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:28.458557 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68aa552-57bd-482f-a2aa-cb12ad02f1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:28.458878 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68aa552-57bd-482f-a2aa-cb12ad02f1f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:28.459594 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68aa552-57bd-482f-a2aa-cb12ad02f1f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:28:28.459943 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68aa552-57bd-482f-a2aa-cb12ad02f1f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:28.462622 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68aa552-57bd-482f-a2aa-cb12ad02f1f6 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:28.481297 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 988/1975] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:28:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:28:28.482397 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68aa552-57bd-482f-a2aa-cb12ad02f1f6 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:28.484363 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-d68aa552-57bd-482f-a2aa-cb12ad02f1f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:28.500258 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68aa552-57bd-482f-a2aa-cb12ad02f1f6 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:28.508166 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233fce84-6c7c-4787-8cbd-d5f46b24ccda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:28.508917 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233fce84-6c7c-4787-8cbd-d5f46b24ccda admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:28.509201 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233fce84-6c7c-4787-8cbd-d5f46b24ccda admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:28.509460 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233fce84-6c7c-4787-8cbd-d5f46b24ccda admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:28.510159 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233fce84-6c7c-4787-8cbd-d5f46b24ccda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:28.512805 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233fce84-6c7c-4787-8cbd-d5f46b24ccda admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:28.544488 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 989/1976] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:28:28 2022] POST /identity/v3/projects => generated 379 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:28.545279 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233fce84-6c7c-4787-8cbd-d5f46b24ccda admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:28.552484 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a931d688-47d3-420b-b3ae-e5e7e98eb307 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:28.624836 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bceeb25-1635-4799-bc18-a8479cf80e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:28.626505 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bceeb25-1635-4799-bc18-a8479cf80e68 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:28.627241 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bceeb25-1635-4799-bc18-a8479cf80e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:28.627732 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bceeb25-1635-4799-bc18-a8479cf80e68 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:28.629114 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bceeb25-1635-4799-bc18-a8479cf80e68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:28.631936 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bceeb25-1635-4799-bc18-a8479cf80e68 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:28.653506 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233fce84-6c7c-4787-8cbd-d5f46b24ccda admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:28.666445 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 988/1977] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:28:28 2022] POST /identity/v3/users => generated 298 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:28.666652 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ae23d-b7f6-4ccd-a431-de3ca435e734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:28.666822 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bceeb25-1635-4799-bc18-a8479cf80e68 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:28.666956 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ae23d-b7f6-4ccd-a431-de3ca435e734 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:28.666956 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ae23d-b7f6-4ccd-a431-de3ca435e734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:28.666956 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ae23d-b7f6-4ccd-a431-de3ca435e734 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:28.666956 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ae23d-b7f6-4ccd-a431-de3ca435e734 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:28.678666 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ae23d-b7f6-4ccd-a431-de3ca435e734 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:28.684923 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bceeb25-1635-4799-bc18-a8479cf80e68 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:28.691333 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3fa95-a10e-4733-8c79-88c3ec6b02e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:28.692083 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3fa95-a10e-4733-8c79-88c3ec6b02e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:28.693417 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3fa95-a10e-4733-8c79-88c3ec6b02e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:28.693781 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3fa95-a10e-4733-8c79-88c3ec6b02e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:28.694621 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e3fa95-a10e-4733-8c79-88c3ec6b02e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:28.697189 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e3fa95-a10e-4733-8c79-88c3ec6b02e1 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:28.725286 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 989/1978] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:28:28 2022] POST /identity/v3/users => generated 296 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:28.726450 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3fa95-a10e-4733-8c79-88c3ec6b02e1 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:28.729736 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-a7e3fa95-a10e-4733-8c79-88c3ec6b02e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:28.734471 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 990/1979] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:28:28 2022] POST /identity/v3/projects => generated 371 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:28.735568 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ae23d-b7f6-4ccd-a431-de3ca435e734 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:28.744264 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3fa95-a10e-4733-8c79-88c3ec6b02e1 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:28.767081 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:28.810443 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d9129c-2654-4e97-8097-85677dd3610b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:28.810953 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9129c-2654-4e97-8097-85677dd3610b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:28.811260 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9129c-2654-4e97-8097-85677dd3610b admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:28.811584 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9129c-2654-4e97-8097-85677dd3610b admin admin] PATH_INFO: `/v3/projects/48453b41a76a4b90b266118b0153221d` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:28.812843 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d9129c-2654-4e97-8097-85677dd3610b admin admin] RBAC: Authorizing `identity:delete_project(project_id=48453b41a76a4b90b266118b0153221d)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:28.814794 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d9129c-2654-4e97-8097-85677dd3610b admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:28.829101 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ae23d-b7f6-4ccd-a431-de3ca435e734 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:28.835732 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc125e-3ab4-4f6e-ad2e-773e8dc2caac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:28.836417 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc125e-3ab4-4f6e-ad2e-773e8dc2caac admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:28.836792 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc125e-3ab4-4f6e-ad2e-773e8dc2caac admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:28.837073 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc125e-3ab4-4f6e-ad2e-773e8dc2caac admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:28.837736 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc125e-3ab4-4f6e-ad2e-773e8dc2caac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:28.839571 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc125e-3ab4-4f6e-ad2e-773e8dc2caac admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:28.858239 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 991/1980] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:28 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:28.859239 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc125e-3ab4-4f6e-ad2e-773e8dc2caac admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:28.876858 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-89d9129c-2654-4e97-8097-85677dd3610b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48453b41a76a4b90b266118b0153221d', 'request_id': 'req-89d9129c-2654-4e97-8097-85677dd3610b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:28.885770 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-89d9129c-2654-4e97-8097-85677dd3610b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48453b41a76a4b90b266118b0153221d', 'request_id': 'req-89d9129c-2654-4e97-8097-85677dd3610b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:28.886233 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc125e-3ab4-4f6e-ad2e-773e8dc2caac admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:28.907298 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:28.912144 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-89d9129c-2654-4e97-8097-85677dd3610b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48453b41a76a4b90b266118b0153221d', 'request_id': 'req-89d9129c-2654-4e97-8097-85677dd3610b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:28.926913 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-89d9129c-2654-4e97-8097-85677dd3610b admin admin] The token cache is being invalidate because project 48453b41a76a4b90b266118b0153221d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:28:28.927280 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-89d9129c-2654-4e97-8097-85677dd3610b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:28.928076 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-89d9129c-2654-4e97-8097-85677dd3610b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:28.933658 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 990/1981] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:28:28 2022] DELETE /identity/v3/projects/48453b41a76a4b90b266118b0153221d => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:28.933658 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d9129c-2654-4e97-8097-85677dd3610b admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:28.933658 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-89d9129c-2654-4e97-8097-85677dd3610b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:28.999372 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68364df-14c6-4426-a8fe-1b01d36c4670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:29.000009 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68364df-14c6-4426-a8fe-1b01d36c4670 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:29.000289 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68364df-14c6-4426-a8fe-1b01d36c4670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:29.005695 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68364df-14c6-4426-a8fe-1b01d36c4670 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:29.006791 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68364df-14c6-4426-a8fe-1b01d36c4670 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:29.008902 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68364df-14c6-4426-a8fe-1b01d36c4670 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:29.039282 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 992/1982] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:28 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:29.040240 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68364df-14c6-4426-a8fe-1b01d36c4670 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:29.045939 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f68364df-14c6-4426-a8fe-1b01d36c4670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:29.076987 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68364df-14c6-4426-a8fe-1b01d36c4670 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:29.093693 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d5141-810a-4467-bb8c-5e4349bfc729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:29.096251 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d5141-810a-4467-bb8c-5e4349bfc729 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:29.096566 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d5141-810a-4467-bb8c-5e4349bfc729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:29.096931 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d5141-810a-4467-bb8c-5e4349bfc729 admin admin] PATH_INFO: `/v3/projects/2ff81bee29d6430b835c247eaad93fa4/users/5612fdc4772f4e91870bb25c4700845a/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:29.097508 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d9129c-2654-4e97-8097-85677dd3610b admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:29.110587 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5740836-f584-4cfe-8908-82061fd3ad95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:29.112856 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5740836-f584-4cfe-8908-82061fd3ad95 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:29.113137 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5740836-f584-4cfe-8908-82061fd3ad95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:29.113412 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5740836-f584-4cfe-8908-82061fd3ad95 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:29.114058 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5740836-f584-4cfe-8908-82061fd3ad95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:29.117293 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5740836-f584-4cfe-8908-82061fd3ad95 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:29.122472 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783d5141-810a-4467-bb8c-5e4349bfc729 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ff81bee29d6430b835c247eaad93fa4, user_id=5612fdc4772f4e91870bb25c4700845a, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:29.125307 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783d5141-810a-4467-bb8c-5e4349bfc729 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:29.148961 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 993/1984] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:28:29 2022] PUT /identity/v3/projects/2ff81bee29d6430b835c247eaad93fa4/users/5612fdc4772f4e91870bb25c4700845a/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:29.149140 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 991/1984] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:28:28 2022] POST /identity/v3/users => generated 286 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:29.149140 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5740836-f584-4cfe-8908-82061fd3ad95 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:29.149313 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1c012-fd55-4d0c-8e89-7cd82ba3bcef None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:29.149313 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1c012-fd55-4d0c-8e89-7cd82ba3bcef None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:29.149313 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1c012-fd55-4d0c-8e89-7cd82ba3bcef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:29.151149 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b5740836-f584-4cfe-8908-82061fd3ad95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:29.171503 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5740836-f584-4cfe-8908-82061fd3ad95 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:29.178498 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-a2a1c012-fd55-4d0c-8e89-7cd82ba3bcef None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:29.180295 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a2a1c012-fd55-4d0c-8e89-7cd82ba3bcef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:29.236793 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:29.263885 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 994/1985] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:29.263885 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a1c012-fd55-4d0c-8e89-7cd82ba3bcef None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:29.275353 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a1c012-fd55-4d0c-8e89-7cd82ba3bcef None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:29.280377 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3365d325-30b9-46ab-97a0-ae4eabd4557c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:29.280992 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365d325-30b9-46ab-97a0-ae4eabd4557c admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:29.281270 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365d325-30b9-46ab-97a0-ae4eabd4557c admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:29.281539 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365d325-30b9-46ab-97a0-ae4eabd4557c admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:29.282276 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3365d325-30b9-46ab-97a0-ae4eabd4557c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:29.283896 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3365d325-30b9-46ab-97a0-ae4eabd4557c admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:29.290368 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b92ba4-8072-42fe-8518-43d4feda7750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:29.291820 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b92ba4-8072-42fe-8518-43d4feda7750 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:29.292353 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b92ba4-8072-42fe-8518-43d4feda7750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:29.294033 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b92ba4-8072-42fe-8518-43d4feda7750 admin admin] PATH_INFO: `/v3/projects/f86d5dc590b3403497aa42d53a05a937/users/0b36127cbeca48b19fe698bebd1202f5/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:29.295398 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 995/1986] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:29.296636 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3365d325-30b9-46ab-97a0-ae4eabd4557c admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:29.308215 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3365d325-30b9-46ab-97a0-ae4eabd4557c admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:29.313099 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b92ba4-8072-42fe-8518-43d4feda7750 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f86d5dc590b3403497aa42d53a05a937, user_id=0b36127cbeca48b19fe698bebd1202f5, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:29.313655 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d11981-3576-4280-91ff-22c19cf12f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:29.314613 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d11981-3576-4280-91ff-22c19cf12f59 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:29.314957 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d11981-3576-4280-91ff-22c19cf12f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:29.315296 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d11981-3576-4280-91ff-22c19cf12f59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:29.316408 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b92ba4-8072-42fe-8518-43d4feda7750 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:29.316679 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d11981-3576-4280-91ff-22c19cf12f59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:29.318497 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d11981-3576-4280-91ff-22c19cf12f59 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:29.330959 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 996/1987] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:29.332729 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca93c2-c65b-40b0-afaa-28b4a66048fa None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:29.332981 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca93c2-c65b-40b0-afaa-28b4a66048fa None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:29.333237 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca93c2-c65b-40b0-afaa-28b4a66048fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:29.337182 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 992/1988] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:28:29 2022] PUT /identity/v3/projects/f86d5dc590b3403497aa42d53a05a937/users/0b36127cbeca48b19fe698bebd1202f5/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:29.338035 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b92ba4-8072-42fe-8518-43d4feda7750 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:29.358437 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-e5ca93c2-c65b-40b0-afaa-28b4a66048fa None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:29.359737 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e5ca93c2-c65b-40b0-afaa-28b4a66048fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:29.428321 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b92ba4-8072-42fe-8518-43d4feda7750 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:29.428626 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 997/1989] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:29.430065 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca93c2-c65b-40b0-afaa-28b4a66048fa None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:29.436648 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:29.436897 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e90720-99f0-404c-ab25-d777a2fc10d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:29.438149 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e90720-99f0-404c-ab25-d777a2fc10d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:29.438589 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e90720-99f0-404c-ab25-d777a2fc10d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:29.439238 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e90720-99f0-404c-ab25-d777a2fc10d0 admin admin] PATH_INFO: `/v3/projects/2ff81bee29d6430b835c247eaad93fa4/users/5612fdc4772f4e91870bb25c4700845a/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:29.441249 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca93c2-c65b-40b0-afaa-28b4a66048fa None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:29.441813 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e90720-99f0-404c-ab25-d777a2fc10d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ff81bee29d6430b835c247eaad93fa4, user_id=5612fdc4772f4e91870bb25c4700845a, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:29.446618 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e90720-99f0-404c-ab25-d777a2fc10d0 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:29.447385 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49086797-c686-4503-9ec3-d63c6dcf8303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:29.448706 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49086797-c686-4503-9ec3-d63c6dcf8303 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:29.448993 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49086797-c686-4503-9ec3-d63c6dcf8303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:29.449279 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49086797-c686-4503-9ec3-d63c6dcf8303 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:29.449984 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49086797-c686-4503-9ec3-d63c6dcf8303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:29.452429 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49086797-c686-4503-9ec3-d63c6dcf8303 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:29.460551 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 993/1990] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:28:29 2022] PUT /identity/v3/projects/2ff81bee29d6430b835c247eaad93fa4/users/5612fdc4772f4e91870bb25c4700845a/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:29.461491 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e90720-99f0-404c-ab25-d777a2fc10d0 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:29.469134 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 998/1991] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:29.474123 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49086797-c686-4503-9ec3-d63c6dcf8303 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:29.489861 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49086797-c686-4503-9ec3-d63c6dcf8303 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:29.560373 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4268fe54-4064-4d2e-ad26-65bcab9644a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:29.561361 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268fe54-4064-4d2e-ad26-65bcab9644a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:29.561708 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268fe54-4064-4d2e-ad26-65bcab9644a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:29.561982 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268fe54-4064-4d2e-ad26-65bcab9644a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:29.562636 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4268fe54-4064-4d2e-ad26-65bcab9644a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:28:29.562939 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4268fe54-4064-4d2e-ad26-65bcab9644a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:29.564638 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4268fe54-4064-4d2e-ad26-65bcab9644a1 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:29.564836 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e90720-99f0-404c-ab25-d777a2fc10d0 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:29.570433 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f168c1-1e4a-4229-a59c-b64de9249abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:29.572242 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f168c1-1e4a-4229-a59c-b64de9249abe admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:29.572242 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f168c1-1e4a-4229-a59c-b64de9249abe admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:29.572242 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f168c1-1e4a-4229-a59c-b64de9249abe admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:29.573034 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f168c1-1e4a-4229-a59c-b64de9249abe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:29.574707 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f168c1-1e4a-4229-a59c-b64de9249abe admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:29.581963 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 999/1992] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:28:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:28:29.584608 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4268fe54-4064-4d2e-ad26-65bcab9644a1 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:29.598191 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 994/1993] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:29.598635 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4268fe54-4064-4d2e-ad26-65bcab9644a1 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:29.600679 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372da74e-6564-42d3-9b67-c6e4b1f90891 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:29.601453 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372da74e-6564-42d3-9b67-c6e4b1f90891 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:29.601871 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372da74e-6564-42d3-9b67-c6e4b1f90891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:29.606583 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9167bdc-a55f-45cc-8bb9-a398de9010cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:29.608002 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9167bdc-a55f-45cc-8bb9-a398de9010cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:29.608375 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9167bdc-a55f-45cc-8bb9-a398de9010cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:29.608775 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9167bdc-a55f-45cc-8bb9-a398de9010cd admin admin] PATH_INFO: `/v3/projects/24e0737363dd49af99f715a1749d08f1/users/254347be36924cf4b754b2a0db7f9f7b/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:29.630084 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9167bdc-a55f-45cc-8bb9-a398de9010cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=24e0737363dd49af99f715a1749d08f1, user_id=254347be36924cf4b754b2a0db7f9f7b, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:29.634003 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9167bdc-a55f-45cc-8bb9-a398de9010cd admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:29.640844 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-372da74e-6564-42d3-9b67-c6e4b1f90891 None None] MFA Rules not processed for user `5612fdc4772f4e91870bb25c4700845a`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:29.642395 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-372da74e-6564-42d3-9b67-c6e4b1f90891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:29.653551 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1000/1994] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:28:29 2022] PUT /identity/v3/projects/24e0737363dd49af99f715a1749d08f1/users/254347be36924cf4b754b2a0db7f9f7b/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:29.654520 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9167bdc-a55f-45cc-8bb9-a398de9010cd admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:29.702593 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:29.723888 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9167bdc-a55f-45cc-8bb9-a398de9010cd admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:29.728633 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35befd23-228c-48c2-ad38-3153ec55b1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:29.729386 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35befd23-228c-48c2-ad38-3153ec55b1fc admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:29.729767 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35befd23-228c-48c2-ad38-3153ec55b1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:29.730136 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35befd23-228c-48c2-ad38-3153ec55b1fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:29.730850 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35befd23-228c-48c2-ad38-3153ec55b1fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:29.732856 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35befd23-228c-48c2-ad38-3153ec55b1fc admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:29.737997 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 995/1995] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:29 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:29.737997 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372da74e-6564-42d3-9b67-c6e4b1f90891 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:29.746944 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372da74e-6564-42d3-9b67-c6e4b1f90891 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:29.751777 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83723d1-ea96-4be3-8ca9-3cf1a964050e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:29.752822 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83723d1-ea96-4be3-8ca9-3cf1a964050e admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:29.753639 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83723d1-ea96-4be3-8ca9-3cf1a964050e admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:29.753639 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83723d1-ea96-4be3-8ca9-3cf1a964050e admin admin] PATH_INFO: `/v3/projects/f86d5dc590b3403497aa42d53a05a937/users/0b36127cbeca48b19fe698bebd1202f5/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:29.756140 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83723d1-ea96-4be3-8ca9-3cf1a964050e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f86d5dc590b3403497aa42d53a05a937, user_id=0b36127cbeca48b19fe698bebd1202f5, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:29.758865 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83723d1-ea96-4be3-8ca9-3cf1a964050e admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:29.770818 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1001/1996] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:28:29 2022] POST /identity/v3/projects => generated 387 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:29.770818 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a13ece3-90c5-488b-be03-a99cf3c36aa3 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:29.770818 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a13ece3-90c5-488b-be03-a99cf3c36aa3 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:29.770818 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a13ece3-90c5-488b-be03-a99cf3c36aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:29.775614 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 996/1997] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:28:29 2022] PUT /identity/v3/projects/f86d5dc590b3403497aa42d53a05a937/users/0b36127cbeca48b19fe698bebd1202f5/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:29.776245 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83723d1-ea96-4be3-8ca9-3cf1a964050e admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:29.777794 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-e83723d1-ea96-4be3-8ca9-3cf1a964050e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:29.798038 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-8a13ece3-90c5-488b-be03-a99cf3c36aa3 None None] MFA Rules not processed for user `254347be36924cf4b754b2a0db7f9f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:29.799495 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-8a13ece3-90c5-488b-be03-a99cf3c36aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:29.839958 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83723d1-ea96-4be3-8ca9-3cf1a964050e admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:29.844917 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:29.877345 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1002/1998] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:29.878715 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a13ece3-90c5-488b-be03-a99cf3c36aa3 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:29.904024 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee594bb9-d4d2-479c-aa63-fede99cebe2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:29.904869 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee594bb9-d4d2-479c-aa63-fede99cebe2d service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:29.905149 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee594bb9-d4d2-479c-aa63-fede99cebe2d service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:29.905418 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee594bb9-d4d2-479c-aa63-fede99cebe2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:29.907277 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ee594bb9-d4d2-479c-aa63-fede99cebe2d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:29.962981 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a13ece3-90c5-488b-be03-a99cf3c36aa3 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:29.967854 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee594bb9-d4d2-479c-aa63-fede99cebe2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:29.968215 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c564d2-ee69-4c88-8a40-3f0e96fc386b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:29.968985 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c564d2-ee69-4c88-8a40-3f0e96fc386b admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:29.969270 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c564d2-ee69-4c88-8a40-3f0e96fc386b admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:29.969451 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee594bb9-d4d2-479c-aa63-fede99cebe2d service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:29.969548 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c564d2-ee69-4c88-8a40-3f0e96fc386b admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:29.970324 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c564d2-ee69-4c88-8a40-3f0e96fc386b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:29.972620 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c564d2-ee69-4c88-8a40-3f0e96fc386b admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:29.978922 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 997/1999] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:28:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:28:29.980310 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c243a07-4da3-432a-9906-c7a132991c40 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:29.980631 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c243a07-4da3-432a-9906-c7a132991c40 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:29.980960 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c243a07-4da3-432a-9906-c7a132991c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:29.999909 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1003/2000] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:28:29 2022] POST /identity/v3/users => generated 294 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:29.999909 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c564d2-ee69-4c88-8a40-3f0e96fc386b admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:30.001287 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-76c564d2-ee69-4c88-8a40-3f0e96fc386b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:30.015039 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c564d2-ee69-4c88-8a40-3f0e96fc386b admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:30.015429 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-5c243a07-4da3-432a-9906-c7a132991c40 None None] MFA Rules not processed for user `0b36127cbeca48b19fe698bebd1202f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:30.016797 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-5c243a07-4da3-432a-9906-c7a132991c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:30.019164 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58c6bd-0758-456e-8610-7b9224c84941 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:30.019782 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58c6bd-0758-456e-8610-7b9224c84941 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:30.020128 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58c6bd-0758-456e-8610-7b9224c84941 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:30.020413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58c6bd-0758-456e-8610-7b9224c84941 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:30.030221 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b58c6bd-0758-456e-8610-7b9224c84941 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:30.032158 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b58c6bd-0758-456e-8610-7b9224c84941 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:30.043103 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1004/2001] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:28:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:28:30.044232 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58c6bd-0758-456e-8610-7b9224c84941 service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:30.055670 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58c6bd-0758-456e-8610-7b9224c84941 service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:30.060364 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:30.067731 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1fe0e-4578-41ec-8b6a-7c03975a0fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:30.068402 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1fe0e-4578-41ec-8b6a-7c03975a0fad admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:30.068718 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1fe0e-4578-41ec-8b6a-7c03975a0fad admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:30.068992 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1fe0e-4578-41ec-8b6a-7c03975a0fad admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:30.069689 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b1fe0e-4578-41ec-8b6a-7c03975a0fad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:30.071356 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b1fe0e-4578-41ec-8b6a-7c03975a0fad admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:30.083258 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1005/2002] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:30.084337 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1fe0e-4578-41ec-8b6a-7c03975a0fad admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:30.099027 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1fe0e-4578-41ec-8b6a-7c03975a0fad admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:30.107374 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b877f38-6d1a-4395-a7ab-ba5b8205c9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:30.108658 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b877f38-6d1a-4395-a7ab-ba5b8205c9d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:30.109171 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b877f38-6d1a-4395-a7ab-ba5b8205c9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:30.110732 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b877f38-6d1a-4395-a7ab-ba5b8205c9d2 admin admin] PATH_INFO: `/v3/users/254347be36924cf4b754b2a0db7f9f7b` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:30.112549 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b877f38-6d1a-4395-a7ab-ba5b8205c9d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=254347be36924cf4b754b2a0db7f9f7b)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:30.116120 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b877f38-6d1a-4395-a7ab-ba5b8205c9d2 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:30.138439 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 998/2003] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:29 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:30.139557 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c243a07-4da3-432a-9906-c7a132991c40 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:30.150904 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c243a07-4da3-432a-9906-c7a132991c40 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:30.157341 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e4b72f-3588-43dc-85dd-66e093cf58a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:30.158798 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4b72f-3588-43dc-85dd-66e093cf58a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:30.159090 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4b72f-3588-43dc-85dd-66e093cf58a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:30.159457 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4b72f-3588-43dc-85dd-66e093cf58a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:30.160303 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e4b72f-3588-43dc-85dd-66e093cf58a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:30.162488 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e4b72f-3588-43dc-85dd-66e093cf58a1 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:30.177524 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 999/2004] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:30.178599 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e4b72f-3588-43dc-85dd-66e093cf58a1 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:30.192329 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e4b72f-3588-43dc-85dd-66e093cf58a1 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:30.197282 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9b877f38-6d1a-4395-a7ab-ba5b8205c9d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '254347be36924cf4b754b2a0db7f9f7b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:30.197676 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224093d-e713-46f2-bdbc-cb9c560ac1df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:30.198461 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224093d-e713-46f2-bdbc-cb9c560ac1df service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:30.198882 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224093d-e713-46f2-bdbc-cb9c560ac1df service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:30.199751 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224093d-e713-46f2-bdbc-cb9c560ac1df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:30.209935 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9b877f38-6d1a-4395-a7ab-ba5b8205c9d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '254347be36924cf4b754b2a0db7f9f7b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:30.214918 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5224093d-e713-46f2-bdbc-cb9c560ac1df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:30.216716 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5224093d-e713-46f2-bdbc-cb9c560ac1df service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:30.220883 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9b877f38-6d1a-4395-a7ab-ba5b8205c9d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '254347be36924cf4b754b2a0db7f9f7b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:30.221685 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9b877f38-6d1a-4395-a7ab-ba5b8205c9d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '254347be36924cf4b754b2a0db7f9f7b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:30.235037 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1000/2005] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:28:30 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:28:30.236076 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224093d-e713-46f2-bdbc-cb9c560ac1df service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:30.246424 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9b877f38-6d1a-4395-a7ab-ba5b8205c9d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '254347be36924cf4b754b2a0db7f9f7b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:30.248961 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224093d-e713-46f2-bdbc-cb9c560ac1df service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:30.257562 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e6dbf-43bf-4e4a-b6bf-dfed4eb546c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:30.260082 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e6dbf-43bf-4e4a-b6bf-dfed4eb546c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:30.260387 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e6dbf-43bf-4e4a-b6bf-dfed4eb546c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:30.260692 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e6dbf-43bf-4e4a-b6bf-dfed4eb546c3 admin admin] PATH_INFO: `/v3/projects/ddbce3e262a5434abf2b7afdeebb24da/users/aff66a6263cd4dc2979c02b83c3fd2f5/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:30.266401 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1006/2006] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:28:30 2022] DELETE /identity/v3/users/254347be36924cf4b754b2a0db7f9f7b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:30.268105 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12f57a-d5fb-4e9e-8a2d-a92ac69a005e None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:30.268598 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12f57a-d5fb-4e9e-8a2d-a92ac69a005e None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:30.268875 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12f57a-d5fb-4e9e-8a2d-a92ac69a005e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:30.290414 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75e6dbf-43bf-4e4a-b6bf-dfed4eb546c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddbce3e262a5434abf2b7afdeebb24da, user_id=aff66a6263cd4dc2979c02b83c3fd2f5, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:30.294203 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75e6dbf-43bf-4e4a-b6bf-dfed4eb546c3 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:30.315511 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-7c12f57a-d5fb-4e9e-8a2d-a92ac69a005e None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:30.330451 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1001/2007] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:28:30 2022] PUT /identity/v3/projects/ddbce3e262a5434abf2b7afdeebb24da/users/aff66a6263cd4dc2979c02b83c3fd2f5/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:30.332481 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-7c12f57a-d5fb-4e9e-8a2d-a92ac69a005e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:30.351352 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc02968-519d-48d0-8b54-bc47ad42dd49 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:30.352940 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc02968-519d-48d0-8b54-bc47ad42dd49 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:30.352940 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc02968-519d-48d0-8b54-bc47ad42dd49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:30.363112 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:30.417272 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-8bc02968-519d-48d0-8b54-bc47ad42dd49 None None] MFA Rules not processed for user `aff66a6263cd4dc2979c02b83c3fd2f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:30.419075 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-8bc02968-519d-48d0-8b54-bc47ad42dd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:30.452174 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1007/2008] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:30.460258 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c12f57a-d5fb-4e9e-8a2d-a92ac69a005e None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:30.462694 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-7c12f57a-d5fb-4e9e-8a2d-a92ac69a005e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:30.593675 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1002/2009] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:30 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:28:30.598296 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc02968-519d-48d0-8b54-bc47ad42dd49 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:30.599965 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-8bc02968-519d-48d0-8b54-bc47ad42dd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:30.610115 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c12f57a-d5fb-4e9e-8a2d-a92ac69a005e None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:30.615892 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc02968-519d-48d0-8b54-bc47ad42dd49 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:30.620174 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35528327-4677-49c7-9bdf-f59de99b6a0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:30.620881 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35528327-4677-49c7-9bdf-f59de99b6a0b service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:30.621038 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9bcdb-8202-467c-9d20-1223bf6f3df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:30.621244 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35528327-4677-49c7-9bdf-f59de99b6a0b service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:30.621974 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9bcdb-8202-467c-9d20-1223bf6f3df7 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:30.622253 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9bcdb-8202-467c-9d20-1223bf6f3df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:30.622525 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9bcdb-8202-467c-9d20-1223bf6f3df7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:30.622721 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35528327-4677-49c7-9bdf-f59de99b6a0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:30.623160 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee9bcdb-8202-467c-9d20-1223bf6f3df7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:30.625160 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee9bcdb-8202-467c-9d20-1223bf6f3df7 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:30.638574 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35528327-4677-49c7-9bdf-f59de99b6a0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:30.641483 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35528327-4677-49c7-9bdf-f59de99b6a0b service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:30.657289 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1008/2010] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:28:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:28:30.663971 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1003/2011] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:28:30 2022] POST /identity/v3/projects => generated 387 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:28:30.667008 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35528327-4677-49c7-9bdf-f59de99b6a0b service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:30.681631 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35528327-4677-49c7-9bdf-f59de99b6a0b service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:30.753950 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2270dbe-6477-486f-b09d-bc62648fbc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:30.754508 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2270dbe-6477-486f-b09d-bc62648fbc6d admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:30.754981 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2270dbe-6477-486f-b09d-bc62648fbc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:30.756126 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2270dbe-6477-486f-b09d-bc62648fbc6d admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:30.757069 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2270dbe-6477-486f-b09d-bc62648fbc6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:30.760361 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2270dbe-6477-486f-b09d-bc62648fbc6d admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:30.794475 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1009/2012] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:28:30 2022] POST /identity/v3/users => generated 294 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:30.796314 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9bcdb-8202-467c-9d20-1223bf6f3df7 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:30.813339 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9bcdb-8202-467c-9d20-1223bf6f3df7 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:30.819589 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b0ffe-69a0-48a5-8710-f7d173494301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:30.820227 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b0ffe-69a0-48a5-8710-f7d173494301 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:30.820556 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b0ffe-69a0-48a5-8710-f7d173494301 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:30.820858 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b0ffe-69a0-48a5-8710-f7d173494301 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:30.821509 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830b0ffe-69a0-48a5-8710-f7d173494301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:30.823350 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830b0ffe-69a0-48a5-8710-f7d173494301 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:30.846976 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1004/2013] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:30.848344 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2270dbe-6477-486f-b09d-bc62648fbc6d admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:30.865324 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2270dbe-6477-486f-b09d-bc62648fbc6d admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:30.872811 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a0e52-1486-4509-8c3d-04e007a7d467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:30.873480 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a0e52-1486-4509-8c3d-04e007a7d467 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:30.873842 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a0e52-1486-4509-8c3d-04e007a7d467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:30.874086 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a0e52-1486-4509-8c3d-04e007a7d467 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:30.874967 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90a0e52-1486-4509-8c3d-04e007a7d467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:30.877340 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90a0e52-1486-4509-8c3d-04e007a7d467 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:30.893579 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b0ffe-69a0-48a5-8710-f7d173494301 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:30.896274 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-830b0ffe-69a0-48a5-8710-f7d173494301 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:30.909939 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1010/2014] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:30.912837 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a0e52-1486-4509-8c3d-04e007a7d467 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:30.928601 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a0e52-1486-4509-8c3d-04e007a7d467 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:30.933744 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e0331-3836-4fa2-a03b-19c553d46aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:30.934420 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e0331-3836-4fa2-a03b-19c553d46aba admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:30.934710 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e0331-3836-4fa2-a03b-19c553d46aba admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:30.935029 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e0331-3836-4fa2-a03b-19c553d46aba admin admin] PATH_INFO: `/v3/projects/0f6029b0dbd14dca9cfe6ae90b2e334f/users/55b4f62b5160401a82708ddcfca60322/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:30.946946 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:30.957609 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2e0331-3836-4fa2-a03b-19c553d46aba admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f6029b0dbd14dca9cfe6ae90b2e334f, user_id=55b4f62b5160401a82708ddcfca60322, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:30.961518 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2e0331-3836-4fa2-a03b-19c553d46aba admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:30.980521 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1011/2015] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:28:30 2022] PUT /identity/v3/projects/0f6029b0dbd14dca9cfe6ae90b2e334f/users/55b4f62b5160401a82708ddcfca60322/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:30.989156 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b0ffe-69a0-48a5-8710-f7d173494301 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:30.992554 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d370e6-a61d-451d-ae5d-32069dfd0918 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:30.993101 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d370e6-a61d-451d-ae5d-32069dfd0918 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:30.993461 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d370e6-a61d-451d-ae5d-32069dfd0918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:31.039667 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:31.044423 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-39d370e6-a61d-451d-ae5d-32069dfd0918 None None] MFA Rules not processed for user `55b4f62b5160401a82708ddcfca60322`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:31.046931 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-39d370e6-a61d-451d-ae5d-32069dfd0918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:31.061338 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b3c8e-736e-4637-a92b-46d8422f1c52 tempest-VolumeQuotaClassesTest-758684660 tempest-VolumeQuotaClassesTest-758684660-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b36127cbeca48b19fe698bebd1202f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f86d5dc590b3403497aa42d53a05a937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:31.062304 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b3c8e-736e-4637-a92b-46d8422f1c52 tempest-VolumeQuotaClassesTest-758684660 tempest-VolumeQuotaClassesTest-758684660-project-admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:31.062664 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b3c8e-736e-4637-a92b-46d8422f1c52 tempest-VolumeQuotaClassesTest-758684660 tempest-VolumeQuotaClassesTest-758684660-project-admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:31.063062 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b3c8e-736e-4637-a92b-46d8422f1c52 tempest-VolumeQuotaClassesTest-758684660 tempest-VolumeQuotaClassesTest-758684660-project-admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:31.065691 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789b3c8e-736e-4637-a92b-46d8422f1c52 tempest-VolumeQuotaClassesTest-758684660 tempest-VolumeQuotaClassesTest-758684660-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:28:31.065691 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789b3c8e-736e-4637-a92b-46d8422f1c52 tempest-VolumeQuotaClassesTest-758684660 tempest-VolumeQuotaClassesTest-758684660-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:31.066230 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789b3c8e-736e-4637-a92b-46d8422f1c52 tempest-VolumeQuotaClassesTest-758684660 tempest-VolumeQuotaClassesTest-758684660-project-admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:31.083481 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1005/2016] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:28:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:28:31.084735 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b3c8e-736e-4637-a92b-46d8422f1c52 tempest-VolumeQuotaClassesTest-758684660 tempest-VolumeQuotaClassesTest-758684660-project-admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:31.096970 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b3c8e-736e-4637-a92b-46d8422f1c52 tempest-VolumeQuotaClassesTest-758684660 tempest-VolumeQuotaClassesTest-758684660-project-admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:31.102366 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bd67e7-1cfb-4a76-9195-0f76dc5b33f5 tempest-VolumeQuotaClassesTest-758684660 tempest-VolumeQuotaClassesTest-758684660-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b36127cbeca48b19fe698bebd1202f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f86d5dc590b3403497aa42d53a05a937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:31.102987 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd67e7-1cfb-4a76-9195-0f76dc5b33f5 tempest-VolumeQuotaClassesTest-758684660 tempest-VolumeQuotaClassesTest-758684660-project-admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:31.103271 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd67e7-1cfb-4a76-9195-0f76dc5b33f5 tempest-VolumeQuotaClassesTest-758684660 tempest-VolumeQuotaClassesTest-758684660-project-admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:31.103547 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd67e7-1cfb-4a76-9195-0f76dc5b33f5 tempest-VolumeQuotaClassesTest-758684660 tempest-VolumeQuotaClassesTest-758684660-project-admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:31.104181 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bd67e7-1cfb-4a76-9195-0f76dc5b33f5 tempest-VolumeQuotaClassesTest-758684660 tempest-VolumeQuotaClassesTest-758684660-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:31.106132 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bd67e7-1cfb-4a76-9195-0f76dc5b33f5 tempest-VolumeQuotaClassesTest-758684660 tempest-VolumeQuotaClassesTest-758684660-project-admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:31.143182 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1012/2017] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:30 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:28:31.147758 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d370e6-a61d-451d-ae5d-32069dfd0918 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:31.149562 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1006/2018] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:28:31 2022] POST /identity/v3/projects => generated 353 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:31.151585 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bd67e7-1cfb-4a76-9195-0f76dc5b33f5 tempest-VolumeQuotaClassesTest-758684660 tempest-VolumeQuotaClassesTest-758684660-project-admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:31.232142 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d370e6-a61d-451d-ae5d-32069dfd0918 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:31.235476 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bd67e7-1cfb-4a76-9195-0f76dc5b33f5 tempest-VolumeQuotaClassesTest-758684660 tempest-VolumeQuotaClassesTest-758684660-project-admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:31.241260 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83700e6f-be2b-48ba-bbf1-d9ffef2c60cd tempest-VolumeQuotaClassesTest-758684660 tempest-VolumeQuotaClassesTest-758684660-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b36127cbeca48b19fe698bebd1202f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f86d5dc590b3403497aa42d53a05a937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:31.241901 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83700e6f-be2b-48ba-bbf1-d9ffef2c60cd tempest-VolumeQuotaClassesTest-758684660 tempest-VolumeQuotaClassesTest-758684660-project-admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:31.242195 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83700e6f-be2b-48ba-bbf1-d9ffef2c60cd tempest-VolumeQuotaClassesTest-758684660 tempest-VolumeQuotaClassesTest-758684660-project-admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:31.242860 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83700e6f-be2b-48ba-bbf1-d9ffef2c60cd tempest-VolumeQuotaClassesTest-758684660 tempest-VolumeQuotaClassesTest-758684660-project-admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:31.243177 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83700e6f-be2b-48ba-bbf1-d9ffef2c60cd tempest-VolumeQuotaClassesTest-758684660 tempest-VolumeQuotaClassesTest-758684660-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:28:31.243489 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83700e6f-be2b-48ba-bbf1-d9ffef2c60cd tempest-VolumeQuotaClassesTest-758684660 tempest-VolumeQuotaClassesTest-758684660-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:31.245468 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83700e6f-be2b-48ba-bbf1-d9ffef2c60cd tempest-VolumeQuotaClassesTest-758684660 tempest-VolumeQuotaClassesTest-758684660-project-admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:31.262887 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1007/2019] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:28:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:28:31.262887 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83700e6f-be2b-48ba-bbf1-d9ffef2c60cd tempest-VolumeQuotaClassesTest-758684660 tempest-VolumeQuotaClassesTest-758684660-project-admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:31.262887 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-83700e6f-be2b-48ba-bbf1-d9ffef2c60cd tempest-VolumeQuotaClassesTest-758684660 tempest-VolumeQuotaClassesTest-758684660-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:31.297358 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20386d1f-fb5b-4da7-9107-d9cb4c236fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:31.298304 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20386d1f-fb5b-4da7-9107-d9cb4c236fd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:31.298849 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20386d1f-fb5b-4da7-9107-d9cb4c236fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:31.299278 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20386d1f-fb5b-4da7-9107-d9cb4c236fd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:31.300233 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20386d1f-fb5b-4da7-9107-d9cb4c236fd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:31.303041 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20386d1f-fb5b-4da7-9107-d9cb4c236fd9 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:31.318484 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:31.332321 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1013/2020] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:28:31 2022] POST /identity/v3/projects => generated 387 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:31.336339 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20386d1f-fb5b-4da7-9107-d9cb4c236fd9 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:31.339546 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83700e6f-be2b-48ba-bbf1-d9ffef2c60cd tempest-VolumeQuotaClassesTest-758684660 tempest-VolumeQuotaClassesTest-758684660-project-admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:31.396509 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:31.419453 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d36987-e34c-4924-aaeb-849203f58db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:31.420102 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d36987-e34c-4924-aaeb-849203f58db6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:31.420380 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d36987-e34c-4924-aaeb-849203f58db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:31.420683 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d36987-e34c-4924-aaeb-849203f58db6 admin admin] PATH_INFO: `/v3/projects/24e0737363dd49af99f715a1749d08f1` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:31.421807 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d36987-e34c-4924-aaeb-849203f58db6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24e0737363dd49af99f715a1749d08f1)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:31.423782 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d36987-e34c-4924-aaeb-849203f58db6 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:31.426240 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20386d1f-fb5b-4da7-9107-d9cb4c236fd9 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:31.430812 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8eb52c-61b6-4876-a917-cb66c5377089 tempest-VolumeQuotaClassesTest-758684660 tempest-VolumeQuotaClassesTest-758684660-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b36127cbeca48b19fe698bebd1202f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f86d5dc590b3403497aa42d53a05a937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:31.431472 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8eb52c-61b6-4876-a917-cb66c5377089 tempest-VolumeQuotaClassesTest-758684660 tempest-VolumeQuotaClassesTest-758684660-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:31.431752 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8eb52c-61b6-4876-a917-cb66c5377089 tempest-VolumeQuotaClassesTest-758684660 tempest-VolumeQuotaClassesTest-758684660-project-admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:31.432026 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8eb52c-61b6-4876-a917-cb66c5377089 tempest-VolumeQuotaClassesTest-758684660 tempest-VolumeQuotaClassesTest-758684660-project-admin] PATH_INFO: `/v3/projects/7d655d52873e431087686003bf469b56` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:31.433157 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8eb52c-61b6-4876-a917-cb66c5377089 tempest-VolumeQuotaClassesTest-758684660 tempest-VolumeQuotaClassesTest-758684660-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7d655d52873e431087686003bf469b56)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:31.435112 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8eb52c-61b6-4876-a917-cb66c5377089 tempest-VolumeQuotaClassesTest-758684660 tempest-VolumeQuotaClassesTest-758684660-project-admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:31.483053 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-78d36987-e34c-4924-aaeb-849203f58db6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24e0737363dd49af99f715a1749d08f1', 'request_id': 'req-78d36987-e34c-4924-aaeb-849203f58db6'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:31.491531 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-78d36987-e34c-4924-aaeb-849203f58db6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24e0737363dd49af99f715a1749d08f1', 'request_id': 'req-78d36987-e34c-4924-aaeb-849203f58db6'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:31.502651 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-78d36987-e34c-4924-aaeb-849203f58db6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24e0737363dd49af99f715a1749d08f1', 'request_id': 'req-78d36987-e34c-4924-aaeb-849203f58db6'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:31.509376 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2d8eb52c-61b6-4876-a917-cb66c5377089 tempest-VolumeQuotaClassesTest-758684660 tempest-VolumeQuotaClassesTest-758684660-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d655d52873e431087686003bf469b56', 'request_id': 'req-2d8eb52c-61b6-4876-a917-cb66c5377089'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:31.517056 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2d8eb52c-61b6-4876-a917-cb66c5377089 tempest-VolumeQuotaClassesTest-758684660 tempest-VolumeQuotaClassesTest-758684660-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d655d52873e431087686003bf469b56', 'request_id': 'req-2d8eb52c-61b6-4876-a917-cb66c5377089'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:31.520353 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-78d36987-e34c-4924-aaeb-849203f58db6 admin admin] The token cache is being invalidate because project 24e0737363dd49af99f715a1749d08f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:28:31.520676 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-78d36987-e34c-4924-aaeb-849203f58db6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:31.529491 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-78d36987-e34c-4924-aaeb-849203f58db6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:31.530164 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2d8eb52c-61b6-4876-a917-cb66c5377089 tempest-VolumeQuotaClassesTest-758684660 tempest-VolumeQuotaClassesTest-758684660-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d655d52873e431087686003bf469b56', 'request_id': 'req-2d8eb52c-61b6-4876-a917-cb66c5377089'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:31.538141 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1008/2021] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:28:31 2022] DELETE /identity/v3/projects/24e0737363dd49af99f715a1749d08f1 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:31.539059 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d36987-e34c-4924-aaeb-849203f58db6 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:31.540496 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-78d36987-e34c-4924-aaeb-849203f58db6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:31.557439 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2d8eb52c-61b6-4876-a917-cb66c5377089 tempest-VolumeQuotaClassesTest-758684660 tempest-VolumeQuotaClassesTest-758684660-project-admin] The token cache is being invalidate because project 7d655d52873e431087686003bf469b56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:28:31.558085 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2d8eb52c-61b6-4876-a917-cb66c5377089 tempest-VolumeQuotaClassesTest-758684660 tempest-VolumeQuotaClassesTest-758684660-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:31.558946 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2d8eb52c-61b6-4876-a917-cb66c5377089 tempest-VolumeQuotaClassesTest-758684660 tempest-VolumeQuotaClassesTest-758684660-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:31.561639 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1014/2022] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:28:31 2022] DELETE /identity/v3/projects/7d655d52873e431087686003bf469b56 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:31.563260 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abca26d-95a7-44d9-a181-fb201bfe3e43 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:31.563683 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abca26d-95a7-44d9-a181-fb201bfe3e43 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:31.564156 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abca26d-95a7-44d9-a181-fb201bfe3e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:31.588149 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-8abca26d-95a7-44d9-a181-fb201bfe3e43 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:31.589440 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-8abca26d-95a7-44d9-a181-fb201bfe3e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:31.626572 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d36987-e34c-4924-aaeb-849203f58db6 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:31.669659 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:31.670835 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1015/2023] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:31.679473 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c9077-c505-4062-91b4-870aabecc281 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:31.680034 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c9077-c505-4062-91b4-870aabecc281 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:31.680354 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c9077-c505-4062-91b4-870aabecc281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:31.716502 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-de1c9077-c505-4062-91b4-870aabecc281 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:31.718037 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-de1c9077-c505-4062-91b4-870aabecc281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:31.718311 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06301083-7d6c-4992-b6b9-2b5611279e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:31.718958 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06301083-7d6c-4992-b6b9-2b5611279e8f admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:31.719293 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06301083-7d6c-4992-b6b9-2b5611279e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:31.719681 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06301083-7d6c-4992-b6b9-2b5611279e8f admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:31.721078 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06301083-7d6c-4992-b6b9-2b5611279e8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:31.724160 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06301083-7d6c-4992-b6b9-2b5611279e8f admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:31.730068 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1016/2024] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:28:31.734624 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c9077-c505-4062-91b4-870aabecc281 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:31.760486 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1009/2025] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:28:31 2022] POST /identity/v3/users => generated 300 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:31.760686 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c9077-c505-4062-91b4-870aabecc281 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:31.764948 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06301083-7d6c-4992-b6b9-2b5611279e8f admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:31.765140 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b9a4b-9aa1-4359-8474-aaf5c6ff5fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:31.765935 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b9a4b-9aa1-4359-8474-aaf5c6ff5fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:31.766316 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b9a4b-9aa1-4359-8474-aaf5c6ff5fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:31.766425 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-06301083-7d6c-4992-b6b9-2b5611279e8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:31.766966 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b9a4b-9aa1-4359-8474-aaf5c6ff5fe7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:31.768904 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33b9a4b-9aa1-4359-8474-aaf5c6ff5fe7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:28:31.769281 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33b9a4b-9aa1-4359-8474-aaf5c6ff5fe7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:31.771185 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33b9a4b-9aa1-4359-8474-aaf5c6ff5fe7 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:31.782657 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06301083-7d6c-4992-b6b9-2b5611279e8f admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:31.789323 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670bba69-7ec3-47f1-b558-bbb315316153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:31.790070 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bba69-7ec3-47f1-b558-bbb315316153 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:31.790416 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bba69-7ec3-47f1-b558-bbb315316153 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:31.790760 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bba69-7ec3-47f1-b558-bbb315316153 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:31.791504 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670bba69-7ec3-47f1-b558-bbb315316153 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:31.793051 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1017/2026] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:28:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:28:31.797355 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670bba69-7ec3-47f1-b558-bbb315316153 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:31.797973 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b9a4b-9aa1-4359-8474-aaf5c6ff5fe7 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:31.814362 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1010/2027] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:31.816796 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670bba69-7ec3-47f1-b558-bbb315316153 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:31.819196 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b9a4b-9aa1-4359-8474-aaf5c6ff5fe7 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:31.829384 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670bba69-7ec3-47f1-b558-bbb315316153 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:31.837229 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee45d56-f1dd-41d1-af5e-698bc96332f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:31.837971 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee45d56-f1dd-41d1-af5e-698bc96332f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:31.838273 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee45d56-f1dd-41d1-af5e-698bc96332f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:31.838594 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee45d56-f1dd-41d1-af5e-698bc96332f0 admin admin] PATH_INFO: `/v3/projects/4c2378aaeaae41f8952a2ebdbe6d43b5/users/747c05001c1f46a6bdad7f59c5a1d700/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:31.846069 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1058e-fd3c-4c65-84d0-741cbaf10c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:31.846909 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1058e-fd3c-4c65-84d0-741cbaf10c89 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:31.847780 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1058e-fd3c-4c65-84d0-741cbaf10c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:31.848207 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1058e-fd3c-4c65-84d0-741cbaf10c89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:31.849030 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f1058e-fd3c-4c65-84d0-741cbaf10c89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:31.858416 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f1058e-fd3c-4c65-84d0-741cbaf10c89 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:31.859663 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee45d56-f1dd-41d1-af5e-698bc96332f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c2378aaeaae41f8952a2ebdbe6d43b5, user_id=747c05001c1f46a6bdad7f59c5a1d700, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:31.863049 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee45d56-f1dd-41d1-af5e-698bc96332f0 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:31.904653 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1011/2028] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:28:31 2022] PUT /identity/v3/projects/4c2378aaeaae41f8952a2ebdbe6d43b5/users/747c05001c1f46a6bdad7f59c5a1d700/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:28:31.906572 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee45d56-f1dd-41d1-af5e-698bc96332f0 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:31.910437 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-cee45d56-f1dd-41d1-af5e-698bc96332f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:31.930462 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1018/2029] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:28:31 2022] POST /identity/v3/projects => generated 361 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:28:31.930462 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1058e-fd3c-4c65-84d0-741cbaf10c89 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:31.980204 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:32.020486 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee45d56-f1dd-41d1-af5e-698bc96332f0 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:32.027859 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1058e-fd3c-4c65-84d0-741cbaf10c89 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:32.032935 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f232d5-11f4-4592-9496-e103e5879f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:32.033730 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e04cbf-ed3c-42e3-9c58-d3915f0c9b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:32.034044 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f232d5-11f4-4592-9496-e103e5879f16 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:32.034991 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f232d5-11f4-4592-9496-e103e5879f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:32.034991 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f232d5-11f4-4592-9496-e103e5879f16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:32.035552 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f232d5-11f4-4592-9496-e103e5879f16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:32.043260 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f232d5-11f4-4592-9496-e103e5879f16 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:32.043441 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e04cbf-ed3c-42e3-9c58-d3915f0c9b31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:32.043441 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e04cbf-ed3c-42e3-9c58-d3915f0c9b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:32.043441 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e04cbf-ed3c-42e3-9c58-d3915f0c9b31 admin admin] PATH_INFO: `/v3/users/c17bb64209184c0c8e4d7447ab107af3` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:32.043441 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e04cbf-ed3c-42e3-9c58-d3915f0c9b31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c17bb64209184c0c8e4d7447ab107af3)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:32.045428 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e04cbf-ed3c-42e3-9c58-d3915f0c9b31 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:32.058597 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1019/2030] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:32.059939 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f232d5-11f4-4592-9496-e103e5879f16 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:32.082565 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f232d5-11f4-4592-9496-e103e5879f16 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:32.088184 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af0be6-5811-4d70-8353-ea2b10d72e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:32.089094 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af0be6-5811-4d70-8353-ea2b10d72e27 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:32.089356 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af0be6-5811-4d70-8353-ea2b10d72e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:32.089902 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af0be6-5811-4d70-8353-ea2b10d72e27 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:32.090729 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34af0be6-5811-4d70-8353-ea2b10d72e27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:32.092844 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34af0be6-5811-4d70-8353-ea2b10d72e27 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:32.120095 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1020/2031] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:28:32 2022] POST /identity/v3/users => generated 281 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:32.121266 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af0be6-5811-4d70-8353-ea2b10d72e27 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:32.123214 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-34af0be6-5811-4d70-8353-ea2b10d72e27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:32.165122 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-a9e04cbf-ed3c-42e3-9c58-d3915f0c9b31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c17bb64209184c0c8e4d7447ab107af3'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:32.177046 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-a9e04cbf-ed3c-42e3-9c58-d3915f0c9b31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c17bb64209184c0c8e4d7447ab107af3'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:32.177811 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-a9e04cbf-ed3c-42e3-9c58-d3915f0c9b31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c17bb64209184c0c8e4d7447ab107af3'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:32.187962 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-a9e04cbf-ed3c-42e3-9c58-d3915f0c9b31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c17bb64209184c0c8e4d7447ab107af3'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:32.189333 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-a9e04cbf-ed3c-42e3-9c58-d3915f0c9b31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c17bb64209184c0c8e4d7447ab107af3'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:32.203898 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af0be6-5811-4d70-8353-ea2b10d72e27 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:32.208310 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d5681b-2f3c-4298-aa4d-0b9cb2d24e36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:32.209034 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d5681b-2f3c-4298-aa4d-0b9cb2d24e36 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:32.209377 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d5681b-2f3c-4298-aa4d-0b9cb2d24e36 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:32.209652 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d5681b-2f3c-4298-aa4d-0b9cb2d24e36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:32.215781 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1012/2032] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:28:31 2022] DELETE /identity/v3/users/c17bb64209184c0c8e4d7447ab107af3 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:32.215781 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e04cbf-ed3c-42e3-9c58-d3915f0c9b31 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:32.217686 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f0d5681b-2f3c-4298-aa4d-0b9cb2d24e36 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:32.219051 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-a9e04cbf-ed3c-42e3-9c58-d3915f0c9b31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:32.231890 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:32.324729 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d5681b-2f3c-4298-aa4d-0b9cb2d24e36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:32.326483 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d5681b-2f3c-4298-aa4d-0b9cb2d24e36 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:32.327934 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e04cbf-ed3c-42e3-9c58-d3915f0c9b31 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:32.338933 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1021/2033] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:28:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:28:32.339956 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d5681b-2f3c-4298-aa4d-0b9cb2d24e36 service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:32.340653 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4030d4-7a58-4099-bc2a-9d445723e002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:32.341520 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4030d4-7a58-4099-bc2a-9d445723e002 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:32.341637 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f0d5681b-2f3c-4298-aa4d-0b9cb2d24e36 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:32.342046 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4030d4-7a58-4099-bc2a-9d445723e002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:32.342479 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4030d4-7a58-4099-bc2a-9d445723e002 admin admin] PATH_INFO: `/v3/projects/4c2378aaeaae41f8952a2ebdbe6d43b5/users/747c05001c1f46a6bdad7f59c5a1d700/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:32.344935 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4030d4-7a58-4099-bc2a-9d445723e002 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c2378aaeaae41f8952a2ebdbe6d43b5, user_id=747c05001c1f46a6bdad7f59c5a1d700, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:32.348768 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4030d4-7a58-4099-bc2a-9d445723e002 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:32.357880 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d5681b-2f3c-4298-aa4d-0b9cb2d24e36 service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:32.366516 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1013/2034] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:28:32 2022] PUT /identity/v3/projects/4c2378aaeaae41f8952a2ebdbe6d43b5/users/747c05001c1f46a6bdad7f59c5a1d700/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:32.367983 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c527be0-4dd0-4e70-be02-af74479a51dd None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:32.368273 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c527be0-4dd0-4e70-be02-af74479a51dd None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:32.368949 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c527be0-4dd0-4e70-be02-af74479a51dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:32.396492 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-2c527be0-4dd0-4e70-be02-af74479a51dd None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:32.398106 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-2c527be0-4dd0-4e70-be02-af74479a51dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:32.441064 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:32.450982 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283dbe2b-03ed-4daf-8aa5-44c99713445c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:32.451778 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283dbe2b-03ed-4daf-8aa5-44c99713445c admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:32.452328 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283dbe2b-03ed-4daf-8aa5-44c99713445c admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:32.452696 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283dbe2b-03ed-4daf-8aa5-44c99713445c admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:32.453808 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283dbe2b-03ed-4daf-8aa5-44c99713445c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:32.456190 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283dbe2b-03ed-4daf-8aa5-44c99713445c admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:32.472633 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1022/2035] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:32.474254 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3d24f-dd55-477c-8ec3-4fafdbcf96db None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:32.474648 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3d24f-dd55-477c-8ec3-4fafdbcf96db None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:32.474976 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3d24f-dd55-477c-8ec3-4fafdbcf96db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:32.476132 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1014/2036] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:32.477100 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c527be0-4dd0-4e70-be02-af74479a51dd None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:32.489380 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c527be0-4dd0-4e70-be02-af74479a51dd None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:32.495499 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba48795d-2d64-41f8-9dba-db4398c5acd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:32.496148 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba48795d-2d64-41f8-9dba-db4398c5acd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:32.497042 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba48795d-2d64-41f8-9dba-db4398c5acd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:32.497042 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba48795d-2d64-41f8-9dba-db4398c5acd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:32.497676 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba48795d-2d64-41f8-9dba-db4398c5acd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:32.499466 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba48795d-2d64-41f8-9dba-db4398c5acd8 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:32.510853 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-06e3d24f-dd55-477c-8ec3-4fafdbcf96db None None] MFA Rules not processed for user `747c05001c1f46a6bdad7f59c5a1d700`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:32.512219 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-06e3d24f-dd55-477c-8ec3-4fafdbcf96db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:32.516001 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1015/2037] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:32.516001 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba48795d-2d64-41f8-9dba-db4398c5acd8 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:32.516001 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ba48795d-2d64-41f8-9dba-db4398c5acd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:32.628931 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1023/2038] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:32 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:32.628931 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3d24f-dd55-477c-8ec3-4fafdbcf96db None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:32.639293 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3d24f-dd55-477c-8ec3-4fafdbcf96db None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:32.646447 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceca105-4b91-43d8-91a7-2acd54de9c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:32.647356 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceca105-4b91-43d8-91a7-2acd54de9c12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:32.647636 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceca105-4b91-43d8-91a7-2acd54de9c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:32.647910 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceca105-4b91-43d8-91a7-2acd54de9c12 admin admin] PATH_INFO: `/v3/projects/a55aade143784fea9e30076eae30f93b/users/498e75c8db5a431a983deae83485f049/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:32.658588 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba48795d-2d64-41f8-9dba-db4398c5acd8 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:32.663219 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964269f9-5e01-4b2e-a7e0-77dc33d96035 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:32.664076 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964269f9-5e01-4b2e-a7e0-77dc33d96035 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:32.664597 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964269f9-5e01-4b2e-a7e0-77dc33d96035 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:32.665049 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964269f9-5e01-4b2e-a7e0-77dc33d96035 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:32.678062 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964269f9-5e01-4b2e-a7e0-77dc33d96035 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:32.679436 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceca105-4b91-43d8-91a7-2acd54de9c12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a55aade143784fea9e30076eae30f93b, user_id=498e75c8db5a431a983deae83485f049, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:32.680139 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964269f9-5e01-4b2e-a7e0-77dc33d96035 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:32.688537 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceca105-4b91-43d8-91a7-2acd54de9c12 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:32.710975 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1016/2039] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:28:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:28:32.712062 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964269f9-5e01-4b2e-a7e0-77dc33d96035 service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:32.713880 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-964269f9-5e01-4b2e-a7e0-77dc33d96035 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:32.716115 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1024/2040] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:28:32 2022] PUT /identity/v3/projects/a55aade143784fea9e30076eae30f93b/users/498e75c8db5a431a983deae83485f049/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:32.727471 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c44f86-9d05-487e-b6a4-ddf9ddf8b211 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:32.727864 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c44f86-9d05-487e-b6a4-ddf9ddf8b211 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:32.728163 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c44f86-9d05-487e-b6a4-ddf9ddf8b211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:32.775607 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-96c44f86-9d05-487e-b6a4-ddf9ddf8b211 None None] MFA Rules not processed for user `498e75c8db5a431a983deae83485f049`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:32.777013 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-96c44f86-9d05-487e-b6a4-ddf9ddf8b211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:32.827516 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:32.886089 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1025/2041] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:28:32.887978 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964269f9-5e01-4b2e-a7e0-77dc33d96035 service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:32.979884 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db45069-266e-4266-95d0-9dbe0b93f016 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:32.980541 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db45069-266e-4266-95d0-9dbe0b93f016 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:32.980839 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db45069-266e-4266-95d0-9dbe0b93f016 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:32.981102 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db45069-266e-4266-95d0-9dbe0b93f016 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:33.068169 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db45069-266e-4266-95d0-9dbe0b93f016 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:33.069817 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db45069-266e-4266-95d0-9dbe0b93f016 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:33.081150 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1017/2042] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:28:32 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:28:33.165914 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c44f86-9d05-487e-b6a4-ddf9ddf8b211 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:33.168340 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-96c44f86-9d05-487e-b6a4-ddf9ddf8b211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:33.198490 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db45069-266e-4266-95d0-9dbe0b93f016 service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:33.208497 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db45069-266e-4266-95d0-9dbe0b93f016 service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:33.212141 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e80670-79f5-4f0e-aa4f-918d2d928a58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:33.212790 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e80670-79f5-4f0e-aa4f-918d2d928a58 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:33.213071 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e80670-79f5-4f0e-aa4f-918d2d928a58 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:33.213351 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e80670-79f5-4f0e-aa4f-918d2d928a58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:33.233018 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e80670-79f5-4f0e-aa4f-918d2d928a58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:33.234647 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e80670-79f5-4f0e-aa4f-918d2d928a58 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:33.249009 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:33.257698 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1018/2043] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:28:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:28:33.264891 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e80670-79f5-4f0e-aa4f-918d2d928a58 service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:33.299550 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c44f86-9d05-487e-b6a4-ddf9ddf8b211 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:33.315398 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd35418-4a18-407f-b0c7-57806ddf1ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:33.315398 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd35418-4a18-407f-b0c7-57806ddf1ede admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:33.315398 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd35418-4a18-407f-b0c7-57806ddf1ede admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:33.315398 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd35418-4a18-407f-b0c7-57806ddf1ede admin admin] PATH_INFO: `/v3/projects/bb3b06a433544278a3a8401dcf1b5b3f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:33.315803 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd35418-4a18-407f-b0c7-57806ddf1ede admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb3b06a433544278a3a8401dcf1b5b3f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:33.323098 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd35418-4a18-407f-b0c7-57806ddf1ede admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:33.409812 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1cd35418-4a18-407f-b0c7-57806ddf1ede admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb3b06a433544278a3a8401dcf1b5b3f', 'request_id': 'req-1cd35418-4a18-407f-b0c7-57806ddf1ede'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:33.411852 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e80670-79f5-4f0e-aa4f-918d2d928a58 service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:33.425019 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1cd35418-4a18-407f-b0c7-57806ddf1ede admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb3b06a433544278a3a8401dcf1b5b3f', 'request_id': 'req-1cd35418-4a18-407f-b0c7-57806ddf1ede'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:33.446056 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1cd35418-4a18-407f-b0c7-57806ddf1ede admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb3b06a433544278a3a8401dcf1b5b3f', 'request_id': 'req-1cd35418-4a18-407f-b0c7-57806ddf1ede'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:33.454555 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:33.471687 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1cd35418-4a18-407f-b0c7-57806ddf1ede admin admin] The token cache is being invalidate because project bb3b06a433544278a3a8401dcf1b5b3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:28:33.471978 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1cd35418-4a18-407f-b0c7-57806ddf1ede admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:33.472796 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1cd35418-4a18-407f-b0c7-57806ddf1ede admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:33.474990 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1026/2044] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:28:33 2022] DELETE /identity/v3/projects/bb3b06a433544278a3a8401dcf1b5b3f => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:33.475976 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd35418-4a18-407f-b0c7-57806ddf1ede admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:33.477381 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-1cd35418-4a18-407f-b0c7-57806ddf1ede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:33.508947 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e009c0d-5005-433f-ba55-55b2fd1afe1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:33.510567 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e009c0d-5005-433f-ba55-55b2fd1afe1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:33.510922 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e009c0d-5005-433f-ba55-55b2fd1afe1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:33.511315 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e009c0d-5005-433f-ba55-55b2fd1afe1c admin admin] PATH_INFO: `/v3/users/498e75c8db5a431a983deae83485f049` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:33.513270 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e009c0d-5005-433f-ba55-55b2fd1afe1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=498e75c8db5a431a983deae83485f049)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:33.515393 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e009c0d-5005-433f-ba55-55b2fd1afe1c admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:33.623195 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd35418-4a18-407f-b0c7-57806ddf1ede admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:33.629583 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d0492-d774-4df0-a511-66ccbdf3695b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:33.630414 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d0492-d774-4df0-a511-66ccbdf3695b service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:33.630765 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d0492-d774-4df0-a511-66ccbdf3695b service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:33.631416 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d0492-d774-4df0-a511-66ccbdf3695b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:33.633888 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-8e0d0492-d774-4df0-a511-66ccbdf3695b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:33.648237 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5e009c0d-5005-433f-ba55-55b2fd1afe1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '498e75c8db5a431a983deae83485f049'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:33.658254 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5e009c0d-5005-433f-ba55-55b2fd1afe1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '498e75c8db5a431a983deae83485f049'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:33.660013 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5e009c0d-5005-433f-ba55-55b2fd1afe1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '498e75c8db5a431a983deae83485f049'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:33.677706 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5e009c0d-5005-433f-ba55-55b2fd1afe1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '498e75c8db5a431a983deae83485f049'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:33.680087 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5e009c0d-5005-433f-ba55-55b2fd1afe1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '498e75c8db5a431a983deae83485f049'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:33.702347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1019/2045] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:28:33 2022] DELETE /identity/v3/users/498e75c8db5a431a983deae83485f049 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:28:33.705549 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e009c0d-5005-433f-ba55-55b2fd1afe1c admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:33.707390 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-5e009c0d-5005-433f-ba55-55b2fd1afe1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:33.735419 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0d0492-d774-4df0-a511-66ccbdf3695b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:33.737255 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0d0492-d774-4df0-a511-66ccbdf3695b service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:33.749968 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1027/2046] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:28:33 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:28:33.751312 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56972d5-41c2-4c08-969e-3307e6bd0dc8 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:33.751688 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56972d5-41c2-4c08-969e-3307e6bd0dc8 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:33.752029 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56972d5-41c2-4c08-969e-3307e6bd0dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:33.775413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-a56972d5-41c2-4c08-969e-3307e6bd0dc8 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:33.777005 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a56972d5-41c2-4c08-969e-3307e6bd0dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:33.803775 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:33.809924 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e009c0d-5005-433f-ba55-55b2fd1afe1c admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:33.816113 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef00d0-4428-4414-b2eb-0a36f7df1af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:33.817146 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef00d0-4428-4414-b2eb-0a36f7df1af7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:33.817863 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef00d0-4428-4414-b2eb-0a36f7df1af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:33.818288 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef00d0-4428-4414-b2eb-0a36f7df1af7 admin admin] PATH_INFO: `/v3/users/0b36127cbeca48b19fe698bebd1202f5` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:33.819637 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aef00d0-4428-4414-b2eb-0a36f7df1af7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b36127cbeca48b19fe698bebd1202f5)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:33.821937 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aef00d0-4428-4414-b2eb-0a36f7df1af7 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:33.870968 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1028/2047] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:33.878428 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56972d5-41c2-4c08-969e-3307e6bd0dc8 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:33.880623 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a56972d5-41c2-4c08-969e-3307e6bd0dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:33.919018 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7aef00d0-4428-4414-b2eb-0a36f7df1af7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b36127cbeca48b19fe698bebd1202f5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:33.921656 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:33.931555 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7aef00d0-4428-4414-b2eb-0a36f7df1af7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b36127cbeca48b19fe698bebd1202f5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:33.932669 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7aef00d0-4428-4414-b2eb-0a36f7df1af7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b36127cbeca48b19fe698bebd1202f5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:33.947017 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7aef00d0-4428-4414-b2eb-0a36f7df1af7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b36127cbeca48b19fe698bebd1202f5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:33.947017 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7aef00d0-4428-4414-b2eb-0a36f7df1af7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b36127cbeca48b19fe698bebd1202f5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:33.974592 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56972d5-41c2-4c08-969e-3307e6bd0dc8 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:33.978500 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f08f4c3-885d-4fe5-87ee-9ef1882871c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:33.979126 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08f4c3-885d-4fe5-87ee-9ef1882871c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:33.979681 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08f4c3-885d-4fe5-87ee-9ef1882871c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:33.979963 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08f4c3-885d-4fe5-87ee-9ef1882871c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:33.982600 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-5f08f4c3-885d-4fe5-87ee-9ef1882871c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:33.991768 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1020/2048] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:28:33 2022] DELETE /identity/v3/users/0b36127cbeca48b19fe698bebd1202f5 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:33.999253 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f08f4c3-885d-4fe5-87ee-9ef1882871c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:34.001024 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f08f4c3-885d-4fe5-87ee-9ef1882871c8 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:34.014131 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1029/2049] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:28:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:28:34.060805 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef00d0-4428-4414-b2eb-0a36f7df1af7 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:34.062942 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7aef00d0-4428-4414-b2eb-0a36f7df1af7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:34.160424 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef00d0-4428-4414-b2eb-0a36f7df1af7 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:34.164293 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ba368-8859-48d3-ab6b-87908edd7367 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:34.165020 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ba368-8859-48d3-ab6b-87908edd7367 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:34.165300 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ba368-8859-48d3-ab6b-87908edd7367 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:34.165716 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ba368-8859-48d3-ab6b-87908edd7367 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:34.167696 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-702ba368-8859-48d3-ab6b-87908edd7367 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:34.245460 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702ba368-8859-48d3-ab6b-87908edd7367 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:34.248131 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702ba368-8859-48d3-ab6b-87908edd7367 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:34.260829 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1021/2050] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:28:34 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:28:34.549396 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f08f4c3-885d-4fe5-87ee-9ef1882871c8 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:34.551899 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-5f08f4c3-885d-4fe5-87ee-9ef1882871c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:34.578261 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f08f4c3-885d-4fe5-87ee-9ef1882871c8 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:34.672033 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b00f620-217e-47e2-b750-e7da482f4b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:34.672033 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00f620-217e-47e2-b750-e7da482f4b33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:34.672033 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00f620-217e-47e2-b750-e7da482f4b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:34.672033 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00f620-217e-47e2-b750-e7da482f4b33 admin admin] PATH_INFO: `/v3/projects/a55aade143784fea9e30076eae30f93b` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:34.672413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b00f620-217e-47e2-b750-e7da482f4b33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a55aade143784fea9e30076eae30f93b)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:34.674429 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b00f620-217e-47e2-b750-e7da482f4b33 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:34.737877 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-6b00f620-217e-47e2-b750-e7da482f4b33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a55aade143784fea9e30076eae30f93b', 'request_id': 'req-6b00f620-217e-47e2-b750-e7da482f4b33'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:34.746685 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-6b00f620-217e-47e2-b750-e7da482f4b33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a55aade143784fea9e30076eae30f93b', 'request_id': 'req-6b00f620-217e-47e2-b750-e7da482f4b33'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:34.762360 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-6b00f620-217e-47e2-b750-e7da482f4b33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a55aade143784fea9e30076eae30f93b', 'request_id': 'req-6b00f620-217e-47e2-b750-e7da482f4b33'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:34.775957 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:34.782654 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-6b00f620-217e-47e2-b750-e7da482f4b33 admin admin] The token cache is being invalidate because project a55aade143784fea9e30076eae30f93b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:28:34.783874 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-6b00f620-217e-47e2-b750-e7da482f4b33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:34.785029 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-6b00f620-217e-47e2-b750-e7da482f4b33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:34.790818 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1030/2051] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:28:34 2022] DELETE /identity/v3/projects/a55aade143784fea9e30076eae30f93b => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:34.794139 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa2b85-6aba-485a-bdf9-4800bb197ebf None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:34.794559 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa2b85-6aba-485a-bdf9-4800bb197ebf None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:34.794842 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa2b85-6aba-485a-bdf9-4800bb197ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:34.819946 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-b5aa2b85-6aba-485a-bdf9-4800bb197ebf None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:34.820912 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b5aa2b85-6aba-485a-bdf9-4800bb197ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:34.900350 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1022/2052] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:34.909364 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012da5b-e620-41d8-b878-a077c5d7748b None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:34.909651 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012da5b-e620-41d8-b878-a077c5d7748b None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:34.909929 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012da5b-e620-41d8-b878-a077c5d7748b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:34.933206 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-8012da5b-e620-41d8-b878-a077c5d7748b None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:34.933206 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-8012da5b-e620-41d8-b878-a077c5d7748b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:34.946614 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1031/2053] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:28:34.951389 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa2b85-6aba-485a-bdf9-4800bb197ebf None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:34.962401 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa2b85-6aba-485a-bdf9-4800bb197ebf None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:34.967109 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997964c-c304-452e-8098-00a3bbc15af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:34.967725 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997964c-c304-452e-8098-00a3bbc15af9 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:34.968007 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997964c-c304-452e-8098-00a3bbc15af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:34.968284 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997964c-c304-452e-8098-00a3bbc15af9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:34.969009 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8997964c-c304-452e-8098-00a3bbc15af9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:28:34.969322 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8997964c-c304-452e-8098-00a3bbc15af9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:34.971157 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8997964c-c304-452e-8098-00a3bbc15af9 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:34.986009 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1023/2054] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:28:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:28:34.991059 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012da5b-e620-41d8-b878-a077c5d7748b None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:35.003056 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012da5b-e620-41d8-b878-a077c5d7748b None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:35.009152 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc1f207-682e-4562-8fd8-5a0fe4dbbdd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:35.009910 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc1f207-682e-4562-8fd8-5a0fe4dbbdd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:35.010198 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc1f207-682e-4562-8fd8-5a0fe4dbbdd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:35.010606 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc1f207-682e-4562-8fd8-5a0fe4dbbdd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:35.011305 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc1f207-682e-4562-8fd8-5a0fe4dbbdd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:35.014269 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc1f207-682e-4562-8fd8-5a0fe4dbbdd0 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:35.053749 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1032/2055] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:28:34 2022] POST /identity/v3/projects => generated 367 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:35.057889 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997964c-c304-452e-8098-00a3bbc15af9 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:35.069700 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997964c-c304-452e-8098-00a3bbc15af9 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:35.076120 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:35.098693 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc1f207-682e-4562-8fd8-5a0fe4dbbdd0 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:35.100865 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3cc1f207-682e-4562-8fd8-5a0fe4dbbdd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:35.215066 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc1f207-682e-4562-8fd8-5a0fe4dbbdd0 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:35.221056 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a585c622-2330-4460-93ca-896c2d259792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:35.221812 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585c622-2330-4460-93ca-896c2d259792 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:35.222164 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585c622-2330-4460-93ca-896c2d259792 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:35.222506 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585c622-2330-4460-93ca-896c2d259792 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:35.223226 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a585c622-2330-4460-93ca-896c2d259792 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:35.224715 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3c5244-504c-4693-8bb8-8314ee696988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:35.225966 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c5244-504c-4693-8bb8-8314ee696988 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:35.226428 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c5244-504c-4693-8bb8-8314ee696988 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:35.226995 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c5244-504c-4693-8bb8-8314ee696988 admin admin] PATH_INFO: `/v3/projects/f86d5dc590b3403497aa42d53a05a937` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:35.235643 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3c5244-504c-4693-8bb8-8314ee696988 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f86d5dc590b3403497aa42d53a05a937)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:35.237092 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a585c622-2330-4460-93ca-896c2d259792 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:35.240406 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3c5244-504c-4693-8bb8-8314ee696988 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:35.311638 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1024/2056] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:28:35 2022] POST /identity/v3/users => generated 284 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:35.316810 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a585c622-2330-4460-93ca-896c2d259792 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:35.332072 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1a3c5244-504c-4693-8bb8-8314ee696988 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f86d5dc590b3403497aa42d53a05a937', 'request_id': 'req-1a3c5244-504c-4693-8bb8-8314ee696988'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:35.340410 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1a3c5244-504c-4693-8bb8-8314ee696988 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f86d5dc590b3403497aa42d53a05a937', 'request_id': 'req-1a3c5244-504c-4693-8bb8-8314ee696988'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:35.344149 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a585c622-2330-4460-93ca-896c2d259792 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:35.347854 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1a3c5244-504c-4693-8bb8-8314ee696988 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f86d5dc590b3403497aa42d53a05a937', 'request_id': 'req-1a3c5244-504c-4693-8bb8-8314ee696988'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:35.372726 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1a3c5244-504c-4693-8bb8-8314ee696988 admin admin] The token cache is being invalidate because project f86d5dc590b3403497aa42d53a05a937 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:28:35.373171 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1a3c5244-504c-4693-8bb8-8314ee696988 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:35.374591 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1a3c5244-504c-4693-8bb8-8314ee696988 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:35.378206 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1033/2057] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:28:35 2022] DELETE /identity/v3/projects/f86d5dc590b3403497aa42d53a05a937 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:28:35.383849 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803837aa-8b15-4e3f-8e0d-8777b8ba4683 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:35.384033 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803837aa-8b15-4e3f-8e0d-8777b8ba4683 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:35.384231 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803837aa-8b15-4e3f-8e0d-8777b8ba4683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:35.422789 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-803837aa-8b15-4e3f-8e0d-8777b8ba4683 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:35.425504 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-803837aa-8b15-4e3f-8e0d-8777b8ba4683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:35.436622 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa5d24-cb35-4979-89a4-47d4f9048efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:35.437360 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa5d24-cb35-4979-89a4-47d4f9048efb admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:35.437982 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa5d24-cb35-4979-89a4-47d4f9048efb admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:35.438184 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa5d24-cb35-4979-89a4-47d4f9048efb admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:35.439322 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfa5d24-cb35-4979-89a4-47d4f9048efb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:35.442407 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfa5d24-cb35-4979-89a4-47d4f9048efb admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:35.456304 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1025/2058] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:35 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:35.461399 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa5d24-cb35-4979-89a4-47d4f9048efb admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:35.463484 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-8bfa5d24-cb35-4979-89a4-47d4f9048efb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:35.479856 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa5d24-cb35-4979-89a4-47d4f9048efb admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:35.487174 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed0bc2-77ed-49a6-ae6b-52d1d0ff35b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:35.487699 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed0bc2-77ed-49a6-ae6b-52d1d0ff35b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:35.488043 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed0bc2-77ed-49a6-ae6b-52d1d0ff35b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:35.488411 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed0bc2-77ed-49a6-ae6b-52d1d0ff35b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:35.489404 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed0bc2-77ed-49a6-ae6b-52d1d0ff35b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:35.491326 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed0bc2-77ed-49a6-ae6b-52d1d0ff35b8 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:35.507620 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1026/2059] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:35 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:35.511407 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed0bc2-77ed-49a6-ae6b-52d1d0ff35b8 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:35.519388 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:35.527290 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed0bc2-77ed-49a6-ae6b-52d1d0ff35b8 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:35.532885 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b587c3-f8f2-4fb8-934d-b916e01ba300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:35.533601 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b587c3-f8f2-4fb8-934d-b916e01ba300 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:35.533885 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b587c3-f8f2-4fb8-934d-b916e01ba300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:35.534150 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b587c3-f8f2-4fb8-934d-b916e01ba300 admin admin] PATH_INFO: `/v3/projects/b2d0abcfad774fc58544a1b408f0cc9d/users/193d28d2ebbb4c5ca9d4b645d392f327/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:35.539007 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1034/2060] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:28:35.547456 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52413f90-7e60-4595-b9a9-5948f9f8e1a6 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:35.547744 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52413f90-7e60-4595-b9a9-5948f9f8e1a6 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:35.548070 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52413f90-7e60-4595-b9a9-5948f9f8e1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:35.563347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b587c3-f8f2-4fb8-934d-b916e01ba300 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2d0abcfad774fc58544a1b408f0cc9d, user_id=193d28d2ebbb4c5ca9d4b645d392f327, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:35.566616 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b587c3-f8f2-4fb8-934d-b916e01ba300 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:35.574700 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-52413f90-7e60-4595-b9a9-5948f9f8e1a6 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:35.576159 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-52413f90-7e60-4595-b9a9-5948f9f8e1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:35.586017 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1035/2061] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:35.590115 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52413f90-7e60-4595-b9a9-5948f9f8e1a6 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:35.594732 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1027/2062] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:28:35 2022] PUT /identity/v3/projects/b2d0abcfad774fc58544a1b408f0cc9d/users/193d28d2ebbb4c5ca9d4b645d392f327/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:28:35.606777 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd5195-397a-47e8-ae35-67ace041ac39 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:35.607421 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd5195-397a-47e8-ae35-67ace041ac39 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:35.607875 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd5195-397a-47e8-ae35-67ace041ac39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:35.612548 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52413f90-7e60-4595-b9a9-5948f9f8e1a6 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:35.641442 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-0fbd5195-397a-47e8-ae35-67ace041ac39 None None] MFA Rules not processed for user `193d28d2ebbb4c5ca9d4b645d392f327`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:35.642735 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-0fbd5195-397a-47e8-ae35-67ace041ac39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:35.704432 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e606a-b618-429f-96d5-8207b5efe506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:35.705526 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e606a-b618-429f-96d5-8207b5efe506 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:35.705845 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e606a-b618-429f-96d5-8207b5efe506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:35.706071 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e606a-b618-429f-96d5-8207b5efe506 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:35.708109 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9e606a-b618-429f-96d5-8207b5efe506 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:28:35.708422 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9e606a-b618-429f-96d5-8207b5efe506 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:35.711355 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9e606a-b618-429f-96d5-8207b5efe506 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:35.746556 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:35.746691 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1036/2063] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:28:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:28:35.758534 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e606a-b618-429f-96d5-8207b5efe506 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:35.784389 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1028/2064] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:35.790437 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e606a-b618-429f-96d5-8207b5efe506 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:35.792134 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbd5195-397a-47e8-ae35-67ace041ac39 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:35.794370 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-0fbd5195-397a-47e8-ae35-67ace041ac39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:35.811392 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276b7a5-8dad-4f4a-b5ad-49c5367adecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:35.813880 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276b7a5-8dad-4f4a-b5ad-49c5367adecd admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:35.813880 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276b7a5-8dad-4f4a-b5ad-49c5367adecd admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:35.813880 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276b7a5-8dad-4f4a-b5ad-49c5367adecd admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:35.815057 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3276b7a5-8dad-4f4a-b5ad-49c5367adecd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:35.821751 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3276b7a5-8dad-4f4a-b5ad-49c5367adecd admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:35.871711 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1037/2065] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:28:35 2022] POST /identity/v3/projects => generated 393 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:35.873453 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276b7a5-8dad-4f4a-b5ad-49c5367adecd admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:35.954719 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbd5195-397a-47e8-ae35-67ace041ac39 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:35.982231 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276b7a5-8dad-4f4a-b5ad-49c5367adecd admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:35.988697 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb301be-3006-4b32-85e6-5e1a31552504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:35.989334 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb301be-3006-4b32-85e6-5e1a31552504 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:35.989616 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb301be-3006-4b32-85e6-5e1a31552504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:35.989916 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb301be-3006-4b32-85e6-5e1a31552504 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:35.990644 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb301be-3006-4b32-85e6-5e1a31552504 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:35.993237 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb301be-3006-4b32-85e6-5e1a31552504 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:36.027151 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1038/2066] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:28:35 2022] POST /identity/v3/users => generated 297 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:36.034060 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb301be-3006-4b32-85e6-5e1a31552504 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:36.052153 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb301be-3006-4b32-85e6-5e1a31552504 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:36.069241 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a427f4-1809-4a76-8a71-55c2bf6da8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:36.069943 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a427f4-1809-4a76-8a71-55c2bf6da8bf admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:36.070226 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a427f4-1809-4a76-8a71-55c2bf6da8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:36.070504 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a427f4-1809-4a76-8a71-55c2bf6da8bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:36.071287 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a427f4-1809-4a76-8a71-55c2bf6da8bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:36.072977 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a427f4-1809-4a76-8a71-55c2bf6da8bf admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:36.086545 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1039/2067] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:36 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:36.090319 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a427f4-1809-4a76-8a71-55c2bf6da8bf admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:36.096911 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b354fb6-23d5-47fa-9813-69877657bd74 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a399ee5db44100a88a4ffb451512aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:36.097547 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b354fb6-23d5-47fa-9813-69877657bd74 service glance] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:36.097832 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b354fb6-23d5-47fa-9813-69877657bd74 service glance] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:36.098106 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b354fb6-23d5-47fa-9813-69877657bd74 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:36.106527 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a427f4-1809-4a76-8a71-55c2bf6da8bf admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:36.113411 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4111fcf6-8714-4a12-93e8-f3f66cc75643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:36.114190 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111fcf6-8714-4a12-93e8-f3f66cc75643 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:36.114849 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111fcf6-8714-4a12-93e8-f3f66cc75643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:36.115224 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111fcf6-8714-4a12-93e8-f3f66cc75643 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:36.116004 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4111fcf6-8714-4a12-93e8-f3f66cc75643 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:36.118405 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4111fcf6-8714-4a12-93e8-f3f66cc75643 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:36.136794 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1040/2068] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:36 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:36.140634 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4111fcf6-8714-4a12-93e8-f3f66cc75643 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:36.154728 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4111fcf6-8714-4a12-93e8-f3f66cc75643 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:36.160590 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d509306-b9ee-4614-b1b9-1c6a0f7becd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:36.161485 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d509306-b9ee-4614-b1b9-1c6a0f7becd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:36.161742 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d509306-b9ee-4614-b1b9-1c6a0f7becd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:36.162016 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d509306-b9ee-4614-b1b9-1c6a0f7becd1 admin admin] PATH_INFO: `/v3/projects/a6805b4c67fb48899a508ca6640c5b99/users/7834f26d2b174e188ac47972b897aa90/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:36.181866 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d509306-b9ee-4614-b1b9-1c6a0f7becd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6805b4c67fb48899a508ca6640c5b99, user_id=7834f26d2b174e188ac47972b897aa90, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:36.184789 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d509306-b9ee-4614-b1b9-1c6a0f7becd1 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:36.195635 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b354fb6-23d5-47fa-9813-69877657bd74 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:36.197470 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b354fb6-23d5-47fa-9813-69877657bd74 service glance] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:36.211236 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1041/2069] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:28:36 2022] PUT /identity/v3/projects/a6805b4c67fb48899a508ca6640c5b99/users/7834f26d2b174e188ac47972b897aa90/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:36.211911 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1029/2070] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:28:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:28:36.223375 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409855a8-efa1-4d63-941d-24d11cf7e790 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:36.223723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409855a8-efa1-4d63-941d-24d11cf7e790 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:36.224486 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409855a8-efa1-4d63-941d-24d11cf7e790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:36.250815 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:36.264175 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-409855a8-efa1-4d63-941d-24d11cf7e790 None None] MFA Rules not processed for user `7834f26d2b174e188ac47972b897aa90`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:36.266327 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-409855a8-efa1-4d63-941d-24d11cf7e790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:36.361409 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1042/2071] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:36 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:36.366101 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b354fb6-23d5-47fa-9813-69877657bd74 service glance] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:36.380696 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b354fb6-23d5-47fa-9813-69877657bd74 service glance] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:36.439471 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:36.478715 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f81f9e-83fc-4579-9153-9404afe45bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:36.480079 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f81f9e-83fc-4579-9153-9404afe45bab admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:36.481031 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f81f9e-83fc-4579-9153-9404afe45bab admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:36.481499 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f81f9e-83fc-4579-9153-9404afe45bab admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:36.482463 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f81f9e-83fc-4579-9153-9404afe45bab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:36.486691 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f81f9e-83fc-4579-9153-9404afe45bab admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:36.531073 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1030/2072] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:28:36 2022] POST /identity/v3/projects => generated 391 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:36.535481 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409855a8-efa1-4d63-941d-24d11cf7e790 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:36.558545 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409855a8-efa1-4d63-941d-24d11cf7e790 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:36.706882 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d42d4-194c-4522-9bcf-d7bccb4a7af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:36.707786 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d42d4-194c-4522-9bcf-d7bccb4a7af0 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:36.708069 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d42d4-194c-4522-9bcf-d7bccb4a7af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:36.708342 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d42d4-194c-4522-9bcf-d7bccb4a7af0 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:36.709036 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d42d4-194c-4522-9bcf-d7bccb4a7af0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:36.711037 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d42d4-194c-4522-9bcf-d7bccb4a7af0 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:36.743222 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1043/2073] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:28:36 2022] POST /identity/v3/users => generated 302 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:36.748216 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f81f9e-83fc-4579-9153-9404afe45bab admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:36.762601 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f81f9e-83fc-4579-9153-9404afe45bab admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:36.772826 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79f0b9-a6b1-4b4b-a2be-fd83a2730c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:36.774371 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79f0b9-a6b1-4b4b-a2be-fd83a2730c2b admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:36.774371 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79f0b9-a6b1-4b4b-a2be-fd83a2730c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:36.774371 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79f0b9-a6b1-4b4b-a2be-fd83a2730c2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:36.774645 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b79f0b9-a6b1-4b4b-a2be-fd83a2730c2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:36.776226 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b79f0b9-a6b1-4b4b-a2be-fd83a2730c2b admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:36.810495 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1031/2074] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:36 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:36.812026 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d42d4-194c-4522-9bcf-d7bccb4a7af0 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:36.828298 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d42d4-194c-4522-9bcf-d7bccb4a7af0 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:36.836661 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb4fbf1-a62d-4f80-b4f0-c5c04bc2db11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:36.841552 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4fbf1-a62d-4f80-b4f0-c5c04bc2db11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:36.844082 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4fbf1-a62d-4f80-b4f0-c5c04bc2db11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:36.844844 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4fbf1-a62d-4f80-b4f0-c5c04bc2db11 admin admin] PATH_INFO: `/v3/projects/e86c8b8872a74b21848bb0b28f5d1f4e/users/d9f8a5163b674455a9b5163331b6467f/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:36.868915 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb4fbf1-a62d-4f80-b4f0-c5c04bc2db11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e86c8b8872a74b21848bb0b28f5d1f4e, user_id=d9f8a5163b674455a9b5163331b6467f, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:36.871842 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb4fbf1-a62d-4f80-b4f0-c5c04bc2db11 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:36.898822 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1044/2075] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:28:36 2022] PUT /identity/v3/projects/e86c8b8872a74b21848bb0b28f5d1f4e/users/d9f8a5163b674455a9b5163331b6467f/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:36.903513 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79f0b9-a6b1-4b4b-a2be-fd83a2730c2b admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:36.920707 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79f0b9-a6b1-4b4b-a2be-fd83a2730c2b admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:37.116566 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a5928-5ade-408e-b60e-4b64e10ec8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:37.117215 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a5928-5ade-408e-b60e-4b64e10ec8f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:37.117499 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a5928-5ade-408e-b60e-4b64e10ec8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:37.117769 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a5928-5ade-408e-b60e-4b64e10ec8f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:37.118525 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a5928-5ade-408e-b60e-4b64e10ec8f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:37.120033 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a5928-5ade-408e-b60e-4b64e10ec8f5 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:37.145954 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb4fbf1-a62d-4f80-b4f0-c5c04bc2db11 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:37.148358 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1032/2076] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:36 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:37.184577 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb4fbf1-a62d-4f80-b4f0-c5c04bc2db11 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:37.204001 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dbb321-c501-42e4-86eb-0fde72a6a5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:37.209315 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dbb321-c501-42e4-86eb-0fde72a6a5b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:37.209614 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dbb321-c501-42e4-86eb-0fde72a6a5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:37.211346 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dbb321-c501-42e4-86eb-0fde72a6a5b8 admin admin] PATH_INFO: `/v3/projects/e86c8b8872a74b21848bb0b28f5d1f4e/users/d9f8a5163b674455a9b5163331b6467f/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:37.220191 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dbb321-c501-42e4-86eb-0fde72a6a5b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e86c8b8872a74b21848bb0b28f5d1f4e, user_id=d9f8a5163b674455a9b5163331b6467f, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:37.227876 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dbb321-c501-42e4-86eb-0fde72a6a5b8 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:37.264443 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1045/2077] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:28:37 2022] PUT /identity/v3/projects/e86c8b8872a74b21848bb0b28f5d1f4e/users/d9f8a5163b674455a9b5163331b6467f/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:37.275454 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b848e-0c20-464f-8a52-2cc92a9e0488 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:37.275864 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b848e-0c20-464f-8a52-2cc92a9e0488 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:37.276091 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b848e-0c20-464f-8a52-2cc92a9e0488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:37.333968 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-124b848e-0c20-464f-8a52-2cc92a9e0488 None None] MFA Rules not processed for user `d9f8a5163b674455a9b5163331b6467f`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:37.335247 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-124b848e-0c20-464f-8a52-2cc92a9e0488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:37.418539 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1033/2078] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:37 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:37.610991 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dbb321-c501-42e4-86eb-0fde72a6a5b8 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:37.615234 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-15dbb321-c501-42e4-86eb-0fde72a6a5b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:37.755235 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dbb321-c501-42e4-86eb-0fde72a6a5b8 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:37.768735 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff2668-8fb4-45f0-9be6-fc3aa36efc11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:37.769671 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff2668-8fb4-45f0-9be6-fc3aa36efc11 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:37.770506 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff2668-8fb4-45f0-9be6-fc3aa36efc11 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:37.770991 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff2668-8fb4-45f0-9be6-fc3aa36efc11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:37.785994 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:37.806767 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abff2668-8fb4-45f0-9be6-fc3aa36efc11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:37.809315 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abff2668-8fb4-45f0-9be6-fc3aa36efc11 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:37.863931 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1046/2079] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:28:37 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:28:37.964536 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b848e-0c20-464f-8a52-2cc92a9e0488 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:37.966115 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-124b848e-0c20-464f-8a52-2cc92a9e0488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:38.002604 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b848e-0c20-464f-8a52-2cc92a9e0488 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:38.023054 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d23659-18b0-4574-bc92-a5b4ab169206 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:38.023991 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d23659-18b0-4574-bc92-a5b4ab169206 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:38.025508 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d23659-18b0-4574-bc92-a5b4ab169206 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:38.025960 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d23659-18b0-4574-bc92-a5b4ab169206 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:38.125664 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:38.137375 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff2668-8fb4-45f0-9be6-fc3aa36efc11 service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:38.139582 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-abff2668-8fb4-45f0-9be6-fc3aa36efc11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:38.200362 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d23659-18b0-4574-bc92-a5b4ab169206 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:38.205936 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d23659-18b0-4574-bc92-a5b4ab169206 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:38.245672 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1034/2080] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:28:37 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:28:38.275542 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff2668-8fb4-45f0-9be6-fc3aa36efc11 service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:38.282823 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6bf074-0ef6-4aec-9ba0-227132416e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:38.284130 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6bf074-0ef6-4aec-9ba0-227132416e75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:38.284843 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6bf074-0ef6-4aec-9ba0-227132416e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:38.285338 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6bf074-0ef6-4aec-9ba0-227132416e75 admin admin] PATH_INFO: `/v3/users/6386e828ab1749e9bf0eb2f9beda0f20` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:38.287338 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6bf074-0ef6-4aec-9ba0-227132416e75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6386e828ab1749e9bf0eb2f9beda0f20)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:38.290061 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6bf074-0ef6-4aec-9ba0-227132416e75 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:38.411958 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-be6bf074-0ef6-4aec-9ba0-227132416e75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6386e828ab1749e9bf0eb2f9beda0f20'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:38.430132 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-be6bf074-0ef6-4aec-9ba0-227132416e75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6386e828ab1749e9bf0eb2f9beda0f20'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:38.442988 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-be6bf074-0ef6-4aec-9ba0-227132416e75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6386e828ab1749e9bf0eb2f9beda0f20'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:38.443907 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-be6bf074-0ef6-4aec-9ba0-227132416e75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6386e828ab1749e9bf0eb2f9beda0f20'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:38.463572 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-be6bf074-0ef6-4aec-9ba0-227132416e75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6386e828ab1749e9bf0eb2f9beda0f20'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:38.502601 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1047/2081] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:28:38 2022] DELETE /identity/v3/users/6386e828ab1749e9bf0eb2f9beda0f20 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:38.508078 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90976f9-ded8-4933-a04e-088826035432 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:38.508815 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90976f9-ded8-4933-a04e-088826035432 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:38.508815 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90976f9-ded8-4933-a04e-088826035432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:38.542727 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-d90976f9-ded8-4933-a04e-088826035432 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:38.546382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d90976f9-ded8-4933-a04e-088826035432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:38.722737 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1035/2082] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:38.732649 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6bf074-0ef6-4aec-9ba0-227132416e75 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:38.734551 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-be6bf074-0ef6-4aec-9ba0-227132416e75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:38.923992 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6bf074-0ef6-4aec-9ba0-227132416e75 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:38.944577 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e168a3c-154a-4855-a6c6-24e6753816b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:38.947340 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e168a3c-154a-4855-a6c6-24e6753816b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:38.947807 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e168a3c-154a-4855-a6c6-24e6753816b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:38.949950 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e168a3c-154a-4855-a6c6-24e6753816b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:38.972671 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e168a3c-154a-4855-a6c6-24e6753816b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:38.973998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e168a3c-154a-4855-a6c6-24e6753816b1 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:38.999190 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1048/2083] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:28:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:28:39.294763 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90976f9-ded8-4933-a04e-088826035432 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:39.297179 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d90976f9-ded8-4933-a04e-088826035432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:39.377437 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90976f9-ded8-4933-a04e-088826035432 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:39.383003 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e807bc-5097-42da-927a-ee1b27fe2953 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:39.384171 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e807bc-5097-42da-927a-ee1b27fe2953 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:39.384597 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e807bc-5097-42da-927a-ee1b27fe2953 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:39.384870 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e807bc-5097-42da-927a-ee1b27fe2953 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:39.387351 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-78e807bc-5097-42da-927a-ee1b27fe2953 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:39.404101 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e168a3c-154a-4855-a6c6-24e6753816b1 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:39.407695 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-0e168a3c-154a-4855-a6c6-24e6753816b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:39.430286 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e168a3c-154a-4855-a6c6-24e6753816b1 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:39.448413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1967b-0c46-4d8c-9b2a-95be1615f347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:39.449339 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1967b-0c46-4d8c-9b2a-95be1615f347 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:39.450237 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1967b-0c46-4d8c-9b2a-95be1615f347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:39.450676 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1967b-0c46-4d8c-9b2a-95be1615f347 admin admin] PATH_INFO: `/v3/projects/d207eb829bbd44ea9675cf92223e65c3` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:39.452074 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf1967b-0c46-4d8c-9b2a-95be1615f347 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d207eb829bbd44ea9675cf92223e65c3)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:39.454216 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf1967b-0c46-4d8c-9b2a-95be1615f347 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:39.468944 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:39.472818 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e807bc-5097-42da-927a-ee1b27fe2953 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:39.474380 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e807bc-5097-42da-927a-ee1b27fe2953 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:39.485867 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1036/2084] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:28:39 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:28:39.528715 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-eaf1967b-0c46-4d8c-9b2a-95be1615f347 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd207eb829bbd44ea9675cf92223e65c3', 'request_id': 'req-eaf1967b-0c46-4d8c-9b2a-95be1615f347'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:39.537391 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-eaf1967b-0c46-4d8c-9b2a-95be1615f347 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd207eb829bbd44ea9675cf92223e65c3', 'request_id': 'req-eaf1967b-0c46-4d8c-9b2a-95be1615f347'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:39.544573 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-eaf1967b-0c46-4d8c-9b2a-95be1615f347 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd207eb829bbd44ea9675cf92223e65c3', 'request_id': 'req-eaf1967b-0c46-4d8c-9b2a-95be1615f347'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:39.569459 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-eaf1967b-0c46-4d8c-9b2a-95be1615f347 admin admin] The token cache is being invalidate because project d207eb829bbd44ea9675cf92223e65c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:28:39.570302 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-eaf1967b-0c46-4d8c-9b2a-95be1615f347 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:39.570904 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-eaf1967b-0c46-4d8c-9b2a-95be1615f347 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:39.572818 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1049/2085] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:28:39 2022] DELETE /identity/v3/projects/d207eb829bbd44ea9675cf92223e65c3 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:28:39.578179 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e807bc-5097-42da-927a-ee1b27fe2953 service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:39.595785 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e807bc-5097-42da-927a-ee1b27fe2953 service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:39.637137 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:39.674823 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d27666e-4604-4baa-9303-c7604a86e4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:39.675523 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27666e-4604-4baa-9303-c7604a86e4cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:39.675810 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27666e-4604-4baa-9303-c7604a86e4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:39.676086 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27666e-4604-4baa-9303-c7604a86e4cb admin admin] PATH_INFO: `/v3/users/283c8f4cc0fa43a68dc016fcb3037786` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:39.677681 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d27666e-4604-4baa-9303-c7604a86e4cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=283c8f4cc0fa43a68dc016fcb3037786)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:39.680114 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d27666e-4604-4baa-9303-c7604a86e4cb admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:39.733044 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9d27666e-4604-4baa-9303-c7604a86e4cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '283c8f4cc0fa43a68dc016fcb3037786'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:39.740942 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9d27666e-4604-4baa-9303-c7604a86e4cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '283c8f4cc0fa43a68dc016fcb3037786'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:39.741811 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9d27666e-4604-4baa-9303-c7604a86e4cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '283c8f4cc0fa43a68dc016fcb3037786'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:39.755466 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9d27666e-4604-4baa-9303-c7604a86e4cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '283c8f4cc0fa43a68dc016fcb3037786'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:39.756599 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9d27666e-4604-4baa-9303-c7604a86e4cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '283c8f4cc0fa43a68dc016fcb3037786'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:39.777193 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1037/2086] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:28:39 2022] DELETE /identity/v3/users/283c8f4cc0fa43a68dc016fcb3037786 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:40.106619 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1967b-0c46-4d8c-9b2a-95be1615f347 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:40.108146 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-eaf1967b-0c46-4d8c-9b2a-95be1615f347 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:40.138378 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1967b-0c46-4d8c-9b2a-95be1615f347 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:40.273170 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705053e5-81fd-491c-adb3-ba2b145e6f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:40.273840 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705053e5-81fd-491c-adb3-ba2b145e6f73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:40.274300 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705053e5-81fd-491c-adb3-ba2b145e6f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:40.274543 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705053e5-81fd-491c-adb3-ba2b145e6f73 admin admin] PATH_INFO: `/v3/projects/af5d726744f44374a4210e265b1fcb2d` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:40.275865 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705053e5-81fd-491c-adb3-ba2b145e6f73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af5d726744f44374a4210e265b1fcb2d)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:40.278148 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705053e5-81fd-491c-adb3-ba2b145e6f73 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:40.362212 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-705053e5-81fd-491c-adb3-ba2b145e6f73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af5d726744f44374a4210e265b1fcb2d', 'request_id': 'req-705053e5-81fd-491c-adb3-ba2b145e6f73'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:40.383882 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-705053e5-81fd-491c-adb3-ba2b145e6f73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af5d726744f44374a4210e265b1fcb2d', 'request_id': 'req-705053e5-81fd-491c-adb3-ba2b145e6f73'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:40.393816 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-705053e5-81fd-491c-adb3-ba2b145e6f73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af5d726744f44374a4210e265b1fcb2d', 'request_id': 'req-705053e5-81fd-491c-adb3-ba2b145e6f73'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:40.409692 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-705053e5-81fd-491c-adb3-ba2b145e6f73 admin admin] The token cache is being invalidate because project af5d726744f44374a4210e265b1fcb2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:28:40.410360 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-705053e5-81fd-491c-adb3-ba2b145e6f73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:40.410864 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-705053e5-81fd-491c-adb3-ba2b145e6f73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:40.412729 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1050/2087] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:28:40 2022] DELETE /identity/v3/projects/af5d726744f44374a4210e265b1fcb2d => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:40.417119 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d27666e-4604-4baa-9303-c7604a86e4cb admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:40.418609 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-9d27666e-4604-4baa-9303-c7604a86e4cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:40.448220 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d27666e-4604-4baa-9303-c7604a86e4cb admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:40.525490 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7163658-fd8c-475c-aba8-f9df25be944e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:40.526245 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7163658-fd8c-475c-aba8-f9df25be944e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:40.526598 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7163658-fd8c-475c-aba8-f9df25be944e admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:40.526884 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7163658-fd8c-475c-aba8-f9df25be944e admin admin] PATH_INFO: `/v3/users/5612fdc4772f4e91870bb25c4700845a` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:40.528054 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7163658-fd8c-475c-aba8-f9df25be944e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5612fdc4772f4e91870bb25c4700845a)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:40.530432 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7163658-fd8c-475c-aba8-f9df25be944e admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:40.594968 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f7163658-fd8c-475c-aba8-f9df25be944e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5612fdc4772f4e91870bb25c4700845a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:40.597947 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:40.611076 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f7163658-fd8c-475c-aba8-f9df25be944e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5612fdc4772f4e91870bb25c4700845a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:40.612067 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f7163658-fd8c-475c-aba8-f9df25be944e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5612fdc4772f4e91870bb25c4700845a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:40.622528 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f7163658-fd8c-475c-aba8-f9df25be944e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5612fdc4772f4e91870bb25c4700845a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:40.623182 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f7163658-fd8c-475c-aba8-f9df25be944e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5612fdc4772f4e91870bb25c4700845a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:40.647968 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1038/2088] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:28:40 2022] DELETE /identity/v3/users/5612fdc4772f4e91870bb25c4700845a => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:40.963773 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705053e5-81fd-491c-adb3-ba2b145e6f73 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:40.965516 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-705053e5-81fd-491c-adb3-ba2b145e6f73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:40.988234 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705053e5-81fd-491c-adb3-ba2b145e6f73 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:41.016989 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:41.053982 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ecc08-6eff-43b3-8663-06c56d1660a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:41.054720 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ecc08-6eff-43b3-8663-06c56d1660a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:41.054997 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ecc08-6eff-43b3-8663-06c56d1660a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:41.055272 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ecc08-6eff-43b3-8663-06c56d1660a2 admin admin] PATH_INFO: `/v3/projects/2ff81bee29d6430b835c247eaad93fa4` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:41.056410 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ecc08-6eff-43b3-8663-06c56d1660a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ff81bee29d6430b835c247eaad93fa4)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:41.058370 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ecc08-6eff-43b3-8663-06c56d1660a2 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:41.110861 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-432ecc08-6eff-43b3-8663-06c56d1660a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ff81bee29d6430b835c247eaad93fa4', 'request_id': 'req-432ecc08-6eff-43b3-8663-06c56d1660a2'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:41.117208 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-432ecc08-6eff-43b3-8663-06c56d1660a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ff81bee29d6430b835c247eaad93fa4', 'request_id': 'req-432ecc08-6eff-43b3-8663-06c56d1660a2'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:41.122682 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-432ecc08-6eff-43b3-8663-06c56d1660a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ff81bee29d6430b835c247eaad93fa4', 'request_id': 'req-432ecc08-6eff-43b3-8663-06c56d1660a2'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:41.139881 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-432ecc08-6eff-43b3-8663-06c56d1660a2 admin admin] The token cache is being invalidate because project 2ff81bee29d6430b835c247eaad93fa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:28:41.140193 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-432ecc08-6eff-43b3-8663-06c56d1660a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:41.141224 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-432ecc08-6eff-43b3-8663-06c56d1660a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:41.143148 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1051/2089] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:28:40 2022] DELETE /identity/v3/projects/2ff81bee29d6430b835c247eaad93fa4 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:41.149172 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e69d6-183d-4a34-a238-e450f6a54989 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:41.149453 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e69d6-183d-4a34-a238-e450f6a54989 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:41.149719 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e69d6-183d-4a34-a238-e450f6a54989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:41.169198 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-7b5e69d6-183d-4a34-a238-e450f6a54989 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:41.170424 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7b5e69d6-183d-4a34-a238-e450f6a54989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:41.234193 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1039/2090] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:28:41.243148 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9d3ec-ce2b-4720-9f89-ba44294d3bdc None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:41.243720 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9d3ec-ce2b-4720-9f89-ba44294d3bdc None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:41.244000 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9d3ec-ce2b-4720-9f89-ba44294d3bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:41.265837 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-5ba9d3ec-ce2b-4720-9f89-ba44294d3bdc None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:41.267129 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-5ba9d3ec-ce2b-4720-9f89-ba44294d3bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:41.276160 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1052/2091] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:41.280400 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e69d6-183d-4a34-a238-e450f6a54989 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:41.291469 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e69d6-183d-4a34-a238-e450f6a54989 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:41.296873 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e43988-f4f5-45ae-a84e-d52ea17243da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:41.297581 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e43988-f4f5-45ae-a84e-d52ea17243da admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:41.297832 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e43988-f4f5-45ae-a84e-d52ea17243da admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:41.298099 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e43988-f4f5-45ae-a84e-d52ea17243da admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:41.299528 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e43988-f4f5-45ae-a84e-d52ea17243da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:28:41.299528 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e43988-f4f5-45ae-a84e-d52ea17243da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:41.300733 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e43988-f4f5-45ae-a84e-d52ea17243da admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:41.321086 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1040/2092] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:28:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:28:41.321771 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba9d3ec-ce2b-4720-9f89-ba44294d3bdc None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:41.333908 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba9d3ec-ce2b-4720-9f89-ba44294d3bdc None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:41.338992 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e1cd7e-c7af-4263-b12c-784ec05f9b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:41.339648 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1cd7e-c7af-4263-b12c-784ec05f9b4c admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:41.339966 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1cd7e-c7af-4263-b12c-784ec05f9b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:41.340235 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1cd7e-c7af-4263-b12c-784ec05f9b4c admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:41.340928 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e1cd7e-c7af-4263-b12c-784ec05f9b4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:41.343181 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e1cd7e-c7af-4263-b12c-784ec05f9b4c admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:41.374232 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1053/2093] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:28:41 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:41.378976 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e43988-f4f5-45ae-a84e-d52ea17243da admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:41.391849 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e43988-f4f5-45ae-a84e-d52ea17243da admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:41.453927 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af063b-da4b-436e-ad60-7badefb03522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:41.454741 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af063b-da4b-436e-ad60-7badefb03522 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:41.455017 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af063b-da4b-436e-ad60-7badefb03522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:41.455291 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af063b-da4b-436e-ad60-7badefb03522 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:41.455958 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55af063b-da4b-436e-ad60-7badefb03522 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:41.457915 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55af063b-da4b-436e-ad60-7badefb03522 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:41.489165 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1041/2094] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:28:41 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:41.493414 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e1cd7e-c7af-4263-b12c-784ec05f9b4c admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:41.505376 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e1cd7e-c7af-4263-b12c-784ec05f9b4c admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:41.520653 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9279ac-5232-4d3c-b2ca-5ca20cf1ee39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:41.521341 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9279ac-5232-4d3c-b2ca-5ca20cf1ee39 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:41.521617 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9279ac-5232-4d3c-b2ca-5ca20cf1ee39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:41.521922 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9279ac-5232-4d3c-b2ca-5ca20cf1ee39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:41.522549 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9279ac-5232-4d3c-b2ca-5ca20cf1ee39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:41.524349 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9279ac-5232-4d3c-b2ca-5ca20cf1ee39 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:41.536625 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1054/2095] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:41 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:41.541391 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af063b-da4b-436e-ad60-7badefb03522 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:41.552899 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af063b-da4b-436e-ad60-7badefb03522 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:41.558662 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456fed27-dd84-4da4-a48b-2488cdb11013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:41.559287 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456fed27-dd84-4da4-a48b-2488cdb11013 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:41.559562 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456fed27-dd84-4da4-a48b-2488cdb11013 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:41.559833 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456fed27-dd84-4da4-a48b-2488cdb11013 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:41.560539 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456fed27-dd84-4da4-a48b-2488cdb11013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:41.562158 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456fed27-dd84-4da4-a48b-2488cdb11013 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:41.585082 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1042/2096] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:41 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:41.589247 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9279ac-5232-4d3c-b2ca-5ca20cf1ee39 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:41.601169 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9279ac-5232-4d3c-b2ca-5ca20cf1ee39 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:41.606313 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ccf348-263b-4b82-8b89-1384e2ed9aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:41.607310 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ccf348-263b-4b82-8b89-1384e2ed9aa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:41.607802 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ccf348-263b-4b82-8b89-1384e2ed9aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:41.608245 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ccf348-263b-4b82-8b89-1384e2ed9aa3 admin admin] PATH_INFO: `/v3/projects/b6bac6649d92416ea732f624e06ddf32/users/17e1588f582443929cffc07017537a6a/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:41.628802 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ccf348-263b-4b82-8b89-1384e2ed9aa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6bac6649d92416ea732f624e06ddf32, user_id=17e1588f582443929cffc07017537a6a, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:41.632050 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ccf348-263b-4b82-8b89-1384e2ed9aa3 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:41.649528 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1055/2097] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:28:41 2022] PUT /identity/v3/projects/b6bac6649d92416ea732f624e06ddf32/users/17e1588f582443929cffc07017537a6a/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:28:41.663550 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a5e0b-5747-458e-b8a7-a3ffe981071e None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:41.664068 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a5e0b-5747-458e-b8a7-a3ffe981071e None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:41.664312 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a5e0b-5747-458e-b8a7-a3ffe981071e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:41.700501 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-bb0a5e0b-5747-458e-b8a7-a3ffe981071e None None] MFA Rules not processed for user `17e1588f582443929cffc07017537a6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:41.701826 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-bb0a5e0b-5747-458e-b8a7-a3ffe981071e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:41.732502 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:41.798170 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1043/2098] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:28:41.807240 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ccf348-263b-4b82-8b89-1384e2ed9aa3 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:41.912158 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:41.919787 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ccf348-263b-4b82-8b89-1384e2ed9aa3 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:41.927965 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d66e7-db2c-4795-b8f8-01142cf11c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:41.928764 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d66e7-db2c-4795-b8f8-01142cf11c28 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:41.929041 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d66e7-db2c-4795-b8f8-01142cf11c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:41.929487 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d66e7-db2c-4795-b8f8-01142cf11c28 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:41.930033 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424d66e7-db2c-4795-b8f8-01142cf11c28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:41.932066 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424d66e7-db2c-4795-b8f8-01142cf11c28 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:41.963475 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1056/2099] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:28:41 2022] POST /identity/v3/projects => generated 381 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:41.968856 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a5e0b-5747-458e-b8a7-a3ffe981071e None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:41.982173 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a5e0b-5747-458e-b8a7-a3ffe981071e None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:42.067201 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5953c2a7-b545-4857-a88d-d134e137445d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:42.067939 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953c2a7-b545-4857-a88d-d134e137445d admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:42.068219 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953c2a7-b545-4857-a88d-d134e137445d admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:42.068558 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953c2a7-b545-4857-a88d-d134e137445d admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:42.069241 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5953c2a7-b545-4857-a88d-d134e137445d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:42.071303 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5953c2a7-b545-4857-a88d-d134e137445d admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:42.099062 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1044/2100] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:28:41 2022] POST /identity/v3/users => generated 291 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:28:42.102855 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d66e7-db2c-4795-b8f8-01142cf11c28 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:42.116599 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5953c2a7-b545-4857-a88d-d134e137445d admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:42.118308 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-5953c2a7-b545-4857-a88d-d134e137445d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:42.123866 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d66e7-db2c-4795-b8f8-01142cf11c28 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:42.129237 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3136ee53-2d8a-407c-ba21-087c6bcd6540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:42.129924 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136ee53-2d8a-407c-ba21-087c6bcd6540 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:42.130271 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136ee53-2d8a-407c-ba21-087c6bcd6540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:42.130605 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136ee53-2d8a-407c-ba21-087c6bcd6540 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:42.131735 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3136ee53-2d8a-407c-ba21-087c6bcd6540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:42.133572 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3136ee53-2d8a-407c-ba21-087c6bcd6540 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:42.134324 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5953c2a7-b545-4857-a88d-d134e137445d admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:42.139922 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89bbc83-3fa3-489d-a8fb-f1f4cd5fff48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:42.140605 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89bbc83-3fa3-489d-a8fb-f1f4cd5fff48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:42.140898 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89bbc83-3fa3-489d-a8fb-f1f4cd5fff48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:42.141253 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89bbc83-3fa3-489d-a8fb-f1f4cd5fff48 admin admin] PATH_INFO: `/v3/users/aff66a6263cd4dc2979c02b83c3fd2f5` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:42.142627 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89bbc83-3fa3-489d-a8fb-f1f4cd5fff48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aff66a6263cd4dc2979c02b83c3fd2f5)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:42.144793 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89bbc83-3fa3-489d-a8fb-f1f4cd5fff48 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:42.148498 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1057/2101] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:42.149614 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3136ee53-2d8a-407c-ba21-087c6bcd6540 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:42.159994 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3136ee53-2d8a-407c-ba21-087c6bcd6540 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:42.165086 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb686ba-d9f4-4b31-b83e-247f8892a3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:42.165711 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb686ba-d9f4-4b31-b83e-247f8892a3f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:42.166020 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb686ba-d9f4-4b31-b83e-247f8892a3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:42.166278 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb686ba-d9f4-4b31-b83e-247f8892a3f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:42.166937 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb686ba-d9f4-4b31-b83e-247f8892a3f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:42.168764 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb686ba-d9f4-4b31-b83e-247f8892a3f4 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:42.181052 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1058/2102] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:28:42.186693 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb686ba-d9f4-4b31-b83e-247f8892a3f4 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:42.199752 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb686ba-d9f4-4b31-b83e-247f8892a3f4 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:42.206636 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e505c8a7-a8e9-4d95-ada3-6a6907e2cb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:42.207445 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e505c8a7-a8e9-4d95-ada3-6a6907e2cb20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:42.207826 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e505c8a7-a8e9-4d95-ada3-6a6907e2cb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:42.208192 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e505c8a7-a8e9-4d95-ada3-6a6907e2cb20 admin admin] PATH_INFO: `/v3/projects/91993cea815846e9af883c82185281ca/users/b0a4bd6dc6ed4e11ad391965e10fc75c/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:42.217655 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f89bbc83-3fa3-489d-a8fb-f1f4cd5fff48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aff66a6263cd4dc2979c02b83c3fd2f5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:42.225849 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f89bbc83-3fa3-489d-a8fb-f1f4cd5fff48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aff66a6263cd4dc2979c02b83c3fd2f5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:42.226584 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f89bbc83-3fa3-489d-a8fb-f1f4cd5fff48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aff66a6263cd4dc2979c02b83c3fd2f5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:42.227832 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e505c8a7-a8e9-4d95-ada3-6a6907e2cb20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91993cea815846e9af883c82185281ca, user_id=b0a4bd6dc6ed4e11ad391965e10fc75c, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:42.231103 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e505c8a7-a8e9-4d95-ada3-6a6907e2cb20 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:42.234645 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f89bbc83-3fa3-489d-a8fb-f1f4cd5fff48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aff66a6263cd4dc2979c02b83c3fd2f5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:42.235724 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f89bbc83-3fa3-489d-a8fb-f1f4cd5fff48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aff66a6263cd4dc2979c02b83c3fd2f5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:42.247699 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1059/2103] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:28:42 2022] PUT /identity/v3/projects/91993cea815846e9af883c82185281ca/users/b0a4bd6dc6ed4e11ad391965e10fc75c/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:42.258098 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1045/2104] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:28:42 2022] DELETE /identity/v3/users/aff66a6263cd4dc2979c02b83c3fd2f5 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:28:42.259525 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26754a08-da9e-44ce-87b1-c6ecaaaa29ca None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:42.259963 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26754a08-da9e-44ce-87b1-c6ecaaaa29ca None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:42.260251 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26754a08-da9e-44ce-87b1-c6ecaaaa29ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:42.261915 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f7ea3-ba45-4201-a4fe-636e0c5c6720 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:42.262325 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f7ea3-ba45-4201-a4fe-636e0c5c6720 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:42.262600 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f7ea3-ba45-4201-a4fe-636e0c5c6720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:42.284560 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-f03f7ea3-ba45-4201-a4fe-636e0c5c6720 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:42.285843 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f03f7ea3-ba45-4201-a4fe-636e0c5c6720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:42.302600 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-26754a08-da9e-44ce-87b1-c6ecaaaa29ca None None] MFA Rules not processed for user `b0a4bd6dc6ed4e11ad391965e10fc75c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:42.304621 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-26754a08-da9e-44ce-87b1-c6ecaaaa29ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:42.323970 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:42.352938 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1060/2105] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:42.353842 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f7ea3-ba45-4201-a4fe-636e0c5c6720 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:42.355273 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f03f7ea3-ba45-4201-a4fe-636e0c5c6720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:42.367815 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f7ea3-ba45-4201-a4fe-636e0c5c6720 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:42.372881 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f38cb41-89a6-4711-b404-daf4b07b0008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:42.373524 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38cb41-89a6-4711-b404-daf4b07b0008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:42.373929 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38cb41-89a6-4711-b404-daf4b07b0008 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:42.374207 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38cb41-89a6-4711-b404-daf4b07b0008 admin admin] PATH_INFO: `/v3/users/7834f26d2b174e188ac47972b897aa90` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:42.375403 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f38cb41-89a6-4711-b404-daf4b07b0008 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7834f26d2b174e188ac47972b897aa90)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:42.377508 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f38cb41-89a6-4711-b404-daf4b07b0008 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:42.389308 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1046/2106] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:42.390178 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26754a08-da9e-44ce-87b1-c6ecaaaa29ca None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:42.391741 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-26754a08-da9e-44ce-87b1-c6ecaaaa29ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:42.430588 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-7f38cb41-89a6-4711-b404-daf4b07b0008 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7834f26d2b174e188ac47972b897aa90'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:42.439457 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-7f38cb41-89a6-4711-b404-daf4b07b0008 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7834f26d2b174e188ac47972b897aa90'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:42.446764 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-7f38cb41-89a6-4711-b404-daf4b07b0008 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7834f26d2b174e188ac47972b897aa90'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:42.447442 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-7f38cb41-89a6-4711-b404-daf4b07b0008 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7834f26d2b174e188ac47972b897aa90'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:42.455566 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26754a08-da9e-44ce-87b1-c6ecaaaa29ca None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:42.459466 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96304f7f-3717-413d-9939-2e942e461a16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:42.460316 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96304f7f-3717-413d-9939-2e942e461a16 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:42.460616 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-7f38cb41-89a6-4711-b404-daf4b07b0008 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7834f26d2b174e188ac47972b897aa90'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:42.460726 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96304f7f-3717-413d-9939-2e942e461a16 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:42.460886 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96304f7f-3717-413d-9939-2e942e461a16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:42.462752 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-96304f7f-3717-413d-9939-2e942e461a16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:42.467033 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1061/2107] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:28:42 2022] DELETE /identity/v3/users/7834f26d2b174e188ac47972b897aa90 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:42.467804 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f38cb41-89a6-4711-b404-daf4b07b0008 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:42.469151 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-7f38cb41-89a6-4711-b404-daf4b07b0008 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:42.476680 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96304f7f-3717-413d-9939-2e942e461a16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:42.478491 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96304f7f-3717-413d-9939-2e942e461a16 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:42.479436 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:42.490039 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1047/2108] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:28:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:28:42.493298 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957c60a-d93e-4c47-b945-ff2a080271c1 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:42.493913 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957c60a-d93e-4c47-b945-ff2a080271c1 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:42.493913 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957c60a-d93e-4c47-b945-ff2a080271c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:42.513207 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-2957c60a-d93e-4c47-b945-ff2a080271c1 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:42.514438 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-2957c60a-d93e-4c47-b945-ff2a080271c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:42.554754 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f38cb41-89a6-4711-b404-daf4b07b0008 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:42.561815 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5889ed3-043e-4178-9a3b-773e210070c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:42.562720 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5889ed3-043e-4178-9a3b-773e210070c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:42.563001 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5889ed3-043e-4178-9a3b-773e210070c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:42.563275 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5889ed3-043e-4178-9a3b-773e210070c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:42.564132 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5889ed3-043e-4178-9a3b-773e210070c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:42.569024 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5889ed3-043e-4178-9a3b-773e210070c3 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:42.601039 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1048/2109] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:42.606063 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1062/2110] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:28:42 2022] POST /identity/v3/projects => generated 383 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:42.610501 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2957c60a-d93e-4c47-b945-ff2a080271c1 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:42.617365 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5889ed3-043e-4178-9a3b-773e210070c3 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:42.620187 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c5889ed3-043e-4178-9a3b-773e210070c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:42.627345 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2957c60a-d93e-4c47-b945-ff2a080271c1 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:42.700232 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5889ed3-043e-4178-9a3b-773e210070c3 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:42.705181 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e0f7b-0f98-4fd1-953a-e6c362701f61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:42.705771 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e0f7b-0f98-4fd1-953a-e6c362701f61 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:42.706052 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e0f7b-0f98-4fd1-953a-e6c362701f61 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:42.706329 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e0f7b-0f98-4fd1-953a-e6c362701f61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:42.708656 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:42.727617 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25a6e3-5cb5-44f5-b8ae-9f829b498cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:42.728328 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25a6e3-5cb5-44f5-b8ae-9f829b498cbf admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:42.728604 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25a6e3-5cb5-44f5-b8ae-9f829b498cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:42.728916 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25a6e3-5cb5-44f5-b8ae-9f829b498cbf admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:42.729881 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d25a6e3-5cb5-44f5-b8ae-9f829b498cbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:42.731839 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d25a6e3-5cb5-44f5-b8ae-9f829b498cbf admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:42.779917 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1049/2111] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:28:42 2022] POST /identity/v3/users => generated 298 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:28:42.781328 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25a6e3-5cb5-44f5-b8ae-9f829b498cbf admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:42.794155 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25a6e3-5cb5-44f5-b8ae-9f829b498cbf admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:42.799870 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf5a31-d143-44e3-87b5-2b5ef1e37d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:42.800750 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf5a31-d143-44e3-87b5-2b5ef1e37d0a admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:42.801038 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf5a31-d143-44e3-87b5-2b5ef1e37d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:42.801319 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf5a31-d143-44e3-87b5-2b5ef1e37d0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:42.802260 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf5a31-d143-44e3-87b5-2b5ef1e37d0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:42.804393 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf5a31-d143-44e3-87b5-2b5ef1e37d0a admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:42.818406 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1050/2112] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:42.824150 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038e0f7b-0f98-4fd1-953a-e6c362701f61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:42.825540 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf5a31-d143-44e3-87b5-2b5ef1e37d0a admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:42.829177 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038e0f7b-0f98-4fd1-953a-e6c362701f61 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:42.848019 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf5a31-d143-44e3-87b5-2b5ef1e37d0a admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:42.860055 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956462a-2c19-4aba-a84d-4f7b8dc14763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:42.861952 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1063/2113] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:28:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:28:42.862764 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956462a-2c19-4aba-a84d-4f7b8dc14763 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:42.863407 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956462a-2c19-4aba-a84d-4f7b8dc14763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:42.863893 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956462a-2c19-4aba-a84d-4f7b8dc14763 admin admin] PATH_INFO: `/v3/projects/5b7916bd457a471b9c8c037a3cb00d61/users/d84eb6481bf04e838862f74e46d18e17/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:42.867256 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e0f7b-0f98-4fd1-953a-e6c362701f61 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:42.868860 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-038e0f7b-0f98-4fd1-953a-e6c362701f61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:42.897315 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e0f7b-0f98-4fd1-953a-e6c362701f61 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:42.905814 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f76710c-8adb-4cfb-b6a7-9c38239bcbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:42.906508 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f76710c-8adb-4cfb-b6a7-9c38239bcbea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:42.906795 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f76710c-8adb-4cfb-b6a7-9c38239bcbea admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:42.907064 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f76710c-8adb-4cfb-b6a7-9c38239bcbea admin admin] PATH_INFO: `/v3/projects/ddbce3e262a5434abf2b7afdeebb24da` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:42.907261 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e956462a-2c19-4aba-a84d-4f7b8dc14763 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b7916bd457a471b9c8c037a3cb00d61, user_id=d84eb6481bf04e838862f74e46d18e17, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:42.908348 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f76710c-8adb-4cfb-b6a7-9c38239bcbea admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddbce3e262a5434abf2b7afdeebb24da)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:42.910575 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f76710c-8adb-4cfb-b6a7-9c38239bcbea admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:42.911568 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e956462a-2c19-4aba-a84d-4f7b8dc14763 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:42.933550 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1051/2114] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:28:42 2022] PUT /identity/v3/projects/5b7916bd457a471b9c8c037a3cb00d61/users/d84eb6481bf04e838862f74e46d18e17/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:42.937649 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956462a-2c19-4aba-a84d-4f7b8dc14763 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:42.991707 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:43.026922 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-6f76710c-8adb-4cfb-b6a7-9c38239bcbea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddbce3e262a5434abf2b7afdeebb24da', 'request_id': 'req-6f76710c-8adb-4cfb-b6a7-9c38239bcbea'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:43.035655 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-6f76710c-8adb-4cfb-b6a7-9c38239bcbea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddbce3e262a5434abf2b7afdeebb24da', 'request_id': 'req-6f76710c-8adb-4cfb-b6a7-9c38239bcbea'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:43.044240 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-6f76710c-8adb-4cfb-b6a7-9c38239bcbea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddbce3e262a5434abf2b7afdeebb24da', 'request_id': 'req-6f76710c-8adb-4cfb-b6a7-9c38239bcbea'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:43.069624 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-6f76710c-8adb-4cfb-b6a7-9c38239bcbea admin admin] The token cache is being invalidate because project ddbce3e262a5434abf2b7afdeebb24da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:28:43.070172 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956462a-2c19-4aba-a84d-4f7b8dc14763 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:43.071295 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-6f76710c-8adb-4cfb-b6a7-9c38239bcbea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:43.072850 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-6f76710c-8adb-4cfb-b6a7-9c38239bcbea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:43.080025 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1064/2115] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:28:42 2022] DELETE /identity/v3/projects/ddbce3e262a5434abf2b7afdeebb24da => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:43.081373 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f76710c-8adb-4cfb-b6a7-9c38239bcbea admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:43.084279 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-6f76710c-8adb-4cfb-b6a7-9c38239bcbea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:43.195017 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863650e2-c8c1-4170-a25c-e93a4a0b2f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:43.195898 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863650e2-c8c1-4170-a25c-e93a4a0b2f3e admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:43.196374 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863650e2-c8c1-4170-a25c-e93a4a0b2f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:43.196758 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863650e2-c8c1-4170-a25c-e93a4a0b2f3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:43.197531 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863650e2-c8c1-4170-a25c-e93a4a0b2f3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:43.199277 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863650e2-c8c1-4170-a25c-e93a4a0b2f3e admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:43.212344 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f76710c-8adb-4cfb-b6a7-9c38239bcbea admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:43.220231 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1052/2116] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:43.227180 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863650e2-c8c1-4170-a25c-e93a4a0b2f3e admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:43.227180 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-863650e2-c8c1-4170-a25c-e93a4a0b2f3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:43.232403 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65430b66-5a83-4f1b-82f5-3f4e13aab1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:43.233317 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65430b66-5a83-4f1b-82f5-3f4e13aab1c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:43.233739 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65430b66-5a83-4f1b-82f5-3f4e13aab1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:43.234174 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65430b66-5a83-4f1b-82f5-3f4e13aab1c2 admin admin] PATH_INFO: `/v3/users/55b4f62b5160401a82708ddcfca60322` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:43.236400 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65430b66-5a83-4f1b-82f5-3f4e13aab1c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55b4f62b5160401a82708ddcfca60322)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:43.239481 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65430b66-5a83-4f1b-82f5-3f4e13aab1c2 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:43.248539 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863650e2-c8c1-4170-a25c-e93a4a0b2f3e admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:43.254954 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027cf6c1-806c-4abe-a243-7308f7b87f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:43.256746 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027cf6c1-806c-4abe-a243-7308f7b87f02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:43.257105 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027cf6c1-806c-4abe-a243-7308f7b87f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:43.262749 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027cf6c1-806c-4abe-a243-7308f7b87f02 admin admin] PATH_INFO: `/v3/projects/5b7916bd457a471b9c8c037a3cb00d61/users/d84eb6481bf04e838862f74e46d18e17/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:43.262749 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027cf6c1-806c-4abe-a243-7308f7b87f02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b7916bd457a471b9c8c037a3cb00d61, user_id=d84eb6481bf04e838862f74e46d18e17, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:43.264082 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027cf6c1-806c-4abe-a243-7308f7b87f02 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:43.278881 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1053/2117] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:28:43 2022] PUT /identity/v3/projects/5b7916bd457a471b9c8c037a3cb00d61/users/d84eb6481bf04e838862f74e46d18e17/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:28:43.292377 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b9fc7-10b4-4f99-bffb-7f5af977570e None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:43.292827 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b9fc7-10b4-4f99-bffb-7f5af977570e None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:43.293326 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b9fc7-10b4-4f99-bffb-7f5af977570e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:43.325465 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-65430b66-5a83-4f1b-82f5-3f4e13aab1c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55b4f62b5160401a82708ddcfca60322'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:43.335104 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-cf2b9fc7-10b4-4f99-bffb-7f5af977570e None None] MFA Rules not processed for user `d84eb6481bf04e838862f74e46d18e17`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:43.336288 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-65430b66-5a83-4f1b-82f5-3f4e13aab1c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55b4f62b5160401a82708ddcfca60322'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:43.336425 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-cf2b9fc7-10b4-4f99-bffb-7f5af977570e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:43.345838 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-65430b66-5a83-4f1b-82f5-3f4e13aab1c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55b4f62b5160401a82708ddcfca60322'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:43.346859 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-65430b66-5a83-4f1b-82f5-3f4e13aab1c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55b4f62b5160401a82708ddcfca60322'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:43.372804 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-65430b66-5a83-4f1b-82f5-3f4e13aab1c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55b4f62b5160401a82708ddcfca60322'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:43.381045 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1065/2118] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:28:43 2022] DELETE /identity/v3/users/55b4f62b5160401a82708ddcfca60322 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:28:43.386450 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:43.449696 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1054/2119] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:43 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:28:43.465626 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65430b66-5a83-4f1b-82f5-3f4e13aab1c2 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:43.467658 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-65430b66-5a83-4f1b-82f5-3f4e13aab1c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:43.553509 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:43.571361 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65430b66-5a83-4f1b-82f5-3f4e13aab1c2 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:43.581894 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61797dce-c48f-417e-95a5-0abdd8a5851e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:43.583245 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61797dce-c48f-417e-95a5-0abdd8a5851e service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:43.583715 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61797dce-c48f-417e-95a5-0abdd8a5851e service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:43.584221 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61797dce-c48f-417e-95a5-0abdd8a5851e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:43.586507 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-61797dce-c48f-417e-95a5-0abdd8a5851e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:43.602622 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b9fc7-10b4-4f99-bffb-7f5af977570e None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:43.604126 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-cf2b9fc7-10b4-4f99-bffb-7f5af977570e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:43.695285 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61797dce-c48f-417e-95a5-0abdd8a5851e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:43.698623 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61797dce-c48f-417e-95a5-0abdd8a5851e service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:43.717302 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1066/2120] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:28:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:28:43.756374 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b9fc7-10b4-4f99-bffb-7f5af977570e None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:43.830553 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61797dce-c48f-417e-95a5-0abdd8a5851e service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:43.832295 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-61797dce-c48f-417e-95a5-0abdd8a5851e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:43.845704 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa64cd04-7e08-4fea-95ff-d1b6dd47bacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:43.846473 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa64cd04-7e08-4fea-95ff-d1b6dd47bacd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:43.846757 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa64cd04-7e08-4fea-95ff-d1b6dd47bacd admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:43.847189 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa64cd04-7e08-4fea-95ff-d1b6dd47bacd admin admin] PATH_INFO: `/v3/projects/a6805b4c67fb48899a508ca6640c5b99` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:43.848427 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa64cd04-7e08-4fea-95ff-d1b6dd47bacd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6805b4c67fb48899a508ca6640c5b99)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:43.850669 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa64cd04-7e08-4fea-95ff-d1b6dd47bacd admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:43.939434 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-fa64cd04-7e08-4fea-95ff-d1b6dd47bacd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6805b4c67fb48899a508ca6640c5b99', 'request_id': 'req-fa64cd04-7e08-4fea-95ff-d1b6dd47bacd'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:43.960217 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-fa64cd04-7e08-4fea-95ff-d1b6dd47bacd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6805b4c67fb48899a508ca6640c5b99', 'request_id': 'req-fa64cd04-7e08-4fea-95ff-d1b6dd47bacd'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:43.968499 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61797dce-c48f-417e-95a5-0abdd8a5851e service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:43.975782 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-fa64cd04-7e08-4fea-95ff-d1b6dd47bacd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6805b4c67fb48899a508ca6640c5b99', 'request_id': 'req-fa64cd04-7e08-4fea-95ff-d1b6dd47bacd'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:43.990491 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-fa64cd04-7e08-4fea-95ff-d1b6dd47bacd admin admin] The token cache is being invalidate because project a6805b4c67fb48899a508ca6640c5b99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:28:43.990978 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-fa64cd04-7e08-4fea-95ff-d1b6dd47bacd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:43.991714 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-fa64cd04-7e08-4fea-95ff-d1b6dd47bacd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:43.993840 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1055/2121] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:28:43 2022] DELETE /identity/v3/projects/a6805b4c67fb48899a508ca6640c5b99 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:28:43.998370 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa64cd04-7e08-4fea-95ff-d1b6dd47bacd admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:44.004697 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-fa64cd04-7e08-4fea-95ff-d1b6dd47bacd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:44.017625 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:44.052568 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba4bc8-9c32-423f-ba3b-334fa82a2293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:44.054089 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba4bc8-9c32-423f-ba3b-334fa82a2293 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:44.054447 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba4bc8-9c32-423f-ba3b-334fa82a2293 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:44.054779 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba4bc8-9c32-423f-ba3b-334fa82a2293 admin admin] PATH_INFO: `/v3/projects/0f6029b0dbd14dca9cfe6ae90b2e334f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:44.056233 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba4bc8-9c32-423f-ba3b-334fa82a2293 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f6029b0dbd14dca9cfe6ae90b2e334f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:44.059026 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba4bc8-9c32-423f-ba3b-334fa82a2293 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:44.133961 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa64cd04-7e08-4fea-95ff-d1b6dd47bacd admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:44.153602 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:44.155584 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-64ba4bc8-9c32-423f-ba3b-334fa82a2293 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f6029b0dbd14dca9cfe6ae90b2e334f', 'request_id': 'req-64ba4bc8-9c32-423f-ba3b-334fa82a2293'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:44.167721 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-64ba4bc8-9c32-423f-ba3b-334fa82a2293 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f6029b0dbd14dca9cfe6ae90b2e334f', 'request_id': 'req-64ba4bc8-9c32-423f-ba3b-334fa82a2293'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:44.186716 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-64ba4bc8-9c32-423f-ba3b-334fa82a2293 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f6029b0dbd14dca9cfe6ae90b2e334f', 'request_id': 'req-64ba4bc8-9c32-423f-ba3b-334fa82a2293'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:44.217874 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-64ba4bc8-9c32-423f-ba3b-334fa82a2293 admin admin] The token cache is being invalidate because project 0f6029b0dbd14dca9cfe6ae90b2e334f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:28:44.218274 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-64ba4bc8-9c32-423f-ba3b-334fa82a2293 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:44.219571 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-64ba4bc8-9c32-423f-ba3b-334fa82a2293 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:44.221391 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1067/2122] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:28:43 2022] DELETE /identity/v3/projects/0f6029b0dbd14dca9cfe6ae90b2e334f => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:44.225459 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba4bc8-9c32-423f-ba3b-334fa82a2293 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:44.226869 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-64ba4bc8-9c32-423f-ba3b-334fa82a2293 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:44.244342 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22ae82-101c-4952-afe1-d058342bf2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:44.245180 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22ae82-101c-4952-afe1-d058342bf2ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:44.245544 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22ae82-101c-4952-afe1-d058342bf2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:44.245754 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22ae82-101c-4952-afe1-d058342bf2ea admin admin] PATH_INFO: `/v3/users/d9f8a5163b674455a9b5163331b6467f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:44.250129 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c22ae82-101c-4952-afe1-d058342bf2ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9f8a5163b674455a9b5163331b6467f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:44.250129 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c22ae82-101c-4952-afe1-d058342bf2ea admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:44.339167 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba4bc8-9c32-423f-ba3b-334fa82a2293 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:44.343752 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4c22ae82-101c-4952-afe1-d058342bf2ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9f8a5163b674455a9b5163331b6467f'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:44.348794 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e81cf1c-0bcd-425c-b6d4-b2e39798e95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:44.349568 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81cf1c-0bcd-425c-b6d4-b2e39798e95e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:44.349914 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81cf1c-0bcd-425c-b6d4-b2e39798e95e admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:44.350277 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81cf1c-0bcd-425c-b6d4-b2e39798e95e admin admin] PATH_INFO: `/v3/users/747c05001c1f46a6bdad7f59c5a1d700` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:44.351842 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e81cf1c-0bcd-425c-b6d4-b2e39798e95e admin admin] RBAC: Authorizing `identity:delete_user(user_id=747c05001c1f46a6bdad7f59c5a1d700)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:44.354002 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e81cf1c-0bcd-425c-b6d4-b2e39798e95e admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:44.359894 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4c22ae82-101c-4952-afe1-d058342bf2ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9f8a5163b674455a9b5163331b6467f'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:44.361235 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4c22ae82-101c-4952-afe1-d058342bf2ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9f8a5163b674455a9b5163331b6467f'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:44.384001 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4c22ae82-101c-4952-afe1-d058342bf2ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9f8a5163b674455a9b5163331b6467f'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:44.385087 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4c22ae82-101c-4952-afe1-d058342bf2ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9f8a5163b674455a9b5163331b6467f'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:44.430211 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1056/2123] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:28:43 2022] DELETE /identity/v3/users/d9f8a5163b674455a9b5163331b6467f => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:44.463998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-4e81cf1c-0bcd-425c-b6d4-b2e39798e95e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '747c05001c1f46a6bdad7f59c5a1d700'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:44.480073 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-4e81cf1c-0bcd-425c-b6d4-b2e39798e95e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '747c05001c1f46a6bdad7f59c5a1d700'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:44.495099 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-4e81cf1c-0bcd-425c-b6d4-b2e39798e95e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '747c05001c1f46a6bdad7f59c5a1d700'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:44.496245 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-4e81cf1c-0bcd-425c-b6d4-b2e39798e95e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '747c05001c1f46a6bdad7f59c5a1d700'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:44.514863 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-4e81cf1c-0bcd-425c-b6d4-b2e39798e95e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '747c05001c1f46a6bdad7f59c5a1d700'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:44.533114 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1068/2124] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:28:44 2022] DELETE /identity/v3/users/747c05001c1f46a6bdad7f59c5a1d700 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:28:44.950449 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22ae82-101c-4952-afe1-d058342bf2ea admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:44.952540 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-4c22ae82-101c-4952-afe1-d058342bf2ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:45.016509 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:45.054183 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22ae82-101c-4952-afe1-d058342bf2ea admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:45.121261 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f4cf6-5318-49c0-9f69-7641a92a394d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:45.121848 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f4cf6-5318-49c0-9f69-7641a92a394d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:45.122119 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f4cf6-5318-49c0-9f69-7641a92a394d admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:45.122382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f4cf6-5318-49c0-9f69-7641a92a394d admin admin] PATH_INFO: `/v3/projects/e86c8b8872a74b21848bb0b28f5d1f4e` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:45.123762 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f4cf6-5318-49c0-9f69-7641a92a394d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e86c8b8872a74b21848bb0b28f5d1f4e)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:45.125916 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f4cf6-5318-49c0-9f69-7641a92a394d admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:45.180478 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-987f4cf6-5318-49c0-9f69-7641a92a394d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e86c8b8872a74b21848bb0b28f5d1f4e', 'request_id': 'req-987f4cf6-5318-49c0-9f69-7641a92a394d'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:45.187197 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-987f4cf6-5318-49c0-9f69-7641a92a394d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e86c8b8872a74b21848bb0b28f5d1f4e', 'request_id': 'req-987f4cf6-5318-49c0-9f69-7641a92a394d'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:45.198290 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-987f4cf6-5318-49c0-9f69-7641a92a394d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e86c8b8872a74b21848bb0b28f5d1f4e', 'request_id': 'req-987f4cf6-5318-49c0-9f69-7641a92a394d'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:45.212308 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-987f4cf6-5318-49c0-9f69-7641a92a394d admin admin] The token cache is being invalidate because project e86c8b8872a74b21848bb0b28f5d1f4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:28:45.212666 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-987f4cf6-5318-49c0-9f69-7641a92a394d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:45.213398 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-987f4cf6-5318-49c0-9f69-7641a92a394d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:45.215200 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1057/2125] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:28:44 2022] DELETE /identity/v3/projects/e86c8b8872a74b21848bb0b28f5d1f4e => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:45.220372 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f671b5-55b6-4de4-8c3c-6222b212e346 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:45.220923 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f671b5-55b6-4de4-8c3c-6222b212e346 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:45.220923 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f671b5-55b6-4de4-8c3c-6222b212e346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:45.244899 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-79f671b5-55b6-4de4-8c3c-6222b212e346 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:45.246144 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-79f671b5-55b6-4de4-8c3c-6222b212e346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:45.312656 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:45.333358 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1069/2126] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:28:45.341706 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02b416-0dbc-4bc0-9ab1-31a5a3ee10bd None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:45.341997 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02b416-0dbc-4bc0-9ab1-31a5a3ee10bd None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:45.342278 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02b416-0dbc-4bc0-9ab1-31a5a3ee10bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:45.366130 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-cd02b416-0dbc-4bc0-9ab1-31a5a3ee10bd None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:45.368103 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-cd02b416-0dbc-4bc0-9ab1-31a5a3ee10bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:45.377491 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1058/2127] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:28:45.390885 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f671b5-55b6-4de4-8c3c-6222b212e346 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:45.406472 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f671b5-55b6-4de4-8c3c-6222b212e346 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:45.412068 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e3cbc-dc55-498f-98d7-7ddf67075e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:45.412932 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e3cbc-dc55-498f-98d7-7ddf67075e31 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:45.413492 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e3cbc-dc55-498f-98d7-7ddf67075e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:45.413992 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e3cbc-dc55-498f-98d7-7ddf67075e31 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:45.414964 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2e3cbc-dc55-498f-98d7-7ddf67075e31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:28:45.415364 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2e3cbc-dc55-498f-98d7-7ddf67075e31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:45.417351 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2e3cbc-dc55-498f-98d7-7ddf67075e31 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:45.436181 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1070/2128] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:28:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:28:45.436735 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd02b416-0dbc-4bc0-9ab1-31a5a3ee10bd None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:45.438300 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-cd02b416-0dbc-4bc0-9ab1-31a5a3ee10bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:45.441135 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e3cbc-dc55-498f-98d7-7ddf67075e31 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:45.453210 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e3cbc-dc55-498f-98d7-7ddf67075e31 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:45.458860 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43330a-b0ea-43c0-9e8a-32c64d3cefdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:45.459617 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43330a-b0ea-43c0-9e8a-32c64d3cefdd admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:45.460012 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43330a-b0ea-43c0-9e8a-32c64d3cefdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:45.460384 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43330a-b0ea-43c0-9e8a-32c64d3cefdd admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:45.461189 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c43330a-b0ea-43c0-9e8a-32c64d3cefdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:45.463374 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c43330a-b0ea-43c0-9e8a-32c64d3cefdd admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:45.508803 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1071/2129] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:28:45 2022] POST /identity/v3/projects => generated 383 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:28:45.508995 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd02b416-0dbc-4bc0-9ab1-31a5a3ee10bd None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:45.509146 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43330a-b0ea-43c0-9e8a-32c64d3cefdd admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:45.511828 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-0c43330a-b0ea-43c0-9e8a-32c64d3cefdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:45.526750 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:45.573806 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6bc6ef-2132-43ac-9172-90fe5f48b138 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:45.575117 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6bc6ef-2132-43ac-9172-90fe5f48b138 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:45.575117 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6bc6ef-2132-43ac-9172-90fe5f48b138 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:45.575117 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6bc6ef-2132-43ac-9172-90fe5f48b138 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:45.577181 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-cd6bc6ef-2132-43ac-9172-90fe5f48b138 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:45.598828 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43330a-b0ea-43c0-9e8a-32c64d3cefdd admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:45.605756 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d133dd07-25b5-4d58-8fd1-033bae4555df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:45.607121 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133dd07-25b5-4d58-8fd1-033bae4555df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:45.607505 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133dd07-25b5-4d58-8fd1-033bae4555df admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:45.607867 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133dd07-25b5-4d58-8fd1-033bae4555df admin admin] PATH_INFO: `/v3/projects/4c2378aaeaae41f8952a2ebdbe6d43b5` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:45.609353 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d133dd07-25b5-4d58-8fd1-033bae4555df admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c2378aaeaae41f8952a2ebdbe6d43b5)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:45.611966 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d133dd07-25b5-4d58-8fd1-033bae4555df admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:45.665148 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6bc6ef-2132-43ac-9172-90fe5f48b138 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:45.666517 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6bc6ef-2132-43ac-9172-90fe5f48b138 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:45.669689 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-d133dd07-25b5-4d58-8fd1-033bae4555df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c2378aaeaae41f8952a2ebdbe6d43b5', 'request_id': 'req-d133dd07-25b5-4d58-8fd1-033bae4555df'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:45.676887 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1059/2130] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:28:45 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:28:45.677737 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6bc6ef-2132-43ac-9172-90fe5f48b138 service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:45.684630 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-d133dd07-25b5-4d58-8fd1-033bae4555df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c2378aaeaae41f8952a2ebdbe6d43b5', 'request_id': 'req-d133dd07-25b5-4d58-8fd1-033bae4555df'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:45.693103 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-d133dd07-25b5-4d58-8fd1-033bae4555df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c2378aaeaae41f8952a2ebdbe6d43b5', 'request_id': 'req-d133dd07-25b5-4d58-8fd1-033bae4555df'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:45.700359 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6bc6ef-2132-43ac-9172-90fe5f48b138 service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:45.715649 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-d133dd07-25b5-4d58-8fd1-033bae4555df admin admin] The token cache is being invalidate because project 4c2378aaeaae41f8952a2ebdbe6d43b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:28:45.716305 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-d133dd07-25b5-4d58-8fd1-033bae4555df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:45.717359 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-d133dd07-25b5-4d58-8fd1-033bae4555df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:45.719884 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1072/2131] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:28:45 2022] DELETE /identity/v3/projects/4c2378aaeaae41f8952a2ebdbe6d43b5 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:45.725891 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7c8f4-0165-4494-a4fe-bc2de2d47e3e None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:45.726182 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7c8f4-0165-4494-a4fe-bc2de2d47e3e None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:45.726485 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7c8f4-0165-4494-a4fe-bc2de2d47e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:45.750367 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-64d7c8f4-0165-4494-a4fe-bc2de2d47e3e None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:45.751689 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-64d7c8f4-0165-4494-a4fe-bc2de2d47e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:45.812553 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eae87d-45c9-4330-a6de-ba7e401208f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:45.813442 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eae87d-45c9-4330-a6de-ba7e401208f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:45.814142 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eae87d-45c9-4330-a6de-ba7e401208f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:45.814639 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eae87d-45c9-4330-a6de-ba7e401208f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:45.815568 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eae87d-45c9-4330-a6de-ba7e401208f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:45.817627 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eae87d-45c9-4330-a6de-ba7e401208f5 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:45.864038 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:45.896658 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1060/2132] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:28:45 2022] POST /identity/v3/users => generated 292 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:45.900183 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eae87d-45c9-4330-a6de-ba7e401208f5 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:45.902990 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1073/2133] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:28:45.907703 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-28eae87d-45c9-4330-a6de-ba7e401208f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:45.912798 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2fef7-1f40-4d2f-b17b-4c78730def2b None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:45.913699 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2fef7-1f40-4d2f-b17b-4c78730def2b None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:45.914188 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2fef7-1f40-4d2f-b17b-4c78730def2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:45.949031 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eae87d-45c9-4330-a6de-ba7e401208f5 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:45.954927 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952837a-ac56-4cd5-8661-5d9e9873736a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:45.956508 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952837a-ac56-4cd5-8661-5d9e9873736a admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:45.956965 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952837a-ac56-4cd5-8661-5d9e9873736a admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:45.957561 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952837a-ac56-4cd5-8661-5d9e9873736a admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:45.958406 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6952837a-ac56-4cd5-8661-5d9e9873736a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:45.959646 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-d9a2fef7-1f40-4d2f-b17b-4c78730def2b None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:45.960359 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6952837a-ac56-4cd5-8661-5d9e9873736a admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:45.962431 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-d9a2fef7-1f40-4d2f-b17b-4c78730def2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:45.984165 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1074/2134] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:28:45.985399 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a2fef7-1f40-4d2f-b17b-4c78730def2b None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:45.986562 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1061/2135] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:45.987617 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952837a-ac56-4cd5-8661-5d9e9873736a admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:46.000589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a2fef7-1f40-4d2f-b17b-4c78730def2b None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:46.011607 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952837a-ac56-4cd5-8661-5d9e9873736a admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:46.012643 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b24a89-6073-40d3-97a4-c3da407d63f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:46.013287 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b24a89-6073-40d3-97a4-c3da407d63f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:46.013759 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b24a89-6073-40d3-97a4-c3da407d63f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:46.013876 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b24a89-6073-40d3-97a4-c3da407d63f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:46.014689 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b24a89-6073-40d3-97a4-c3da407d63f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:28:46.015002 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b24a89-6073-40d3-97a4-c3da407d63f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:46.016945 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b24a89-6073-40d3-97a4-c3da407d63f3 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:46.024591 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b784aa6-ebe9-4054-a2f6-f7600edd78f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:46.025338 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b784aa6-ebe9-4054-a2f6-f7600edd78f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:46.025722 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b784aa6-ebe9-4054-a2f6-f7600edd78f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:46.026097 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b784aa6-ebe9-4054-a2f6-f7600edd78f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:46.026867 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b784aa6-ebe9-4054-a2f6-f7600edd78f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:46.035934 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b784aa6-ebe9-4054-a2f6-f7600edd78f2 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:46.036078 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1075/2136] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:28:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:28:46.040071 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b24a89-6073-40d3-97a4-c3da407d63f3 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:46.059619 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b24a89-6073-40d3-97a4-c3da407d63f3 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:46.069011 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1062/2137] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:46.069229 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d88ed-b240-405e-8f42-16d9ca16b328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:46.069229 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d88ed-b240-405e-8f42-16d9ca16b328 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:46.069229 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d88ed-b240-405e-8f42-16d9ca16b328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:46.069229 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d88ed-b240-405e-8f42-16d9ca16b328 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:46.069601 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768d88ed-b240-405e-8f42-16d9ca16b328 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:46.070366 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b784aa6-ebe9-4054-a2f6-f7600edd78f2 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:46.071655 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768d88ed-b240-405e-8f42-16d9ca16b328 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:46.093971 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b784aa6-ebe9-4054-a2f6-f7600edd78f2 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:46.106374 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f9b6d1-9a95-43f1-8e8b-9fa30bb2fbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:46.107114 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9b6d1-9a95-43f1-8e8b-9fa30bb2fbf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:46.107406 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9b6d1-9a95-43f1-8e8b-9fa30bb2fbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:46.107693 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9b6d1-9a95-43f1-8e8b-9fa30bb2fbf8 admin admin] PATH_INFO: `/v3/projects/34333b7864574c12be38e612a2d3aeb9/users/27b05d9c4f864132aa17f57ab59316da/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:46.128313 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1076/2138] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:28:46 2022] POST /identity/v3/projects => generated 401 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:46.129515 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d88ed-b240-405e-8f42-16d9ca16b328 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:46.143588 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f9b6d1-9a95-43f1-8e8b-9fa30bb2fbf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34333b7864574c12be38e612a2d3aeb9, user_id=27b05d9c4f864132aa17f57ab59316da, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:46.146255 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f9b6d1-9a95-43f1-8e8b-9fa30bb2fbf8 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:46.177711 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1063/2139] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:28:46 2022] PUT /identity/v3/projects/34333b7864574c12be38e612a2d3aeb9/users/27b05d9c4f864132aa17f57ab59316da/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:46.189224 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de130e29-86c6-4d4a-afff-3a7a3d449ba7 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:46.190220 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de130e29-86c6-4d4a-afff-3a7a3d449ba7 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:46.190530 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de130e29-86c6-4d4a-afff-3a7a3d449ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:46.253675 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-de130e29-86c6-4d4a-afff-3a7a3d449ba7 None None] MFA Rules not processed for user `27b05d9c4f864132aa17f57ab59316da`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:46.257705 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-de130e29-86c6-4d4a-afff-3a7a3d449ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:46.262594 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:46.339949 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d88ed-b240-405e-8f42-16d9ca16b328 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:46.435007 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1064/2140] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:28:46.489567 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a227c0-fa32-47b7-9c4b-22166a7d8269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:46.490393 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a227c0-fa32-47b7-9c4b-22166a7d8269 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:46.490674 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a227c0-fa32-47b7-9c4b-22166a7d8269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:46.490944 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a227c0-fa32-47b7-9c4b-22166a7d8269 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:46.491766 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a227c0-fa32-47b7-9c4b-22166a7d8269 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:46.494471 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a227c0-fa32-47b7-9c4b-22166a7d8269 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:46.549584 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de130e29-86c6-4d4a-afff-3a7a3d449ba7 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:46.551238 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-de130e29-86c6-4d4a-afff-3a7a3d449ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:46.556880 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1077/2141] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:28:46 2022] POST /identity/v3/users => generated 301 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:46.558102 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a227c0-fa32-47b7-9c4b-22166a7d8269 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:46.573299 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a227c0-fa32-47b7-9c4b-22166a7d8269 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:46.582964 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70bdd87-b770-47b1-bb8c-a4cf9cd08f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:46.583609 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70bdd87-b770-47b1-bb8c-a4cf9cd08f07 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:46.583878 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70bdd87-b770-47b1-bb8c-a4cf9cd08f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:46.584149 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70bdd87-b770-47b1-bb8c-a4cf9cd08f07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:46.584840 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70bdd87-b770-47b1-bb8c-a4cf9cd08f07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:46.592177 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70bdd87-b770-47b1-bb8c-a4cf9cd08f07 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:46.622655 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1078/2142] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:46.628351 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70bdd87-b770-47b1-bb8c-a4cf9cd08f07 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:46.652625 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70bdd87-b770-47b1-bb8c-a4cf9cd08f07 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:46.658552 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f4919e-60de-47fc-9820-f05b4396d1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:46.659195 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4919e-60de-47fc-9820-f05b4396d1e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:46.659485 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4919e-60de-47fc-9820-f05b4396d1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:46.659756 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4919e-60de-47fc-9820-f05b4396d1e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:46.660412 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f4919e-60de-47fc-9820-f05b4396d1e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:46.660883 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de130e29-86c6-4d4a-afff-3a7a3d449ba7 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:46.662166 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f4919e-60de-47fc-9820-f05b4396d1e3 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:46.668843 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf099a-d53b-4392-954e-a73953418e20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:46.672752 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf099a-d53b-4392-954e-a73953418e20 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:46.673151 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf099a-d53b-4392-954e-a73953418e20 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:46.673626 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf099a-d53b-4392-954e-a73953418e20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:46.674003 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1079/2143] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:46.678721 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f4919e-60de-47fc-9820-f05b4396d1e3 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:46.690359 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf099a-d53b-4392-954e-a73953418e20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:46.693540 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf099a-d53b-4392-954e-a73953418e20 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:46.707603 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f4919e-60de-47fc-9820-f05b4396d1e3 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:46.708865 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1065/2144] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:28:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:28:46.719346 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc90679c-532d-4c97-b5fc-6b6a3bd4f81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:46.720246 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90679c-532d-4c97-b5fc-6b6a3bd4f81b admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:46.720557 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90679c-532d-4c97-b5fc-6b6a3bd4f81b admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:46.726724 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90679c-532d-4c97-b5fc-6b6a3bd4f81b admin admin] PATH_INFO: `/v3/projects/fb723ee168724a03a5e5d8c68b18a5e6/users/8277421004204237a7963611e79ce6c8/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:46.744931 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc90679c-532d-4c97-b5fc-6b6a3bd4f81b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb723ee168724a03a5e5d8c68b18a5e6, user_id=8277421004204237a7963611e79ce6c8, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:46.748288 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc90679c-532d-4c97-b5fc-6b6a3bd4f81b admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:46.760076 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:46.766580 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1080/2145] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:28:46 2022] PUT /identity/v3/projects/fb723ee168724a03a5e5d8c68b18a5e6/users/8277421004204237a7963611e79ce6c8/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:46.778721 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93561c8b-863d-495d-8ef1-bd54350c7589 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:46.779224 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93561c8b-863d-495d-8ef1-bd54350c7589 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:46.779647 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93561c8b-863d-495d-8ef1-bd54350c7589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:46.863859 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-93561c8b-863d-495d-8ef1-bd54350c7589 None None] MFA Rules not processed for user `8277421004204237a7963611e79ce6c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:46.865478 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-93561c8b-863d-495d-8ef1-bd54350c7589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:46.871671 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc90679c-532d-4c97-b5fc-6b6a3bd4f81b admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:46.873996 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-bc90679c-532d-4c97-b5fc-6b6a3bd4f81b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:46.965073 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1066/2146] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:46 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:46.969524 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93561c8b-863d-495d-8ef1-bd54350c7589 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:46.983308 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc90679c-532d-4c97-b5fc-6b6a3bd4f81b admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:46.988031 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7e5147-350d-4c2e-aea0-4f075702ef19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:46.989144 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e5147-350d-4c2e-aea0-4f075702ef19 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:46.989706 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e5147-350d-4c2e-aea0-4f075702ef19 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:46.990328 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e5147-350d-4c2e-aea0-4f075702ef19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:46.992022 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-cd7e5147-350d-4c2e-aea0-4f075702ef19 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:47.030263 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:47.060164 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93561c8b-863d-495d-8ef1-bd54350c7589 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:47.069476 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e5eb0d-ceba-4c59-a418-25ad00b2dd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:47.070452 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5eb0d-ceba-4c59-a418-25ad00b2dd2b admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:47.070999 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5eb0d-ceba-4c59-a418-25ad00b2dd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:47.071281 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5eb0d-ceba-4c59-a418-25ad00b2dd2b admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:47.072031 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e5eb0d-ceba-4c59-a418-25ad00b2dd2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:47.074292 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e5eb0d-ceba-4c59-a418-25ad00b2dd2b admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:47.089592 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7e5147-350d-4c2e-aea0-4f075702ef19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:47.092279 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7e5147-350d-4c2e-aea0-4f075702ef19 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:47.108584 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1081/2147] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:28:46 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:28:47.125181 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1067/2148] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:28:46 2022] POST /identity/v3/projects => generated 395 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:47.128743 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7e5147-350d-4c2e-aea0-4f075702ef19 service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:47.155265 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7e5147-350d-4c2e-aea0-4f075702ef19 service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:47.250551 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34bcf15-5f98-4464-b0cf-a2e556115b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:47.252234 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34bcf15-5f98-4464-b0cf-a2e556115b84 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:47.252846 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34bcf15-5f98-4464-b0cf-a2e556115b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:47.253642 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34bcf15-5f98-4464-b0cf-a2e556115b84 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:47.254489 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34bcf15-5f98-4464-b0cf-a2e556115b84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:47.257230 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34bcf15-5f98-4464-b0cf-a2e556115b84 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:47.316017 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1082/2149] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:28:47 2022] POST /identity/v3/users => generated 304 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:47.317495 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e5eb0d-ceba-4c59-a418-25ad00b2dd2b admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:47.331654 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e5eb0d-ceba-4c59-a418-25ad00b2dd2b admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:47.339459 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf0c92b-b901-4ea6-899b-e2f53224ec8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:47.340169 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0c92b-b901-4ea6-899b-e2f53224ec8a admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:47.340417 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0c92b-b901-4ea6-899b-e2f53224ec8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:47.340720 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0c92b-b901-4ea6-899b-e2f53224ec8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:47.341428 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf0c92b-b901-4ea6-899b-e2f53224ec8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:47.343604 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf0c92b-b901-4ea6-899b-e2f53224ec8a admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:47.364487 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1068/2150] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:47.368169 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34bcf15-5f98-4464-b0cf-a2e556115b84 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:47.382280 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34bcf15-5f98-4464-b0cf-a2e556115b84 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:47.388338 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542592b7-da60-4345-9116-f664b4c6665f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:47.389187 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542592b7-da60-4345-9116-f664b4c6665f admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:47.389564 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542592b7-da60-4345-9116-f664b4c6665f admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:47.389928 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542592b7-da60-4345-9116-f664b4c6665f admin admin] PATH_INFO: `/v3/projects/d6ffda52fcbf465891e2d7830f8279c3/users/86dc12d4e665485d81551f3150db0dd9/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:47.409163 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542592b7-da60-4345-9116-f664b4c6665f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6ffda52fcbf465891e2d7830f8279c3, user_id=86dc12d4e665485d81551f3150db0dd9, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:47.411973 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542592b7-da60-4345-9116-f664b4c6665f admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:47.427258 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1083/2151] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:28:47 2022] PUT /identity/v3/projects/d6ffda52fcbf465891e2d7830f8279c3/users/86dc12d4e665485d81551f3150db0dd9/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:47.431255 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf0c92b-b901-4ea6-899b-e2f53224ec8a admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:47.442533 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf0c92b-b901-4ea6-899b-e2f53224ec8a admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:47.502558 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa78fd8-7e4c-4ba9-a463-4622424d98fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:47.503730 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa78fd8-7e4c-4ba9-a463-4622424d98fe admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:47.503989 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa78fd8-7e4c-4ba9-a463-4622424d98fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:47.504292 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa78fd8-7e4c-4ba9-a463-4622424d98fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:47.505076 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa78fd8-7e4c-4ba9-a463-4622424d98fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:47.507251 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa78fd8-7e4c-4ba9-a463-4622424d98fe admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:47.522087 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1069/2152] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:47.523410 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542592b7-da60-4345-9116-f664b4c6665f admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:47.550803 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542592b7-da60-4345-9116-f664b4c6665f admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:47.564655 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f7a89-cd74-4c9c-879e-a0f48d59bdf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:47.565026 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f7a89-cd74-4c9c-879e-a0f48d59bdf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:47.565293 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f7a89-cd74-4c9c-879e-a0f48d59bdf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:47.565553 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f7a89-cd74-4c9c-879e-a0f48d59bdf8 admin admin] PATH_INFO: `/v3/projects/d6ffda52fcbf465891e2d7830f8279c3/users/86dc12d4e665485d81551f3150db0dd9/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:47.572693 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3f7a89-cd74-4c9c-879e-a0f48d59bdf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6ffda52fcbf465891e2d7830f8279c3, user_id=86dc12d4e665485d81551f3150db0dd9, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:47.576114 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3f7a89-cd74-4c9c-879e-a0f48d59bdf8 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:47.597300 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1084/2153] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:28:47 2022] PUT /identity/v3/projects/d6ffda52fcbf465891e2d7830f8279c3/users/86dc12d4e665485d81551f3150db0dd9/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:28:47.604045 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700084d4-76bf-493e-9608-427d703328f6 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:47.605141 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700084d4-76bf-493e-9608-427d703328f6 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:47.605141 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700084d4-76bf-493e-9608-427d703328f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:47.641642 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-700084d4-76bf-493e-9608-427d703328f6 None None] MFA Rules not processed for user `86dc12d4e665485d81551f3150db0dd9`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:47.643811 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-700084d4-76bf-493e-9608-427d703328f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:47.759930 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1070/2154] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:47 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:47.775048 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f7a89-cd74-4c9c-879e-a0f48d59bdf8 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:47.783733 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:47.865999 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f7a89-cd74-4c9c-879e-a0f48d59bdf8 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:47.870612 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628d699-eb4f-427a-8601-525d9e5a9ea2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:47.871797 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628d699-eb4f-427a-8601-525d9e5a9ea2 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:47.873055 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628d699-eb4f-427a-8601-525d9e5a9ea2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:47.873577 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628d699-eb4f-427a-8601-525d9e5a9ea2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:47.901783 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628d699-eb4f-427a-8601-525d9e5a9ea2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:47.903651 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628d699-eb4f-427a-8601-525d9e5a9ea2 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:47.929321 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1085/2155] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:28:47 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:28:48.052137 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700084d4-76bf-493e-9608-427d703328f6 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:48.067889 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700084d4-76bf-493e-9608-427d703328f6 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:48.088505 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f81eb-a5b4-4fa6-899e-04f0a902ea81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:48.088505 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f81eb-a5b4-4fa6-899e-04f0a902ea81 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:48.088804 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f81eb-a5b4-4fa6-899e-04f0a902ea81 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:48.089041 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f81eb-a5b4-4fa6-899e-04f0a902ea81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:48.217925 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:48.284887 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347f81eb-a5b4-4fa6-899e-04f0a902ea81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:48.286347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347f81eb-a5b4-4fa6-899e-04f0a902ea81 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:48.305803 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1071/2156] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:28:48 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:28:48.442059 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628d699-eb4f-427a-8601-525d9e5a9ea2 service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:48.444991 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a628d699-eb4f-427a-8601-525d9e5a9ea2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:48.556052 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628d699-eb4f-427a-8601-525d9e5a9ea2 service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:48.562677 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560dbb11-74f1-475e-9fab-770ac8818a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:48.563342 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560dbb11-74f1-475e-9fab-770ac8818a14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:48.563671 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560dbb11-74f1-475e-9fab-770ac8818a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:48.564329 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560dbb11-74f1-475e-9fab-770ac8818a14 admin admin] PATH_INFO: `/v3/users/a92a2da2bce0489988ab08978d85b265` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:48.566038 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560dbb11-74f1-475e-9fab-770ac8818a14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a92a2da2bce0489988ab08978d85b265)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:48.569454 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560dbb11-74f1-475e-9fab-770ac8818a14 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:48.653182 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-560dbb11-74f1-475e-9fab-770ac8818a14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a92a2da2bce0489988ab08978d85b265'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:48.674325 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-560dbb11-74f1-475e-9fab-770ac8818a14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a92a2da2bce0489988ab08978d85b265'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:48.685826 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-560dbb11-74f1-475e-9fab-770ac8818a14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a92a2da2bce0489988ab08978d85b265'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:48.686698 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-560dbb11-74f1-475e-9fab-770ac8818a14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a92a2da2bce0489988ab08978d85b265'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:48.710346 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-560dbb11-74f1-475e-9fab-770ac8818a14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a92a2da2bce0489988ab08978d85b265'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:48.718552 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1086/2157] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:28:48 2022] DELETE /identity/v3/users/a92a2da2bce0489988ab08978d85b265 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:49.179382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f81eb-a5b4-4fa6-899e-04f0a902ea81 service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:49.193824 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f81eb-a5b4-4fa6-899e-04f0a902ea81 service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:49.255348 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd238cbf-816e-46d4-a4fb-9364254868e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:49.256337 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd238cbf-816e-46d4-a4fb-9364254868e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:49.256650 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd238cbf-816e-46d4-a4fb-9364254868e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:49.256928 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd238cbf-816e-46d4-a4fb-9364254868e3 admin admin] PATH_INFO: `/v3/projects/54d43bb823ab468b8f624fa340db52ec` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:49.258075 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd238cbf-816e-46d4-a4fb-9364254868e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54d43bb823ab468b8f624fa340db52ec)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:49.259993 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd238cbf-816e-46d4-a4fb-9364254868e3 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:49.308490 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-bd238cbf-816e-46d4-a4fb-9364254868e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54d43bb823ab468b8f624fa340db52ec', 'request_id': 'req-bd238cbf-816e-46d4-a4fb-9364254868e3'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:49.314887 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-bd238cbf-816e-46d4-a4fb-9364254868e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54d43bb823ab468b8f624fa340db52ec', 'request_id': 'req-bd238cbf-816e-46d4-a4fb-9364254868e3'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:49.322322 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-bd238cbf-816e-46d4-a4fb-9364254868e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54d43bb823ab468b8f624fa340db52ec', 'request_id': 'req-bd238cbf-816e-46d4-a4fb-9364254868e3'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:49.333078 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-bd238cbf-816e-46d4-a4fb-9364254868e3 admin admin] The token cache is being invalidate because project 54d43bb823ab468b8f624fa340db52ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:28:49.333366 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-bd238cbf-816e-46d4-a4fb-9364254868e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:49.334044 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-bd238cbf-816e-46d4-a4fb-9364254868e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:49.335638 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1072/2158] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:28:49 2022] DELETE /identity/v3/projects/54d43bb823ab468b8f624fa340db52ec => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:49.340703 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d83198-eed2-4d66-bd1b-d424a7611d0d None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:49.341046 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d83198-eed2-4d66-bd1b-d424a7611d0d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:49.341325 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d83198-eed2-4d66-bd1b-d424a7611d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:49.362304 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-c7d83198-eed2-4d66-bd1b-d424a7611d0d None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:49.363756 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c7d83198-eed2-4d66-bd1b-d424a7611d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:49.385982 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:49.437920 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1087/2159] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:49.446993 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60704011-5353-44de-8b43-8195f1f8c728 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:49.447479 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60704011-5353-44de-8b43-8195f1f8c728 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:49.447820 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60704011-5353-44de-8b43-8195f1f8c728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:49.472396 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-60704011-5353-44de-8b43-8195f1f8c728 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:49.473844 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-60704011-5353-44de-8b43-8195f1f8c728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:49.483901 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1073/2160] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:49.489087 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d83198-eed2-4d66-bd1b-d424a7611d0d None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:49.499239 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d83198-eed2-4d66-bd1b-d424a7611d0d None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:49.504816 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ca5a28-2b7f-433b-b10a-f71a48babfe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:49.505429 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca5a28-2b7f-433b-b10a-f71a48babfe8 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:49.506030 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca5a28-2b7f-433b-b10a-f71a48babfe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:49.506479 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca5a28-2b7f-433b-b10a-f71a48babfe8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:49.507135 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ca5a28-2b7f-433b-b10a-f71a48babfe8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:28:49.507431 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ca5a28-2b7f-433b-b10a-f71a48babfe8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:49.509186 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ca5a28-2b7f-433b-b10a-f71a48babfe8 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:49.523195 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1088/2161] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:28:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:28:49.528217 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60704011-5353-44de-8b43-8195f1f8c728 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:49.539746 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60704011-5353-44de-8b43-8195f1f8c728 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:49.546570 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6917558-26a9-41d1-8780-0c777719ac8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:49.547177 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6917558-26a9-41d1-8780-0c777719ac8d admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:49.547454 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6917558-26a9-41d1-8780-0c777719ac8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:49.547722 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6917558-26a9-41d1-8780-0c777719ac8d admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:49.548636 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6917558-26a9-41d1-8780-0c777719ac8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:49.550615 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6917558-26a9-41d1-8780-0c777719ac8d admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:49.581467 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1074/2162] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:28:49 2022] POST /identity/v3/projects => generated 389 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:49.585629 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ca5a28-2b7f-433b-b10a-f71a48babfe8 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:49.596213 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ca5a28-2b7f-433b-b10a-f71a48babfe8 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:49.660905 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f91bb-b224-45a7-b2ce-24999f9efeea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:49.661604 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f91bb-b224-45a7-b2ce-24999f9efeea admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:49.661826 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f91bb-b224-45a7-b2ce-24999f9efeea admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:49.662098 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f91bb-b224-45a7-b2ce-24999f9efeea admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:49.662780 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847f91bb-b224-45a7-b2ce-24999f9efeea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:49.664744 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847f91bb-b224-45a7-b2ce-24999f9efeea admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:49.692527 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1089/2163] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:28:49 2022] POST /identity/v3/users => generated 295 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:49.697374 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6917558-26a9-41d1-8780-0c777719ac8d admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:49.708601 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6917558-26a9-41d1-8780-0c777719ac8d admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:49.713642 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f096bf3f-ac32-44f5-96dd-9e9025bbaa31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:49.714279 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096bf3f-ac32-44f5-96dd-9e9025bbaa31 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:49.714563 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096bf3f-ac32-44f5-96dd-9e9025bbaa31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:49.715577 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096bf3f-ac32-44f5-96dd-9e9025bbaa31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:49.715577 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f096bf3f-ac32-44f5-96dd-9e9025bbaa31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:49.717492 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f096bf3f-ac32-44f5-96dd-9e9025bbaa31 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:49.728938 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1075/2164] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:49.733627 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f91bb-b224-45a7-b2ce-24999f9efeea admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:49.744937 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f91bb-b224-45a7-b2ce-24999f9efeea admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:49.749530 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7041a5-25b6-4cbe-88e4-02db6a075be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:49.750140 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7041a5-25b6-4cbe-88e4-02db6a075be8 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:49.750419 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7041a5-25b6-4cbe-88e4-02db6a075be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:49.750681 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7041a5-25b6-4cbe-88e4-02db6a075be8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:49.751468 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7041a5-25b6-4cbe-88e4-02db6a075be8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:49.753377 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7041a5-25b6-4cbe-88e4-02db6a075be8 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:49.765660 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1090/2165] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:28:49.770828 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f096bf3f-ac32-44f5-96dd-9e9025bbaa31 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:49.781208 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f096bf3f-ac32-44f5-96dd-9e9025bbaa31 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:49.786180 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eb738c-261c-4307-b416-17156bea7263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:49.787032 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb738c-261c-4307-b416-17156bea7263 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:49.787332 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb738c-261c-4307-b416-17156bea7263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:49.787620 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb738c-261c-4307-b416-17156bea7263 admin admin] PATH_INFO: `/v3/projects/01bb002d5b6a4a208f8f380833169c4e/users/91fc37814c4f421687ab653f9062da27/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:49.806646 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eb738c-261c-4307-b416-17156bea7263 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01bb002d5b6a4a208f8f380833169c4e, user_id=91fc37814c4f421687ab653f9062da27, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:49.809357 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eb738c-261c-4307-b416-17156bea7263 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:49.818158 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:49.824911 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1076/2166] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:28:49 2022] PUT /identity/v3/projects/01bb002d5b6a4a208f8f380833169c4e/users/91fc37814c4f421687ab653f9062da27/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:28:49.830713 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d696bc-2d8d-476b-9cc5-b102b98cbd61 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:49.830992 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d696bc-2d8d-476b-9cc5-b102b98cbd61 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:49.831290 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d696bc-2d8d-476b-9cc5-b102b98cbd61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:49.851550 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-68d696bc-2d8d-476b-9cc5-b102b98cbd61 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:49.852780 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-68d696bc-2d8d-476b-9cc5-b102b98cbd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:49.949662 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1091/2167] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:49.960172 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eb738c-261c-4307-b416-17156bea7263 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:49.961982 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c2eb738c-261c-4307-b416-17156bea7263 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:50.044047 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eb738c-261c-4307-b416-17156bea7263 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:50.050496 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda7fb46-09aa-4a66-a1c8-8319cea034bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:50.051221 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7fb46-09aa-4a66-a1c8-8319cea034bb service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:50.051944 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7fb46-09aa-4a66-a1c8-8319cea034bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:50.052228 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7fb46-09aa-4a66-a1c8-8319cea034bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:50.064905 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda7fb46-09aa-4a66-a1c8-8319cea034bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:50.067158 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda7fb46-09aa-4a66-a1c8-8319cea034bb service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:50.080234 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1077/2168] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:28:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:28:51.837653 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d696bc-2d8d-476b-9cc5-b102b98cbd61 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:51.847654 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-68d696bc-2d8d-476b-9cc5-b102b98cbd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:51.868305 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d696bc-2d8d-476b-9cc5-b102b98cbd61 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:51.876438 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29844ad8-96ad-4194-ad32-a7fef4d813c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:51.878001 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29844ad8-96ad-4194-ad32-a7fef4d813c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:51.878484 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29844ad8-96ad-4194-ad32-a7fef4d813c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:51.878966 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29844ad8-96ad-4194-ad32-a7fef4d813c3 admin admin] PATH_INFO: `/v3/users/17e1588f582443929cffc07017537a6a` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:51.880548 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29844ad8-96ad-4194-ad32-a7fef4d813c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17e1588f582443929cffc07017537a6a)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:51.885568 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29844ad8-96ad-4194-ad32-a7fef4d813c3 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:51.928282 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:51.955294 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-29844ad8-96ad-4194-ad32-a7fef4d813c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17e1588f582443929cffc07017537a6a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:51.966778 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-29844ad8-96ad-4194-ad32-a7fef4d813c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17e1588f582443929cffc07017537a6a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:51.980558 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-29844ad8-96ad-4194-ad32-a7fef4d813c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17e1588f582443929cffc07017537a6a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:51.981771 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-29844ad8-96ad-4194-ad32-a7fef4d813c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17e1588f582443929cffc07017537a6a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:52.002509 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-29844ad8-96ad-4194-ad32-a7fef4d813c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17e1588f582443929cffc07017537a6a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:52.013112 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1092/2169] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:28:51 2022] DELETE /identity/v3/users/17e1588f582443929cffc07017537a6a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:52.018960 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eaa620-4ad9-42fd-9ce6-8dc23498c431 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:52.018960 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eaa620-4ad9-42fd-9ce6-8dc23498c431 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:52.018960 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eaa620-4ad9-42fd-9ce6-8dc23498c431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:52.068595 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-18eaa620-4ad9-42fd-9ce6-8dc23498c431 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:52.070410 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-18eaa620-4ad9-42fd-9ce6-8dc23498c431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:52.198530 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1078/2170] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:28:52.208731 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29844ad8-96ad-4194-ad32-a7fef4d813c3 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:52.210531 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-29844ad8-96ad-4194-ad32-a7fef4d813c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:52.300898 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29844ad8-96ad-4194-ad32-a7fef4d813c3 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:52.306982 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f528dd-d318-4132-a70c-a9cf29fbae68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:52.308022 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f528dd-d318-4132-a70c-a9cf29fbae68 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:52.308332 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f528dd-d318-4132-a70c-a9cf29fbae68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:52.308716 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f528dd-d318-4132-a70c-a9cf29fbae68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:52.321188 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f528dd-d318-4132-a70c-a9cf29fbae68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:52.322399 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f528dd-d318-4132-a70c-a9cf29fbae68 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:52.340579 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1093/2171] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:28:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:28:53.083196 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eaa620-4ad9-42fd-9ce6-8dc23498c431 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:53.084867 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-18eaa620-4ad9-42fd-9ce6-8dc23498c431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:53.104741 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eaa620-4ad9-42fd-9ce6-8dc23498c431 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:53.118784 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c1782-6f46-4591-b752-b9cd00eb9abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:53.120991 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c1782-6f46-4591-b752-b9cd00eb9abb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:53.121855 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c1782-6f46-4591-b752-b9cd00eb9abb admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:53.122638 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c1782-6f46-4591-b752-b9cd00eb9abb admin admin] PATH_INFO: `/v3/users/8277421004204237a7963611e79ce6c8` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:53.124976 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899c1782-6f46-4591-b752-b9cd00eb9abb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8277421004204237a7963611e79ce6c8)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:53.127882 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899c1782-6f46-4591-b752-b9cd00eb9abb admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:53.132070 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f528dd-d318-4132-a70c-a9cf29fbae68 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:53.133918 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c0f528dd-d318-4132-a70c-a9cf29fbae68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:53.168200 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f528dd-d318-4132-a70c-a9cf29fbae68 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:53.181074 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f76e1-40dc-4962-b51f-7eccb5fa4054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:53.182070 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f76e1-40dc-4962-b51f-7eccb5fa4054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:53.182516 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f76e1-40dc-4962-b51f-7eccb5fa4054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:53.182793 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f76e1-40dc-4962-b51f-7eccb5fa4054 admin admin] PATH_INFO: `/v3/projects/b6bac6649d92416ea732f624e06ddf32` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:53.183997 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f76e1-40dc-4962-b51f-7eccb5fa4054 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6bac6649d92416ea732f624e06ddf32)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:53.186025 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f76e1-40dc-4962-b51f-7eccb5fa4054 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:53.206915 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-899c1782-6f46-4591-b752-b9cd00eb9abb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8277421004204237a7963611e79ce6c8'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:53.218625 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-899c1782-6f46-4591-b752-b9cd00eb9abb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8277421004204237a7963611e79ce6c8'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:53.219572 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-899c1782-6f46-4591-b752-b9cd00eb9abb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8277421004204237a7963611e79ce6c8'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:53.253176 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-7e9f76e1-40dc-4962-b51f-7eccb5fa4054 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6bac6649d92416ea732f624e06ddf32', 'request_id': 'req-7e9f76e1-40dc-4962-b51f-7eccb5fa4054'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:53.261196 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-899c1782-6f46-4591-b752-b9cd00eb9abb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8277421004204237a7963611e79ce6c8'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:53.261519 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-7e9f76e1-40dc-4962-b51f-7eccb5fa4054 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6bac6649d92416ea732f624e06ddf32', 'request_id': 'req-7e9f76e1-40dc-4962-b51f-7eccb5fa4054'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:53.261955 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-899c1782-6f46-4591-b752-b9cd00eb9abb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8277421004204237a7963611e79ce6c8'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:53.268978 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-7e9f76e1-40dc-4962-b51f-7eccb5fa4054 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6bac6649d92416ea732f624e06ddf32', 'request_id': 'req-7e9f76e1-40dc-4962-b51f-7eccb5fa4054'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:53.286188 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1079/2172] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:28:53 2022] DELETE /identity/v3/users/8277421004204237a7963611e79ce6c8 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:53.287412 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c1782-6f46-4591-b752-b9cd00eb9abb admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:53.289655 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-899c1782-6f46-4591-b752-b9cd00eb9abb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:53.291359 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-7e9f76e1-40dc-4962-b51f-7eccb5fa4054 admin admin] The token cache is being invalidate because project b6bac6649d92416ea732f624e06ddf32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:28:53.292359 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-7e9f76e1-40dc-4962-b51f-7eccb5fa4054 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:53.293360 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-7e9f76e1-40dc-4962-b51f-7eccb5fa4054 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:53.300861 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1094/2173] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:28:53 2022] DELETE /identity/v3/projects/b6bac6649d92416ea732f624e06ddf32 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:53.302267 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577edc7-c466-4922-af38-0285c46f79ed None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:53.302558 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577edc7-c466-4922-af38-0285c46f79ed None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:53.302836 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577edc7-c466-4922-af38-0285c46f79ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:53.315985 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:53.341234 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-e577edc7-c466-4922-af38-0285c46f79ed None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:53.343850 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e577edc7-c466-4922-af38-0285c46f79ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:53.420878 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c1782-6f46-4591-b752-b9cd00eb9abb admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:53.427809 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785fd1fe-0cc7-4e73-be1b-3340f73a67c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:53.428940 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785fd1fe-0cc7-4e73-be1b-3340f73a67c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:53.429427 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785fd1fe-0cc7-4e73-be1b-3340f73a67c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:53.429904 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785fd1fe-0cc7-4e73-be1b-3340f73a67c2 admin admin] PATH_INFO: `/v3/users/27b05d9c4f864132aa17f57ab59316da` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:53.434054 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785fd1fe-0cc7-4e73-be1b-3340f73a67c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27b05d9c4f864132aa17f57ab59316da)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:53.439026 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785fd1fe-0cc7-4e73-be1b-3340f73a67c2 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:53.451949 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:53.527041 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1095/2174] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:53.527041 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577edc7-c466-4922-af38-0285c46f79ed None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:53.527041 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e577edc7-c466-4922-af38-0285c46f79ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:53.556419 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577edc7-c466-4922-af38-0285c46f79ed None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:53.557664 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-785fd1fe-0cc7-4e73-be1b-3340f73a67c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27b05d9c4f864132aa17f57ab59316da'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:53.562059 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba50feb-c913-4a97-abe8-9e3c2e8444fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:53.562968 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba50feb-c913-4a97-abe8-9e3c2e8444fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:53.563370 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba50feb-c913-4a97-abe8-9e3c2e8444fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:53.563804 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba50feb-c913-4a97-abe8-9e3c2e8444fc admin admin] PATH_INFO: `/v3/users/b0a4bd6dc6ed4e11ad391965e10fc75c` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:53.565331 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba50feb-c913-4a97-abe8-9e3c2e8444fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0a4bd6dc6ed4e11ad391965e10fc75c)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:53.567598 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba50feb-c913-4a97-abe8-9e3c2e8444fc admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:53.569747 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-785fd1fe-0cc7-4e73-be1b-3340f73a67c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27b05d9c4f864132aa17f57ab59316da'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:53.570700 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-785fd1fe-0cc7-4e73-be1b-3340f73a67c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27b05d9c4f864132aa17f57ab59316da'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:53.588043 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-785fd1fe-0cc7-4e73-be1b-3340f73a67c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27b05d9c4f864132aa17f57ab59316da'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:53.589794 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-785fd1fe-0cc7-4e73-be1b-3340f73a67c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27b05d9c4f864132aa17f57ab59316da'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:53.635518 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1080/2175] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:28:53 2022] DELETE /identity/v3/users/27b05d9c4f864132aa17f57ab59316da => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:53.636694 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785fd1fe-0cc7-4e73-be1b-3340f73a67c2 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:53.642592 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-785fd1fe-0cc7-4e73-be1b-3340f73a67c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:53.664882 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-fba50feb-c913-4a97-abe8-9e3c2e8444fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0a4bd6dc6ed4e11ad391965e10fc75c'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:53.678705 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-fba50feb-c913-4a97-abe8-9e3c2e8444fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0a4bd6dc6ed4e11ad391965e10fc75c'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:53.699192 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-fba50feb-c913-4a97-abe8-9e3c2e8444fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0a4bd6dc6ed4e11ad391965e10fc75c'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:53.701296 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-fba50feb-c913-4a97-abe8-9e3c2e8444fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0a4bd6dc6ed4e11ad391965e10fc75c'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:53.727443 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-fba50feb-c913-4a97-abe8-9e3c2e8444fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0a4bd6dc6ed4e11ad391965e10fc75c'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:53.728972 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785fd1fe-0cc7-4e73-be1b-3340f73a67c2 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:53.741120 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1096/2176] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:28:53 2022] DELETE /identity/v3/users/b0a4bd6dc6ed4e11ad391965e10fc75c => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:53.741120 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3cd3f-40f2-43e0-b941-eb55be405101 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:53.741120 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3cd3f-40f2-43e0-b941-eb55be405101 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:53.741120 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3cd3f-40f2-43e0-b941-eb55be405101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:53.752889 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3600e8-243c-4bb9-9e27-2a950703dfba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:53.752889 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3600e8-243c-4bb9-9e27-2a950703dfba service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:53.752889 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3600e8-243c-4bb9-9e27-2a950703dfba service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:53.752889 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3600e8-243c-4bb9-9e27-2a950703dfba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:53.765793 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-8a3600e8-243c-4bb9-9e27-2a950703dfba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:53.795176 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-b0d3cd3f-40f2-43e0-b941-eb55be405101 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:53.800854 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b0d3cd3f-40f2-43e0-b941-eb55be405101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:53.873773 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:53.942802 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1097/2177] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:53.950582 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3600e8-243c-4bb9-9e27-2a950703dfba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:53.952326 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3600e8-243c-4bb9-9e27-2a950703dfba service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:53.957068 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d3cd3f-40f2-43e0-b941-eb55be405101 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:53.959725 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b0d3cd3f-40f2-43e0-b941-eb55be405101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:53.965820 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1081/2178] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:28:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:28:54.090192 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:54.128491 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d3cd3f-40f2-43e0-b941-eb55be405101 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:54.140081 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e928c2-802c-4340-80de-def99f529d38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:54.140784 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e928c2-802c-4340-80de-def99f529d38 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:54.141196 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e928c2-802c-4340-80de-def99f529d38 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:54.141476 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e928c2-802c-4340-80de-def99f529d38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:54.165163 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e928c2-802c-4340-80de-def99f529d38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:54.168261 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e928c2-802c-4340-80de-def99f529d38 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:54.193373 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1098/2179] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:28:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:28:54.666274 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3600e8-243c-4bb9-9e27-2a950703dfba service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:54.668793 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-8a3600e8-243c-4bb9-9e27-2a950703dfba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:54.694343 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3600e8-243c-4bb9-9e27-2a950703dfba service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:54.702643 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99f38b-840a-49df-bf03-2c0e15357c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:54.703775 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99f38b-840a-49df-bf03-2c0e15357c78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:54.704189 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99f38b-840a-49df-bf03-2c0e15357c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:54.704641 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99f38b-840a-49df-bf03-2c0e15357c78 admin admin] PATH_INFO: `/v3/projects/91993cea815846e9af883c82185281ca` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:54.706256 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c99f38b-840a-49df-bf03-2c0e15357c78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91993cea815846e9af883c82185281ca)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:54.709308 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c99f38b-840a-49df-bf03-2c0e15357c78 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:54.797627 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-0c99f38b-840a-49df-bf03-2c0e15357c78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91993cea815846e9af883c82185281ca', 'request_id': 'req-0c99f38b-840a-49df-bf03-2c0e15357c78'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:54.807584 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-0c99f38b-840a-49df-bf03-2c0e15357c78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91993cea815846e9af883c82185281ca', 'request_id': 'req-0c99f38b-840a-49df-bf03-2c0e15357c78'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:54.820156 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-0c99f38b-840a-49df-bf03-2c0e15357c78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91993cea815846e9af883c82185281ca', 'request_id': 'req-0c99f38b-840a-49df-bf03-2c0e15357c78'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:54.853860 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-0c99f38b-840a-49df-bf03-2c0e15357c78 admin admin] The token cache is being invalidate because project 91993cea815846e9af883c82185281ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:28:54.875244 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-0c99f38b-840a-49df-bf03-2c0e15357c78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:54.887814 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-0c99f38b-840a-49df-bf03-2c0e15357c78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:54.891551 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1082/2180] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:28:54 2022] DELETE /identity/v3/projects/91993cea815846e9af883c82185281ca => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:54.895605 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e928c2-802c-4340-80de-def99f529d38 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:54.917589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e928c2-802c-4340-80de-def99f529d38 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:54.956916 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99f38b-840a-49df-bf03-2c0e15357c78 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:54.960828 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-0c99f38b-840a-49df-bf03-2c0e15357c78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:55.037475 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f1ea2-e92b-4ac0-b4ae-7f8a4c31017f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:55.039304 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f1ea2-e92b-4ac0-b4ae-7f8a4c31017f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:55.039610 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f1ea2-e92b-4ac0-b4ae-7f8a4c31017f admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:55.039884 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f1ea2-e92b-4ac0-b4ae-7f8a4c31017f admin admin] PATH_INFO: `/v3/users/d84eb6481bf04e838862f74e46d18e17` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:55.041559 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0f1ea2-e92b-4ac0-b4ae-7f8a4c31017f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d84eb6481bf04e838862f74e46d18e17)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:55.048085 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0f1ea2-e92b-4ac0-b4ae-7f8a4c31017f admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:55.118981 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99f38b-840a-49df-bf03-2c0e15357c78 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:55.128885 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9800010c-7ed8-4f4f-a7e9-9e9da343900f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:55.134726 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800010c-7ed8-4f4f-a7e9-9e9da343900f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:55.135279 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800010c-7ed8-4f4f-a7e9-9e9da343900f admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:55.135572 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800010c-7ed8-4f4f-a7e9-9e9da343900f admin admin] PATH_INFO: `/v3/projects/34333b7864574c12be38e612a2d3aeb9` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:55.137792 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9800010c-7ed8-4f4f-a7e9-9e9da343900f admin admin] RBAC: Authorizing `identity:delete_project(project_id=34333b7864574c12be38e612a2d3aeb9)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:55.141402 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9800010c-7ed8-4f4f-a7e9-9e9da343900f admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:55.165752 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-bb0f1ea2-e92b-4ac0-b4ae-7f8a4c31017f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd84eb6481bf04e838862f74e46d18e17'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:55.185773 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-bb0f1ea2-e92b-4ac0-b4ae-7f8a4c31017f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd84eb6481bf04e838862f74e46d18e17'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:55.233415 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-bb0f1ea2-e92b-4ac0-b4ae-7f8a4c31017f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd84eb6481bf04e838862f74e46d18e17'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:55.234834 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-bb0f1ea2-e92b-4ac0-b4ae-7f8a4c31017f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd84eb6481bf04e838862f74e46d18e17'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:55.241097 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9800010c-7ed8-4f4f-a7e9-9e9da343900f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34333b7864574c12be38e612a2d3aeb9', 'request_id': 'req-9800010c-7ed8-4f4f-a7e9-9e9da343900f'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:55.252008 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9800010c-7ed8-4f4f-a7e9-9e9da343900f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34333b7864574c12be38e612a2d3aeb9', 'request_id': 'req-9800010c-7ed8-4f4f-a7e9-9e9da343900f'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:55.261212 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-bb0f1ea2-e92b-4ac0-b4ae-7f8a4c31017f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd84eb6481bf04e838862f74e46d18e17'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:55.272137 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9800010c-7ed8-4f4f-a7e9-9e9da343900f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34333b7864574c12be38e612a2d3aeb9', 'request_id': 'req-9800010c-7ed8-4f4f-a7e9-9e9da343900f'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:55.278219 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1099/2181] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:28:54 2022] DELETE /identity/v3/users/d84eb6481bf04e838862f74e46d18e17 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:55.279268 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f1ea2-e92b-4ac0-b4ae-7f8a4c31017f admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:55.280786 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-bb0f1ea2-e92b-4ac0-b4ae-7f8a4c31017f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:55.285225 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:55.297510 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9800010c-7ed8-4f4f-a7e9-9e9da343900f admin admin] The token cache is being invalidate because project 34333b7864574c12be38e612a2d3aeb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:28:55.298198 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9800010c-7ed8-4f4f-a7e9-9e9da343900f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:55.299257 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9800010c-7ed8-4f4f-a7e9-9e9da343900f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:55.309211 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1083/2182] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:28:54 2022] DELETE /identity/v3/projects/34333b7864574c12be38e612a2d3aeb9 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:28:55.311706 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7cc2a-a8da-4748-87c0-0e7d6ab5f5d2 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:55.312061 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7cc2a-a8da-4748-87c0-0e7d6ab5f5d2 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:55.312653 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7cc2a-a8da-4748-87c0-0e7d6ab5f5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:55.359205 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-b3b7cc2a-a8da-4748-87c0-0e7d6ab5f5d2 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:55.360624 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b3b7cc2a-a8da-4748-87c0-0e7d6ab5f5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:55.446087 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f1ea2-e92b-4ac0-b4ae-7f8a4c31017f admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:55.459963 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffffc0af-8f37-44a8-86e3-c713e38ea40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:55.460724 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffffc0af-8f37-44a8-86e3-c713e38ea40e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:55.461007 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffffc0af-8f37-44a8-86e3-c713e38ea40e admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:55.461281 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffffc0af-8f37-44a8-86e3-c713e38ea40e admin admin] PATH_INFO: `/v3/projects/fb723ee168724a03a5e5d8c68b18a5e6` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:55.462442 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffffc0af-8f37-44a8-86e3-c713e38ea40e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb723ee168724a03a5e5d8c68b18a5e6)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:55.464401 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffffc0af-8f37-44a8-86e3-c713e38ea40e admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:55.473258 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:55.487284 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1084/2183] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:55.492471 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89111947-a836-4298-aeb7-ac52cc02c7a5 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:55.492855 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89111947-a836-4298-aeb7-ac52cc02c7a5 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:55.493196 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89111947-a836-4298-aeb7-ac52cc02c7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:55.522871 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-89111947-a836-4298-aeb7-ac52cc02c7a5 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:55.524293 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-89111947-a836-4298-aeb7-ac52cc02c7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:55.548734 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ffffc0af-8f37-44a8-86e3-c713e38ea40e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb723ee168724a03a5e5d8c68b18a5e6', 'request_id': 'req-ffffc0af-8f37-44a8-86e3-c713e38ea40e'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:55.563567 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ffffc0af-8f37-44a8-86e3-c713e38ea40e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb723ee168724a03a5e5d8c68b18a5e6', 'request_id': 'req-ffffc0af-8f37-44a8-86e3-c713e38ea40e'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:55.573230 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ffffc0af-8f37-44a8-86e3-c713e38ea40e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb723ee168724a03a5e5d8c68b18a5e6', 'request_id': 'req-ffffc0af-8f37-44a8-86e3-c713e38ea40e'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:55.595535 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ffffc0af-8f37-44a8-86e3-c713e38ea40e admin admin] The token cache is being invalidate because project fb723ee168724a03a5e5d8c68b18a5e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:28:55.595825 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ffffc0af-8f37-44a8-86e3-c713e38ea40e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:55.598062 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ffffc0af-8f37-44a8-86e3-c713e38ea40e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:55.601228 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1100/2184] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:28:55 2022] DELETE /identity/v3/projects/fb723ee168724a03a5e5d8c68b18a5e6 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:55.604521 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffffc0af-8f37-44a8-86e3-c713e38ea40e admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:55.605952 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-ffffc0af-8f37-44a8-86e3-c713e38ea40e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:55.661404 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1085/2185] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:55.662382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89111947-a836-4298-aeb7-ac52cc02c7a5 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:55.683900 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89111947-a836-4298-aeb7-ac52cc02c7a5 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:55.722294 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e8ae0-cd79-43ae-8686-d8acf2b0b656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:55.723182 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e8ae0-cd79-43ae-8686-d8acf2b0b656 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:55.723750 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e8ae0-cd79-43ae-8686-d8acf2b0b656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:55.724812 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e8ae0-cd79-43ae-8686-d8acf2b0b656 admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:55.726258 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffffc0af-8f37-44a8-86e3-c713e38ea40e admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:55.729640 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992e8ae0-cd79-43ae-8686-d8acf2b0b656 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:28:55.730355 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992e8ae0-cd79-43ae-8686-d8acf2b0b656 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:55.733217 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992e8ae0-cd79-43ae-8686-d8acf2b0b656 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:55.740596 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfada93f-d937-4c94-af14-8a1b7256e765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:55.741290 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfada93f-d937-4c94-af14-8a1b7256e765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:55.741894 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfada93f-d937-4c94-af14-8a1b7256e765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:55.741894 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfada93f-d937-4c94-af14-8a1b7256e765 admin admin] PATH_INFO: `/v3/users/86dc12d4e665485d81551f3150db0dd9` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:55.743060 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfada93f-d937-4c94-af14-8a1b7256e765 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86dc12d4e665485d81551f3150db0dd9)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:55.749293 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfada93f-d937-4c94-af14-8a1b7256e765 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:55.770140 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1086/2186] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:28:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:28:55.774761 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e8ae0-cd79-43ae-8686-d8acf2b0b656 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:55.803538 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e8ae0-cd79-43ae-8686-d8acf2b0b656 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:55.814382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ffd482-a194-446d-8ebf-53089fa6b1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:55.815053 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ffd482-a194-446d-8ebf-53089fa6b1f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:55.815332 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ffd482-a194-446d-8ebf-53089fa6b1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:55.815624 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ffd482-a194-446d-8ebf-53089fa6b1f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:55.816282 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ffd482-a194-446d-8ebf-53089fa6b1f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:55.823886 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ffd482-a194-446d-8ebf-53089fa6b1f3 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:55.860712 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-cfada93f-d937-4c94-af14-8a1b7256e765 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86dc12d4e665485d81551f3150db0dd9'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:55.890712 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1087/2187] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:28:55 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:55.896822 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ffd482-a194-446d-8ebf-53089fa6b1f3 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:55.901007 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-cfada93f-d937-4c94-af14-8a1b7256e765 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86dc12d4e665485d81551f3150db0dd9'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:55.911670 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-cfada93f-d937-4c94-af14-8a1b7256e765 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86dc12d4e665485d81551f3150db0dd9'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:55.914511 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-cfada93f-d937-4c94-af14-8a1b7256e765 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86dc12d4e665485d81551f3150db0dd9'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:55.969514 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-cfada93f-d937-4c94-af14-8a1b7256e765 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86dc12d4e665485d81551f3150db0dd9'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:56.008542 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1101/2188] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:28:55 2022] DELETE /identity/v3/users/86dc12d4e665485d81551f3150db0dd9 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:28:56.009550 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfada93f-d937-4c94-af14-8a1b7256e765 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:56.013319 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-cfada93f-d937-4c94-af14-8a1b7256e765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:56.036534 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:56.131711 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ffd482-a194-446d-8ebf-53089fa6b1f3 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:56.154349 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:56.239716 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfada93f-d937-4c94-af14-8a1b7256e765 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:56.261334 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea541b-385e-4925-8a41-9ce4ae84aacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:56.262036 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea541b-385e-4925-8a41-9ce4ae84aacc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:56.262310 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea541b-385e-4925-8a41-9ce4ae84aacc admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:56.262576 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea541b-385e-4925-8a41-9ce4ae84aacc admin admin] PATH_INFO: `/v3/projects/5b7916bd457a471b9c8c037a3cb00d61` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:56.266364 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ea541b-385e-4925-8a41-9ce4ae84aacc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b7916bd457a471b9c8c037a3cb00d61)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:56.284606 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ea541b-385e-4925-8a41-9ce4ae84aacc admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:56.324664 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d0cfcf-6d1b-48d9-8c26-0f71fb37e4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:56.325425 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0cfcf-6d1b-48d9-8c26-0f71fb37e4b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:56.325744 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0cfcf-6d1b-48d9-8c26-0f71fb37e4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:56.325895 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0cfcf-6d1b-48d9-8c26-0f71fb37e4b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:56.326528 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d0cfcf-6d1b-48d9-8c26-0f71fb37e4b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:56.328844 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d0cfcf-6d1b-48d9-8c26-0f71fb37e4b4 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:56.356246 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-62ea541b-385e-4925-8a41-9ce4ae84aacc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b7916bd457a471b9c8c037a3cb00d61', 'request_id': 'req-62ea541b-385e-4925-8a41-9ce4ae84aacc'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:56.381047 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-62ea541b-385e-4925-8a41-9ce4ae84aacc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b7916bd457a471b9c8c037a3cb00d61', 'request_id': 'req-62ea541b-385e-4925-8a41-9ce4ae84aacc'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:56.390746 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-62ea541b-385e-4925-8a41-9ce4ae84aacc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b7916bd457a471b9c8c037a3cb00d61', 'request_id': 'req-62ea541b-385e-4925-8a41-9ce4ae84aacc'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:56.396117 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1088/2189] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:28:55 2022] POST /identity/v3/users => generated 287 bytes in 500 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:28:56.400444 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d0cfcf-6d1b-48d9-8c26-0f71fb37e4b4 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:56.406179 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-35d0cfcf-6d1b-48d9-8c26-0f71fb37e4b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:56.417029 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-62ea541b-385e-4925-8a41-9ce4ae84aacc admin admin] The token cache is being invalidate because project 5b7916bd457a471b9c8c037a3cb00d61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:28:56.417029 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-62ea541b-385e-4925-8a41-9ce4ae84aacc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:56.417962 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-62ea541b-385e-4925-8a41-9ce4ae84aacc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:56.419694 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1102/2190] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:28:56 2022] DELETE /identity/v3/projects/5b7916bd457a471b9c8c037a3cb00d61 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:56.427642 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d290e9a-f337-4bd8-a38b-e28bdebd01a3 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:56.430742 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d290e9a-f337-4bd8-a38b-e28bdebd01a3 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:56.433163 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d290e9a-f337-4bd8-a38b-e28bdebd01a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:56.453152 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d0cfcf-6d1b-48d9-8c26-0f71fb37e4b4 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:56.507435 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-5d290e9a-f337-4bd8-a38b-e28bdebd01a3 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:56.512234 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-5d290e9a-f337-4bd8-a38b-e28bdebd01a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:56.639898 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2198297-11d0-41ca-981c-4549e99d1e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:56.640897 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2198297-11d0-41ca-981c-4549e99d1e0a admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:56.641485 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2198297-11d0-41ca-981c-4549e99d1e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:56.641836 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2198297-11d0-41ca-981c-4549e99d1e0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:56.643626 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2198297-11d0-41ca-981c-4549e99d1e0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:56.645493 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2198297-11d0-41ca-981c-4549e99d1e0a admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:56.665527 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1089/2191] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:56.667027 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e85efa-7e45-490c-b834-833e3ee36fd8 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:56.667387 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e85efa-7e45-490c-b834-833e3ee36fd8 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:56.667812 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e85efa-7e45-490c-b834-833e3ee36fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:56.704535 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-24e85efa-7e45-490c-b834-833e3ee36fd8 None None] MFA Rules not processed for user `91fc37814c4f421687ab653f9062da27`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:56.706057 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-24e85efa-7e45-490c-b834-833e3ee36fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:56.707645 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1103/2192] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:56.709013 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d290e9a-f337-4bd8-a38b-e28bdebd01a3 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:56.710926 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-5d290e9a-f337-4bd8-a38b-e28bdebd01a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:56.731637 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d290e9a-f337-4bd8-a38b-e28bdebd01a3 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:56.739528 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fac128b-a3c4-4d04-995a-8b7c28c7ac8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:56.740586 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac128b-a3c4-4d04-995a-8b7c28c7ac8d admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:56.741135 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac128b-a3c4-4d04-995a-8b7c28c7ac8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:56.741688 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac128b-a3c4-4d04-995a-8b7c28c7ac8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:56.742682 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fac128b-a3c4-4d04-995a-8b7c28c7ac8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:56.745660 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fac128b-a3c4-4d04-995a-8b7c28c7ac8d admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:56.763861 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1104/2193] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:56.765873 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239299b-e508-4119-a961-e18f79f8d2a0 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:56.766458 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239299b-e508-4119-a961-e18f79f8d2a0 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:56.767957 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239299b-e508-4119-a961-e18f79f8d2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:56.797613 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-1239299b-e508-4119-a961-e18f79f8d2a0 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:56.800190 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-1239299b-e508-4119-a961-e18f79f8d2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:56.809449 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1105/2194] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:56.810411 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239299b-e508-4119-a961-e18f79f8d2a0 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:56.828979 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239299b-e508-4119-a961-e18f79f8d2a0 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:56.836754 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1090/2195] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:56 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:56.837534 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e85efa-7e45-490c-b834-833e3ee36fd8 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:56.870315 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a89f9e3-6a2f-4761-ae53-cf1386aa193b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:56.871035 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89f9e3-6a2f-4761-ae53-cf1386aa193b admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:56.871268 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e85efa-7e45-490c-b834-833e3ee36fd8 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:56.871377 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89f9e3-6a2f-4761-ae53-cf1386aa193b admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:56.871575 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89f9e3-6a2f-4761-ae53-cf1386aa193b admin admin] PATH_INFO: `/v3/projects/71257c838a024f1f96f83d4447f246ab/users/817a2fbf56274267a68ccb5029cb9678/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:56.886864 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b5243-a0b0-4f05-9bf4-a06b3b699231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:56.887579 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b5243-a0b0-4f05-9bf4-a06b3b699231 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:56.888013 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b5243-a0b0-4f05-9bf4-a06b3b699231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:56.888297 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b5243-a0b0-4f05-9bf4-a06b3b699231 admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:56.888990 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b5243-a0b0-4f05-9bf4-a06b3b699231 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:28:56.889406 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b5243-a0b0-4f05-9bf4-a06b3b699231 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:56.891407 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b5243-a0b0-4f05-9bf4-a06b3b699231 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:56.894540 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a89f9e3-6a2f-4761-ae53-cf1386aa193b admin admin] RBAC: Authorizing `identity:create_grant(project_id=71257c838a024f1f96f83d4447f246ab, user_id=817a2fbf56274267a68ccb5029cb9678, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:56.898120 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a89f9e3-6a2f-4761-ae53-cf1386aa193b admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:56.912105 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1091/2196] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:28:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:28:56.914195 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b5243-a0b0-4f05-9bf4-a06b3b699231 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:56.923660 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b99b5243-a0b0-4f05-9bf4-a06b3b699231 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:56.933667 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1106/2197] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:28:56 2022] PUT /identity/v3/projects/71257c838a024f1f96f83d4447f246ab/users/817a2fbf56274267a68ccb5029cb9678/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:56.934561 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a89f9e3-6a2f-4761-ae53-cf1386aa193b admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:56.941654 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b5243-a0b0-4f05-9bf4-a06b3b699231 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:56.944284 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-9a89f9e3-6a2f-4761-ae53-cf1386aa193b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:56.953204 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:56.954449 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:57.030837 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ae573-a0d0-4a8b-b6f2-b18284f633ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:57.031560 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ae573-a0d0-4a8b-b6f2-b18284f633ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:57.031776 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ae573-a0d0-4a8b-b6f2-b18284f633ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:57.032052 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ae573-a0d0-4a8b-b6f2-b18284f633ec admin admin] PATH_INFO: `/v3/projects/d6ffda52fcbf465891e2d7830f8279c3` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:57.033918 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4ae573-a0d0-4a8b-b6f2-b18284f633ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6ffda52fcbf465891e2d7830f8279c3)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:57.036115 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4ae573-a0d0-4a8b-b6f2-b18284f633ec admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:57.075409 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a89f9e3-6a2f-4761-ae53-cf1386aa193b admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:57.085496 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f5100-fcc4-4532-a091-ff0b8b266377 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b7213b7111456a93e294ce40b95b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:57.086440 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f5100-fcc4-4532-a091-ff0b8b266377 service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:57.086950 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f5100-fcc4-4532-a091-ff0b8b266377 service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:57.090570 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f5100-fcc4-4532-a091-ff0b8b266377 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:57.108956 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4d4ae573-a0d0-4a8b-b6f2-b18284f633ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6ffda52fcbf465891e2d7830f8279c3', 'request_id': 'req-4d4ae573-a0d0-4a8b-b6f2-b18284f633ec'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:57.116430 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4d4ae573-a0d0-4a8b-b6f2-b18284f633ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6ffda52fcbf465891e2d7830f8279c3', 'request_id': 'req-4d4ae573-a0d0-4a8b-b6f2-b18284f633ec'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:57.125701 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4d4ae573-a0d0-4a8b-b6f2-b18284f633ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6ffda52fcbf465891e2d7830f8279c3', 'request_id': 'req-4d4ae573-a0d0-4a8b-b6f2-b18284f633ec'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:57.140259 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4d4ae573-a0d0-4a8b-b6f2-b18284f633ec admin admin] The token cache is being invalidate because project d6ffda52fcbf465891e2d7830f8279c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:28:57.140684 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4d4ae573-a0d0-4a8b-b6f2-b18284f633ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:57.141345 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4d4ae573-a0d0-4a8b-b6f2-b18284f633ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:57.146374 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1092/2198] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:28:56 2022] DELETE /identity/v3/projects/d6ffda52fcbf465891e2d7830f8279c3 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:57.146374 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ae573-a0d0-4a8b-b6f2-b18284f633ec admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:57.146374 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-4d4ae573-a0d0-4a8b-b6f2-b18284f633ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:57.153018 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358f5100-fcc4-4532-a091-ff0b8b266377 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:57.154663 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358f5100-fcc4-4532-a091-ff0b8b266377 service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:57.164041 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1107/2199] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:28:56 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:28:57.165475 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522a293-f253-48fe-8875-a0cc7a775ff5 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:57.165776 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522a293-f253-48fe-8875-a0cc7a775ff5 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:57.166054 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522a293-f253-48fe-8875-a0cc7a775ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:57.210234 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-a522a293-f253-48fe-8875-a0cc7a775ff5 None None] MFA Rules not processed for user `817a2fbf56274267a68ccb5029cb9678`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:57.211754 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a522a293-f253-48fe-8875-a0cc7a775ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:57.223911 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ae573-a0d0-4a8b-b6f2-b18284f633ec admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:57.229434 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c963ad5-6c03-4680-a694-98f0dd86f1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:57.230174 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c963ad5-6c03-4680-a694-98f0dd86f1a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:57.230372 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c963ad5-6c03-4680-a694-98f0dd86f1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:57.230646 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c963ad5-6c03-4680-a694-98f0dd86f1a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:57.231359 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c963ad5-6c03-4680-a694-98f0dd86f1a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:57.233452 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c963ad5-6c03-4680-a694-98f0dd86f1a6 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:57.275386 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1093/2200] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:28:57 2022] POST /identity/v3/projects => generated 397 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:57.276955 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e530c-9003-4694-950d-9a3120986c1c None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:57.277324 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e530c-9003-4694-950d-9a3120986c1c None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:57.277671 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e530c-9003-4694-950d-9a3120986c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:57.307156 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-d25e530c-9003-4694-950d-9a3120986c1c None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:57.307359 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1108/2201] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:57.307943 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a522a293-f253-48fe-8875-a0cc7a775ff5 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:57.308137 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d25e530c-9003-4694-950d-9a3120986c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:57.330967 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a522a293-f253-48fe-8875-a0cc7a775ff5 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:57.343837 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:57.372198 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:57.398239 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1094/2202] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:57.399098 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e530c-9003-4694-950d-9a3120986c1c None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:57.400403 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d25e530c-9003-4694-950d-9a3120986c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:57.422058 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47724a0-5c23-48d8-ba90-c125307d7f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:57.423052 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47724a0-5c23-48d8-ba90-c125307d7f6c admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:57.423808 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47724a0-5c23-48d8-ba90-c125307d7f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:57.424625 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47724a0-5c23-48d8-ba90-c125307d7f6c admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:57.425688 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47724a0-5c23-48d8-ba90-c125307d7f6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:57.428522 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47724a0-5c23-48d8-ba90-c125307d7f6c admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:57.469382 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1109/2203] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:28:57 2022] POST /identity/v3/users => generated 299 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:57.469382 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a16bd-893d-41ee-ad80-04e545e87bf2 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:57.469382 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a16bd-893d-41ee-ad80-04e545e87bf2 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:57.469382 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a16bd-893d-41ee-ad80-04e545e87bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:57.482118 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e530c-9003-4694-950d-9a3120986c1c None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:57.491735 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-9b9a16bd-893d-41ee-ad80-04e545e87bf2 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:57.492010 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf1498-fa41-4d1a-8339-6d2525b84d4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:57.492771 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf1498-fa41-4d1a-8339-6d2525b84d4c service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:57.493015 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-9b9a16bd-893d-41ee-ad80-04e545e87bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:57.493176 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf1498-fa41-4d1a-8339-6d2525b84d4c service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:57.493491 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf1498-fa41-4d1a-8339-6d2525b84d4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:57.503377 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1110/2204] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:57.503916 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a16bd-893d-41ee-ad80-04e545e87bf2 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:57.515786 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a16bd-893d-41ee-ad80-04e545e87bf2 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:57.522251 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188a98a-338a-4eb5-b56a-c93942382a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:57.523454 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188a98a-338a-4eb5-b56a-c93942382a06 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:57.523878 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188a98a-338a-4eb5-b56a-c93942382a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:57.524251 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188a98a-338a-4eb5-b56a-c93942382a06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:57.525341 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f188a98a-338a-4eb5-b56a-c93942382a06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:57.527256 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f188a98a-338a-4eb5-b56a-c93942382a06 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:57.544629 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1111/2205] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:57.545850 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188a98a-338a-4eb5-b56a-c93942382a06 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:57.564762 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188a98a-338a-4eb5-b56a-c93942382a06 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:57.574723 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf1498-fa41-4d1a-8339-6d2525b84d4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:57.576481 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf1498-fa41-4d1a-8339-6d2525b84d4c service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:57.581477 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b809af-9484-43ca-afef-cf54dff16519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:57.582451 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b809af-9484-43ca-afef-cf54dff16519 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:57.582785 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b809af-9484-43ca-afef-cf54dff16519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:57.583091 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b809af-9484-43ca-afef-cf54dff16519 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:57.583776 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b809af-9484-43ca-afef-cf54dff16519 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:28:57.584076 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b809af-9484-43ca-afef-cf54dff16519 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:57.585756 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b809af-9484-43ca-afef-cf54dff16519 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:57.588960 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1095/2206] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:28:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:28:57.597009 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf1498-fa41-4d1a-8339-6d2525b84d4c service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:57.601232 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1112/2207] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:28:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:28:57.606451 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b809af-9484-43ca-afef-cf54dff16519 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:57.620373 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b809af-9484-43ca-afef-cf54dff16519 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:57.627791 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272b6161-b39e-461d-a362-82d40154df12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:57.628551 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b6161-b39e-461d-a362-82d40154df12 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:57.629213 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b6161-b39e-461d-a362-82d40154df12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:57.629213 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b6161-b39e-461d-a362-82d40154df12 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:57.629808 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272b6161-b39e-461d-a362-82d40154df12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:57.630041 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf1498-fa41-4d1a-8339-6d2525b84d4c service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:57.632400 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272b6161-b39e-461d-a362-82d40154df12 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:57.644277 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207aae4-7404-4a93-822e-d845e5afdd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:57.645021 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207aae4-7404-4a93-822e-d845e5afdd1a admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:57.645404 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207aae4-7404-4a93-822e-d845e5afdd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:57.646117 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207aae4-7404-4a93-822e-d845e5afdd1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:57.649109 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3207aae4-7404-4a93-822e-d845e5afdd1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:57.650950 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3207aae4-7404-4a93-822e-d845e5afdd1a admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:57.672371 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1096/2208] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:57.677289 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207aae4-7404-4a93-822e-d845e5afdd1a admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:57.689970 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1113/2209] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:28:57 2022] POST /identity/v3/projects => generated 387 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:57.695346 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272b6161-b39e-461d-a362-82d40154df12 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:57.701205 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207aae4-7404-4a93-822e-d845e5afdd1a admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:57.847894 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272b6161-b39e-461d-a362-82d40154df12 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:57.864136 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48dafa5-a894-4a31-ad9e-b5ff40adcce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:57.868595 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48dafa5-a894-4a31-ad9e-b5ff40adcce7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:57.870812 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48dafa5-a894-4a31-ad9e-b5ff40adcce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:57.871849 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48dafa5-a894-4a31-ad9e-b5ff40adcce7 admin admin] PATH_INFO: `/v3/projects/a5b5ca43a4cb4166be2f8f9f5ec9c1c5/users/7c3fc7a3138641858b00cc6eb23ce75a/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:57.872694 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c563de-c4a8-4df5-88a3-66cc3b66f545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:57.875419 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c563de-c4a8-4df5-88a3-66cc3b66f545 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:57.875866 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c563de-c4a8-4df5-88a3-66cc3b66f545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:57.876947 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c563de-c4a8-4df5-88a3-66cc3b66f545 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:57.878439 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c563de-c4a8-4df5-88a3-66cc3b66f545 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:57.889093 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c563de-c4a8-4df5-88a3-66cc3b66f545 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:57.922067 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48dafa5-a894-4a31-ad9e-b5ff40adcce7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5b5ca43a4cb4166be2f8f9f5ec9c1c5, user_id=7c3fc7a3138641858b00cc6eb23ce75a, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:57.925276 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48dafa5-a894-4a31-ad9e-b5ff40adcce7 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:57.936727 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:57.950793 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1114/2210] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:28:57 2022] POST /identity/v3/users => generated 294 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:57.951827 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c563de-c4a8-4df5-88a3-66cc3b66f545 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:57.955862 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1097/2211] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:28:57 2022] PUT /identity/v3/projects/a5b5ca43a4cb4166be2f8f9f5ec9c1c5/users/7c3fc7a3138641858b00cc6eb23ce75a/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:28:57.968927 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d63c25-ae1c-4e80-9910-f3347444e750 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:57.968927 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d63c25-ae1c-4e80-9910-f3347444e750 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:57.969400 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d63c25-ae1c-4e80-9910-f3347444e750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:58.002439 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c563de-c4a8-4df5-88a3-66cc3b66f545 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:58.022575 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-92d63c25-ae1c-4e80-9910-f3347444e750 None None] MFA Rules not processed for user `7c3fc7a3138641858b00cc6eb23ce75a`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:58.024020 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-92d63c25-ae1c-4e80-9910-f3347444e750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:58.125378 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1098/2212] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:57 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:58.165939 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d63c25-ae1c-4e80-9910-f3347444e750 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:58.205406 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:58.232194 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be48223a-a2a5-4c7e-8188-84e0586416e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:58.233295 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be48223a-a2a5-4c7e-8188-84e0586416e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:58.233761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be48223a-a2a5-4c7e-8188-84e0586416e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:58.234311 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be48223a-a2a5-4c7e-8188-84e0586416e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:58.235174 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be48223a-a2a5-4c7e-8188-84e0586416e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:58.237212 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be48223a-a2a5-4c7e-8188-84e0586416e6 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:58.255503 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1115/2213] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:58.261001 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be48223a-a2a5-4c7e-8188-84e0586416e6 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:58.282386 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be48223a-a2a5-4c7e-8188-84e0586416e6 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:58.296006 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d63c25-ae1c-4e80-9910-f3347444e750 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:58.300036 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e79a7-2c9c-463f-9877-6b34db6868f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:58.300221 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b6440f-f810-4ab1-9948-cdf11e230609 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:58.300886 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b6440f-f810-4ab1-9948-cdf11e230609 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:58.301122 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b6440f-f810-4ab1-9948-cdf11e230609 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:58.301329 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e79a7-2c9c-463f-9877-6b34db6868f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:58.301445 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b6440f-f810-4ab1-9948-cdf11e230609 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:58.301797 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e79a7-2c9c-463f-9877-6b34db6868f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:58.302166 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e79a7-2c9c-463f-9877-6b34db6868f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:58.303028 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712e79a7-2c9c-463f-9877-6b34db6868f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:58.307674 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712e79a7-2c9c-463f-9877-6b34db6868f3 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:58.312102 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b6440f-f810-4ab1-9948-cdf11e230609 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:58.314046 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b6440f-f810-4ab1-9948-cdf11e230609 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:58.330789 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1116/2214] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:58.335944 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e79a7-2c9c-463f-9877-6b34db6868f3 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:58.339096 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1099/2215] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:28:58 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:28:58.366503 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e79a7-2c9c-463f-9877-6b34db6868f3 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:58.379423 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0227c0-b0ae-4ddd-8f6f-3bb287d36404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:58.380198 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0227c0-b0ae-4ddd-8f6f-3bb287d36404 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:58.381089 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0227c0-b0ae-4ddd-8f6f-3bb287d36404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:58.381438 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0227c0-b0ae-4ddd-8f6f-3bb287d36404 admin admin] PATH_INFO: `/v3/projects/f5e934cb68ab44ec86fd65ebe68211a8/users/0304d9360aba4b768862fae51dcb05f9/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:58.422342 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0227c0-b0ae-4ddd-8f6f-3bb287d36404 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5e934cb68ab44ec86fd65ebe68211a8, user_id=0304d9360aba4b768862fae51dcb05f9, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:58.428894 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0227c0-b0ae-4ddd-8f6f-3bb287d36404 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:58.435098 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b6440f-f810-4ab1-9948-cdf11e230609 service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:58.436626 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-93b6440f-f810-4ab1-9948-cdf11e230609 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:58.464519 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1117/2216] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:28:58 2022] PUT /identity/v3/projects/f5e934cb68ab44ec86fd65ebe68211a8/users/0304d9360aba4b768862fae51dcb05f9/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:58.468482 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b6440f-f810-4ab1-9948-cdf11e230609 service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:58.470083 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94787ef3-f170-430b-b0e3-a4636fc519c9 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:58.471614 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94787ef3-f170-430b-b0e3-a4636fc519c9 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:58.473315 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94787ef3-f170-430b-b0e3-a4636fc519c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:58.546792 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-94787ef3-f170-430b-b0e3-a4636fc519c9 None None] MFA Rules not processed for user `0304d9360aba4b768862fae51dcb05f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:58.552295 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-94787ef3-f170-430b-b0e3-a4636fc519c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:58.585279 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc48afb-327f-437e-a055-17c932e88545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:58.585930 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc48afb-327f-437e-a055-17c932e88545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:58.586209 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc48afb-327f-437e-a055-17c932e88545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:58.586479 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc48afb-327f-437e-a055-17c932e88545 admin admin] PATH_INFO: `/v3/users/9302d17c8ea947d6a44440f7556d23ac` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:58.589029 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc48afb-327f-437e-a055-17c932e88545 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9302d17c8ea947d6a44440f7556d23ac)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:58.590973 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc48afb-327f-437e-a055-17c932e88545 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:58.646337 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:INSERT=1,keystone:SELECT=94,keystone:DELETE=5 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:58.692500 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1118/2217] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:28:58.694748 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94787ef3-f170-430b-b0e3-a4636fc519c9 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:58.695812 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7cc48afb-327f-437e-a055-17c932e88545 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9302d17c8ea947d6a44440f7556d23ac'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:58.710721 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94787ef3-f170-430b-b0e3-a4636fc519c9 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:58.714173 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7cc48afb-327f-437e-a055-17c932e88545 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9302d17c8ea947d6a44440f7556d23ac'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:58.715228 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7cc48afb-327f-437e-a055-17c932e88545 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9302d17c8ea947d6a44440f7556d23ac'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:58.717276 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e7c5d-e4ee-41bd-9227-33716663b11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:58.718176 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e7c5d-e4ee-41bd-9227-33716663b11d admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:58.718553 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e7c5d-e4ee-41bd-9227-33716663b11d admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:58.718925 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e7c5d-e4ee-41bd-9227-33716663b11d admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:58.719976 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8e7c5d-e4ee-41bd-9227-33716663b11d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:58.723037 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8e7c5d-e4ee-41bd-9227-33716663b11d admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:58.733338 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7cc48afb-327f-437e-a055-17c932e88545 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9302d17c8ea947d6a44440f7556d23ac'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:58.733942 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7cc48afb-327f-437e-a055-17c932e88545 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9302d17c8ea947d6a44440f7556d23ac'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:28:58.767637 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1119/2218] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:28:58 2022] POST /identity/v3/projects => generated 387 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:58.768819 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e7c5d-e4ee-41bd-9227-33716663b11d admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:58.770777 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-5b8e7c5d-e4ee-41bd-9227-33716663b11d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:58.778119 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1100/2219] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:28:58 2022] DELETE /identity/v3/users/9302d17c8ea947d6a44440f7556d23ac => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:58.783315 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963011d1-6866-428f-a055-915809facfb5 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:58.783315 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963011d1-6866-428f-a055-915809facfb5 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:58.783315 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963011d1-6866-428f-a055-915809facfb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:58.833372 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-963011d1-6866-428f-a055-915809facfb5 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:58.838288 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-963011d1-6866-428f-a055-915809facfb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:58.878636 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e7c5d-e4ee-41bd-9227-33716663b11d admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:58.931357 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:58.981920 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1101/2220] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:28:58.983071 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963011d1-6866-428f-a055-915809facfb5 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:58.994348 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc685b9-7d06-4960-918f-4a7da27b6398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:58.994994 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc685b9-7d06-4960-918f-4a7da27b6398 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:58.995273 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc685b9-7d06-4960-918f-4a7da27b6398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:58.995555 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc685b9-7d06-4960-918f-4a7da27b6398 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:58.996561 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc685b9-7d06-4960-918f-4a7da27b6398 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:58.998549 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc685b9-7d06-4960-918f-4a7da27b6398 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:58.999667 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-963011d1-6866-428f-a055-915809facfb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:59.042701 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1120/2221] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:28:58 2022] POST /identity/v3/users => generated 300 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:28:59.044017 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc685b9-7d06-4960-918f-4a7da27b6398 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:59.074573 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc685b9-7d06-4960-918f-4a7da27b6398 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:59.085847 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e64a7-90b7-4511-a29b-2bc145460f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:59.087946 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e64a7-90b7-4511-a29b-2bc145460f33 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:59.088349 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e64a7-90b7-4511-a29b-2bc145460f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:59.089125 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e64a7-90b7-4511-a29b-2bc145460f33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:59.089837 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e64a7-90b7-4511-a29b-2bc145460f33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:59.091749 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e64a7-90b7-4511-a29b-2bc145460f33 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:59.116268 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963011d1-6866-428f-a055-915809facfb5 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:59.125296 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a6c82-6428-43a8-a92c-0e50d23e9b02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:59.125812 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1121/2222] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:59 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:59.126367 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a6c82-6428-43a8-a92c-0e50d23e9b02 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:59.126736 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a6c82-6428-43a8-a92c-0e50d23e9b02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:59.127124 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a6c82-6428-43a8-a92c-0e50d23e9b02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:59.129603 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e64a7-90b7-4511-a29b-2bc145460f33 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:59.152165 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a6c82-6428-43a8-a92c-0e50d23e9b02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:59.153379 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e64a7-90b7-4511-a29b-2bc145460f33 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:59.154906 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a6c82-6428-43a8-a92c-0e50d23e9b02 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:59.166668 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100ed2c-528a-44a2-884c-99c132934b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:59.167743 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100ed2c-528a-44a2-884c-99c132934b4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:59.167743 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100ed2c-528a-44a2-884c-99c132934b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:59.167952 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100ed2c-528a-44a2-884c-99c132934b4f admin admin] PATH_INFO: `/v3/projects/87471f314ff545cab1136805a4f7d030/users/c02b6bc762b44b86adb8e72b042a2e38/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:59.176033 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1102/2223] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:28:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:28:59.191929 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4100ed2c-528a-44a2-884c-99c132934b4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=87471f314ff545cab1136805a4f7d030, user_id=c02b6bc762b44b86adb8e72b042a2e38, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:59.194780 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4100ed2c-528a-44a2-884c-99c132934b4f admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:59.230079 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1122/2224] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:28:59 2022] PUT /identity/v3/projects/87471f314ff545cab1136805a4f7d030/users/c02b6bc762b44b86adb8e72b042a2e38/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:59.234403 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a6c82-6428-43a8-a92c-0e50d23e9b02 service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:59.248493 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a6c82-6428-43a8-a92c-0e50d23e9b02 service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:59.314699 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:28:59.347580 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94250c-d75e-4e4a-9970-c44eae73962f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:59.348169 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94250c-d75e-4e4a-9970-c44eae73962f admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:59.348485 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94250c-d75e-4e4a-9970-c44eae73962f admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:59.351229 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94250c-d75e-4e4a-9970-c44eae73962f admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:59.352258 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94250c-d75e-4e4a-9970-c44eae73962f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:59.354331 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94250c-d75e-4e4a-9970-c44eae73962f admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:59.393584 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1103/2225] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:28:59 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:28:59.395492 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100ed2c-528a-44a2-884c-99c132934b4f admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:59.409433 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100ed2c-528a-44a2-884c-99c132934b4f admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:59.414907 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82dea87-a679-434f-8c9d-c9f6eece2b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:59.415650 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82dea87-a679-434f-8c9d-c9f6eece2b5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:59.415966 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82dea87-a679-434f-8c9d-c9f6eece2b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:59.416239 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82dea87-a679-434f-8c9d-c9f6eece2b5d admin admin] PATH_INFO: `/v3/projects/87471f314ff545cab1136805a4f7d030/users/c02b6bc762b44b86adb8e72b042a2e38/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:59.418430 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82dea87-a679-434f-8c9d-c9f6eece2b5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=87471f314ff545cab1136805a4f7d030, user_id=c02b6bc762b44b86adb8e72b042a2e38, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:59.424644 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82dea87-a679-434f-8c9d-c9f6eece2b5d admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:59.447631 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1123/2226] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:28:59 2022] PUT /identity/v3/projects/87471f314ff545cab1136805a4f7d030/users/c02b6bc762b44b86adb8e72b042a2e38/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:28:59.449839 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b94e9f-1397-4a54-962d-71a50830dcf3 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:59.450467 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b94e9f-1397-4a54-962d-71a50830dcf3 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:59.450467 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b94e9f-1397-4a54-962d-71a50830dcf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:59.511261 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-97b94e9f-1397-4a54-962d-71a50830dcf3 None None] MFA Rules not processed for user `c02b6bc762b44b86adb8e72b042a2e38`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:59.513366 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-97b94e9f-1397-4a54-962d-71a50830dcf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:59.651321 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1104/2227] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:59 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:28:59.652513 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82dea87-a679-434f-8c9d-c9f6eece2b5d admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:59.654957 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b82dea87-a679-434f-8c9d-c9f6eece2b5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:59.757877 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b94e9f-1397-4a54-962d-71a50830dcf3 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:28:59.759465 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-97b94e9f-1397-4a54-962d-71a50830dcf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:28:59.816545 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82dea87-a679-434f-8c9d-c9f6eece2b5d admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:59.822620 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd12e042-cb18-46bc-93a5-4231b2defe8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:59.823505 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12e042-cb18-46bc-93a5-4231b2defe8e service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:59.823789 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12e042-cb18-46bc-93a5-4231b2defe8e service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:59.824065 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12e042-cb18-46bc-93a5-4231b2defe8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:59.838784 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd12e042-cb18-46bc-93a5-4231b2defe8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:59.840785 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd12e042-cb18-46bc-93a5-4231b2defe8e service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:59.866694 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1124/2228] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:28:59 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:28:59.880284 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b94e9f-1397-4a54-962d-71a50830dcf3 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:28:59.881988 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d148fd-94a2-408e-a193-1e6f379ca037 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:59.882283 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d148fd-94a2-408e-a193-1e6f379ca037 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:59.882569 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d148fd-94a2-408e-a193-1e6f379ca037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:59.888433 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c55390-bd2e-4737-992a-2752781e3ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:28:59.889245 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c55390-bd2e-4737-992a-2752781e3ec5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:28:59.889530 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c55390-bd2e-4737-992a-2752781e3ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:28:59.890200 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c55390-bd2e-4737-992a-2752781e3ec5 admin admin] PATH_INFO: `/v3/projects/48f0b4b095314819933698415eb0ca93` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:28:59.891941 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c55390-bd2e-4737-992a-2752781e3ec5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48f0b4b095314819933698415eb0ca93)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:28:59.895144 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c55390-bd2e-4737-992a-2752781e3ec5 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:28:59.929274 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-52d148fd-94a2-408e-a193-1e6f379ca037 None None] MFA Rules not processed for user `91fc37814c4f421687ab653f9062da27`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:28:59.931225 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-52d148fd-94a2-408e-a193-1e6f379ca037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:00.017738 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-40c55390-bd2e-4737-992a-2752781e3ec5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48f0b4b095314819933698415eb0ca93', 'request_id': 'req-40c55390-bd2e-4737-992a-2752781e3ec5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:00.030842 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-40c55390-bd2e-4737-992a-2752781e3ec5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48f0b4b095314819933698415eb0ca93', 'request_id': 'req-40c55390-bd2e-4737-992a-2752781e3ec5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:00.051273 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-40c55390-bd2e-4737-992a-2752781e3ec5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48f0b4b095314819933698415eb0ca93', 'request_id': 'req-40c55390-bd2e-4737-992a-2752781e3ec5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:00.068892 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:00.077189 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-40c55390-bd2e-4737-992a-2752781e3ec5 admin admin] The token cache is being invalidate because project 48f0b4b095314819933698415eb0ca93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:29:00.078401 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-40c55390-bd2e-4737-992a-2752781e3ec5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:00.080687 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-40c55390-bd2e-4737-992a-2752781e3ec5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:00.092598 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1105/2229] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:28:59 2022] DELETE /identity/v3/projects/48f0b4b095314819933698415eb0ca93 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:29:00.092883 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1125/2230] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:28:59 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:29:00.092988 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c55390-bd2e-4737-992a-2752781e3ec5 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:00.097620 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d148fd-94a2-408e-a193-1e6f379ca037 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:00.103898 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-40c55390-bd2e-4737-992a-2752781e3ec5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:00.110563 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d148fd-94a2-408e-a193-1e6f379ca037 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:00.132808 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:00.228989 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c22181-f888-4823-9d83-778458675300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:00.229677 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c22181-f888-4823-9d83-778458675300 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:00.230670 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c22181-f888-4823-9d83-778458675300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:00.230832 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c22181-f888-4823-9d83-778458675300 admin admin] PATH_INFO: `/v3/users/f60dcd23b3e24a0ea77e12b629f2ddcf` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:00.236513 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c22181-f888-4823-9d83-778458675300 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f60dcd23b3e24a0ea77e12b629f2ddcf)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:00.245207 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c22181-f888-4823-9d83-778458675300 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:00.261602 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c55390-bd2e-4737-992a-2752781e3ec5 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:00.267064 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70c72b-c962-43b0-8d64-18bf782685cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:00.267774 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70c72b-c962-43b0-8d64-18bf782685cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:00.268045 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70c72b-c962-43b0-8d64-18bf782685cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:00.268323 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70c72b-c962-43b0-8d64-18bf782685cf admin admin] PATH_INFO: `/v3/users/0304d9360aba4b768862fae51dcb05f9` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:00.269634 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce70c72b-c962-43b0-8d64-18bf782685cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=0304d9360aba4b768862fae51dcb05f9)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:00.271787 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce70c72b-c962-43b0-8d64-18bf782685cf admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:00.377736 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-ce70c72b-c962-43b0-8d64-18bf782685cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0304d9360aba4b768862fae51dcb05f9'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:00.379373 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-28c22181-f888-4823-9d83-778458675300 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f60dcd23b3e24a0ea77e12b629f2ddcf'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:00.402924 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-ce70c72b-c962-43b0-8d64-18bf782685cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0304d9360aba4b768862fae51dcb05f9'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:00.403820 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-ce70c72b-c962-43b0-8d64-18bf782685cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0304d9360aba4b768862fae51dcb05f9'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:00.404309 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-28c22181-f888-4823-9d83-778458675300 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f60dcd23b3e24a0ea77e12b629f2ddcf'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:00.420742 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-ce70c72b-c962-43b0-8d64-18bf782685cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0304d9360aba4b768862fae51dcb05f9'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:00.421935 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-ce70c72b-c962-43b0-8d64-18bf782685cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0304d9360aba4b768862fae51dcb05f9'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:00.426882 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-28c22181-f888-4823-9d83-778458675300 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f60dcd23b3e24a0ea77e12b629f2ddcf'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:00.427895 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-28c22181-f888-4823-9d83-778458675300 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f60dcd23b3e24a0ea77e12b629f2ddcf'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:00.492888 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-28c22181-f888-4823-9d83-778458675300 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f60dcd23b3e24a0ea77e12b629f2ddcf'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:00.527128 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1106/2231] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:29:00 2022] DELETE /identity/v3/users/0304d9360aba4b768862fae51dcb05f9 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:29:00.537360 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104e2ca-313e-422e-a551-0b3aa3531237 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:00.537730 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104e2ca-313e-422e-a551-0b3aa3531237 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:00.539160 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104e2ca-313e-422e-a551-0b3aa3531237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:00.552922 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1126/2232] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:29:00 2022] DELETE /identity/v3/users/f60dcd23b3e24a0ea77e12b629f2ddcf => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:29:00.594206 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-9104e2ca-313e-422e-a551-0b3aa3531237 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:00.596055 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-9104e2ca-313e-422e-a551-0b3aa3531237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:00.770744 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1107/2233] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:29:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:29:00.785046 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c22181-f888-4823-9d83-778458675300 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:00.786934 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-28c22181-f888-4823-9d83-778458675300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:00.911156 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c22181-f888-4823-9d83-778458675300 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:00.918206 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2272ce7a-a91b-422d-90cd-8a59c859b91a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:00.919634 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2272ce7a-a91b-422d-90cd-8a59c859b91a service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:00.920144 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2272ce7a-a91b-422d-90cd-8a59c859b91a service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:00.920602 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2272ce7a-a91b-422d-90cd-8a59c859b91a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:00.942576 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2272ce7a-a91b-422d-90cd-8a59c859b91a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:00.944749 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2272ce7a-a91b-422d-90cd-8a59c859b91a service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:00.967064 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1127/2234] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:29:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:29:01.289118 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9104e2ca-313e-422e-a551-0b3aa3531237 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:01.290451 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-9104e2ca-313e-422e-a551-0b3aa3531237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:01.313205 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9104e2ca-313e-422e-a551-0b3aa3531237 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:01.331763 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c8926-b6d8-47de-87bf-118677fed6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:01.332595 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c8926-b6d8-47de-87bf-118677fed6a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:01.332763 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c8926-b6d8-47de-87bf-118677fed6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:01.333027 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c8926-b6d8-47de-87bf-118677fed6a9 admin admin] PATH_INFO: `/v3/projects/d0de856323314942b8ccdbbae1fc4765` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:01.342042 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372c8926-b6d8-47de-87bf-118677fed6a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0de856323314942b8ccdbbae1fc4765)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:01.344065 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372c8926-b6d8-47de-87bf-118677fed6a9 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:01.369698 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:01.447790 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-372c8926-b6d8-47de-87bf-118677fed6a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0de856323314942b8ccdbbae1fc4765', 'request_id': 'req-372c8926-b6d8-47de-87bf-118677fed6a9'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:01.459580 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-372c8926-b6d8-47de-87bf-118677fed6a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0de856323314942b8ccdbbae1fc4765', 'request_id': 'req-372c8926-b6d8-47de-87bf-118677fed6a9'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:01.474487 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-372c8926-b6d8-47de-87bf-118677fed6a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0de856323314942b8ccdbbae1fc4765', 'request_id': 'req-372c8926-b6d8-47de-87bf-118677fed6a9'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:01.494130 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-372c8926-b6d8-47de-87bf-118677fed6a9 admin admin] The token cache is being invalidate because project d0de856323314942b8ccdbbae1fc4765 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:29:01.494373 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-372c8926-b6d8-47de-87bf-118677fed6a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:01.495207 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-372c8926-b6d8-47de-87bf-118677fed6a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:01.501404 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1108/2235] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:29:01 2022] DELETE /identity/v3/projects/d0de856323314942b8ccdbbae1fc4765 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:29:01.503846 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361eb066-58e3-4ff7-9f81-27b38f2281cb None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:01.504344 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361eb066-58e3-4ff7-9f81-27b38f2281cb None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:01.504508 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361eb066-58e3-4ff7-9f81-27b38f2281cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:01.534878 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-361eb066-58e3-4ff7-9f81-27b38f2281cb None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:01.536141 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-361eb066-58e3-4ff7-9f81-27b38f2281cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:01.578481 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c8926-b6d8-47de-87bf-118677fed6a9 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:01.581296 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-372c8926-b6d8-47de-87bf-118677fed6a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:01.613155 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:01.690132 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1128/2236] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:29:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:29:01.704959 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45632f77-e083-487b-b8c7-686c2ad541c4 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:01.705591 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45632f77-e083-487b-b8c7-686c2ad541c4 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:01.706857 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45632f77-e083-487b-b8c7-686c2ad541c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:01.737597 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-45632f77-e083-487b-b8c7-686c2ad541c4 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:01.739410 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-45632f77-e083-487b-b8c7-686c2ad541c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:01.754773 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1129/2237] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:29:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:29:01.756503 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45632f77-e083-487b-b8c7-686c2ad541c4 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:01.762911 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-45632f77-e083-487b-b8c7-686c2ad541c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:01.764479 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c8926-b6d8-47de-87bf-118677fed6a9 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:01.800429 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e2c4fb-b965-4624-8661-f22c46e29b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:01.801319 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2c4fb-b965-4624-8661-f22c46e29b2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:01.801613 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2c4fb-b965-4624-8661-f22c46e29b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:01.801892 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2c4fb-b965-4624-8661-f22c46e29b2c admin admin] PATH_INFO: `/v3/users/817a2fbf56274267a68ccb5029cb9678` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:01.807533 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e2c4fb-b965-4624-8661-f22c46e29b2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=817a2fbf56274267a68ccb5029cb9678)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:01.815003 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e2c4fb-b965-4624-8661-f22c46e29b2c admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:01.823414 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45632f77-e083-487b-b8c7-686c2ad541c4 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:01.838058 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0863d0a-9b31-4eee-82dd-56c28136ecdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:01.840428 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0863d0a-9b31-4eee-82dd-56c28136ecdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:01.840942 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0863d0a-9b31-4eee-82dd-56c28136ecdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:01.841223 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0863d0a-9b31-4eee-82dd-56c28136ecdf admin admin] PATH_INFO: `/v3/projects/f5e934cb68ab44ec86fd65ebe68211a8` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:01.843384 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0863d0a-9b31-4eee-82dd-56c28136ecdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5e934cb68ab44ec86fd65ebe68211a8)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:01.846704 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0863d0a-9b31-4eee-82dd-56c28136ecdf admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:01.925696 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-39e2c4fb-b965-4624-8661-f22c46e29b2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '817a2fbf56274267a68ccb5029cb9678'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:01.933630 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-39e2c4fb-b965-4624-8661-f22c46e29b2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '817a2fbf56274267a68ccb5029cb9678'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:01.934637 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-39e2c4fb-b965-4624-8661-f22c46e29b2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '817a2fbf56274267a68ccb5029cb9678'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:01.936415 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b0863d0a-9b31-4eee-82dd-56c28136ecdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5e934cb68ab44ec86fd65ebe68211a8', 'request_id': 'req-b0863d0a-9b31-4eee-82dd-56c28136ecdf'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:01.943785 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b0863d0a-9b31-4eee-82dd-56c28136ecdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5e934cb68ab44ec86fd65ebe68211a8', 'request_id': 'req-b0863d0a-9b31-4eee-82dd-56c28136ecdf'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:01.947867 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-39e2c4fb-b965-4624-8661-f22c46e29b2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '817a2fbf56274267a68ccb5029cb9678'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:01.948868 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-39e2c4fb-b965-4624-8661-f22c46e29b2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '817a2fbf56274267a68ccb5029cb9678'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:01.950996 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b0863d0a-9b31-4eee-82dd-56c28136ecdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5e934cb68ab44ec86fd65ebe68211a8', 'request_id': 'req-b0863d0a-9b31-4eee-82dd-56c28136ecdf'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:01.978013 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1109/2238] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:29:01 2022] DELETE /identity/v3/users/817a2fbf56274267a68ccb5029cb9678 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:29:01.978939 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e2c4fb-b965-4624-8661-f22c46e29b2c admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:01.980206 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-39e2c4fb-b965-4624-8661-f22c46e29b2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:01.982296 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b0863d0a-9b31-4eee-82dd-56c28136ecdf admin admin] The token cache is being invalidate because project f5e934cb68ab44ec86fd65ebe68211a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:29:01.982758 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b0863d0a-9b31-4eee-82dd-56c28136ecdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:01.991477 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b0863d0a-9b31-4eee-82dd-56c28136ecdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:01.997832 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1130/2239] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:29:01 2022] DELETE /identity/v3/projects/f5e934cb68ab44ec86fd65ebe68211a8 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:29:01.998995 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903c439-e3cc-4f9a-b412-708819aceb5c None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:01.999247 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903c439-e3cc-4f9a-b412-708819aceb5c None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:01.999523 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903c439-e3cc-4f9a-b412-708819aceb5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:02.044572 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:02.049547 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-7903c439-e3cc-4f9a-b412-708819aceb5c None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:02.051166 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-7903c439-e3cc-4f9a-b412-708819aceb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:02.167202 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e2c4fb-b965-4624-8661-f22c46e29b2c admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:02.179708 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e168792-d4f9-421d-98b4-b4ae4a092be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:02.180763 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e168792-d4f9-421d-98b4-b4ae4a092be8 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:02.181045 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e168792-d4f9-421d-98b4-b4ae4a092be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:02.181329 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e168792-d4f9-421d-98b4-b4ae4a092be8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:02.182015 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e168792-d4f9-421d-98b4-b4ae4a092be8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:29:02.182320 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e168792-d4f9-421d-98b4-b4ae4a092be8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:02.183987 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e168792-d4f9-421d-98b4-b4ae4a092be8 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:02.219005 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1110/2240] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:29:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:02.219005 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e168792-d4f9-421d-98b4-b4ae4a092be8 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:02.222587 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-1e168792-d4f9-421d-98b4-b4ae4a092be8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:02.302249 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e168792-d4f9-421d-98b4-b4ae4a092be8 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:02.306255 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1131/2241] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:29:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:29:02.312542 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7903c439-e3cc-4f9a-b412-708819aceb5c None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:02.316732 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-7903c439-e3cc-4f9a-b412-708819aceb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:02.346755 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7903c439-e3cc-4f9a-b412-708819aceb5c None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:02.348368 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae6bbff-c573-4a92-8767-f4f165a31ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:02.348567 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6bbff-c573-4a92-8767-f4f165a31ebd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:02.348946 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6bbff-c573-4a92-8767-f4f165a31ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:02.349116 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6bbff-c573-4a92-8767-f4f165a31ebd admin admin] PATH_INFO: `/v3/users/c02b6bc762b44b86adb8e72b042a2e38` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:02.350928 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae6bbff-c573-4a92-8767-f4f165a31ebd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c02b6bc762b44b86adb8e72b042a2e38)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:02.355538 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae6bbff-c573-4a92-8767-f4f165a31ebd admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:02.359753 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e153b-3044-4bc3-b584-0cc44bab809e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:02.360493 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e153b-3044-4bc3-b584-0cc44bab809e admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:02.360845 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e153b-3044-4bc3-b584-0cc44bab809e admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:02.361119 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e153b-3044-4bc3-b584-0cc44bab809e admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:02.361864 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6e153b-3044-4bc3-b584-0cc44bab809e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:02.366956 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6e153b-3044-4bc3-b584-0cc44bab809e admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:02.436864 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1132/2242] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:29:02 2022] POST /identity/v3/projects => generated 377 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:29:02.438625 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e153b-3044-4bc3-b584-0cc44bab809e admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:02.441347 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-df6e153b-3044-4bc3-b584-0cc44bab809e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:02.494346 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-fae6bbff-c573-4a92-8767-f4f165a31ebd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c02b6bc762b44b86adb8e72b042a2e38'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:02.509842 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-fae6bbff-c573-4a92-8767-f4f165a31ebd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c02b6bc762b44b86adb8e72b042a2e38'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:02.512932 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-fae6bbff-c573-4a92-8767-f4f165a31ebd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c02b6bc762b44b86adb8e72b042a2e38'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:02.526652 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-fae6bbff-c573-4a92-8767-f4f165a31ebd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c02b6bc762b44b86adb8e72b042a2e38'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:02.527863 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-fae6bbff-c573-4a92-8767-f4f165a31ebd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c02b6bc762b44b86adb8e72b042a2e38'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:02.561607 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:02.567030 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1111/2243] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:29:02 2022] DELETE /identity/v3/users/c02b6bc762b44b86adb8e72b042a2e38 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:29:02.570348 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae6bbff-c573-4a92-8767-f4f165a31ebd admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:02.572705 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-fae6bbff-c573-4a92-8767-f4f165a31ebd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:02.592373 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e153b-3044-4bc3-b584-0cc44bab809e admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:02.657122 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba0bc40-cc15-4d53-a5f1-3713798faa84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:02.657875 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0bc40-cc15-4d53-a5f1-3713798faa84 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:02.658156 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0bc40-cc15-4d53-a5f1-3713798faa84 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:02.658512 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0bc40-cc15-4d53-a5f1-3713798faa84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:02.660690 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-eba0bc40-cc15-4d53-a5f1-3713798faa84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:02.737884 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae6bbff-c573-4a92-8767-f4f165a31ebd admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:02.743396 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320fcb7-6e90-41f1-b2d7-cae236539827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:02.744098 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320fcb7-6e90-41f1-b2d7-cae236539827 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:02.744616 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320fcb7-6e90-41f1-b2d7-cae236539827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:02.744898 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320fcb7-6e90-41f1-b2d7-cae236539827 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:02.745549 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1320fcb7-6e90-41f1-b2d7-cae236539827 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:02.748151 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1320fcb7-6e90-41f1-b2d7-cae236539827 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:02.776757 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba0bc40-cc15-4d53-a5f1-3713798faa84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:02.777978 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba0bc40-cc15-4d53-a5f1-3713798faa84 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:02.781964 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1112/2244] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:29:02 2022] POST /identity/v3/users => generated 289 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:29:02.786918 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320fcb7-6e90-41f1-b2d7-cae236539827 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:02.790060 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1133/2245] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:29:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:29:02.804947 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320fcb7-6e90-41f1-b2d7-cae236539827 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:02.811898 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc838fa8-98c7-4ce2-82e0-98ed9bc83aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:02.812815 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc838fa8-98c7-4ce2-82e0-98ed9bc83aff admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:02.813524 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc838fa8-98c7-4ce2-82e0-98ed9bc83aff admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:02.814940 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc838fa8-98c7-4ce2-82e0-98ed9bc83aff admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:02.815763 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc838fa8-98c7-4ce2-82e0-98ed9bc83aff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:02.818114 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc838fa8-98c7-4ce2-82e0-98ed9bc83aff admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:02.832292 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1113/2246] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:29:02.836522 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba0bc40-cc15-4d53-a5f1-3713798faa84 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:02.863536 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba0bc40-cc15-4d53-a5f1-3713798faa84 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:02.871170 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d031c5a3-a8c0-40a7-ba6d-ef9715cda5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:02.871170 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031c5a3-a8c0-40a7-ba6d-ef9715cda5cf admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:02.871170 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031c5a3-a8c0-40a7-ba6d-ef9715cda5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:02.871170 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031c5a3-a8c0-40a7-ba6d-ef9715cda5cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:02.871630 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d031c5a3-a8c0-40a7-ba6d-ef9715cda5cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:02.871630 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d031c5a3-a8c0-40a7-ba6d-ef9715cda5cf admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:02.895333 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1134/2247] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:29:02.896776 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc838fa8-98c7-4ce2-82e0-98ed9bc83aff admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:02.911147 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc838fa8-98c7-4ce2-82e0-98ed9bc83aff admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:02.918208 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3612184-8439-40c0-8782-28d310197b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:02.919476 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3612184-8439-40c0-8782-28d310197b67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:02.919957 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3612184-8439-40c0-8782-28d310197b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:02.920359 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3612184-8439-40c0-8782-28d310197b67 admin admin] PATH_INFO: `/v3/projects/e61bef10efc846148f727411ef87163d/users/b63b9634a8934b9bb40520251722a632/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:02.925651 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:02.950814 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3612184-8439-40c0-8782-28d310197b67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e61bef10efc846148f727411ef87163d, user_id=b63b9634a8934b9bb40520251722a632, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:02.953640 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3612184-8439-40c0-8782-28d310197b67 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:02.984499 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1114/2248] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:29:02 2022] PUT /identity/v3/projects/e61bef10efc846148f727411ef87163d/users/b63b9634a8934b9bb40520251722a632/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:29:02.992205 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e71b6a-764f-4cc0-bd78-a119ba32c222 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:02.992548 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e71b6a-764f-4cc0-bd78-a119ba32c222 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:02.992973 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e71b6a-764f-4cc0-bd78-a119ba32c222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:03.072711 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-b2e71b6a-764f-4cc0-bd78-a119ba32c222 None None] MFA Rules not processed for user `b63b9634a8934b9bb40520251722a632`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:03.074488 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b2e71b6a-764f-4cc0-bd78-a119ba32c222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:03.183460 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3612184-8439-40c0-8782-28d310197b67 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:03.185896 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f3612184-8439-40c0-8782-28d310197b67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:03.195159 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1135/2249] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:29:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:29:03.199448 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e71b6a-764f-4cc0-bd78-a119ba32c222 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:03.232810 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:03.280633 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3612184-8439-40c0-8782-28d310197b67 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:03.280779 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e71b6a-764f-4cc0-bd78-a119ba32c222 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:03.287098 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4ae56-c79c-47f3-866f-de72b9b9ca34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:03.287661 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a06664-fc9e-421d-a92a-66c4b76eed2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:03.288353 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4ae56-c79c-47f3-866f-de72b9b9ca34 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:03.288504 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a06664-fc9e-421d-a92a-66c4b76eed2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:03.288698 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4ae56-c79c-47f3-866f-de72b9b9ca34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:03.288805 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a06664-fc9e-421d-a92a-66c4b76eed2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:03.288976 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4ae56-c79c-47f3-866f-de72b9b9ca34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:03.289685 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a06664-fc9e-421d-a92a-66c4b76eed2f admin admin] PATH_INFO: `/v3/projects/87471f314ff545cab1136805a4f7d030` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:03.289856 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c4ae56-c79c-47f3-866f-de72b9b9ca34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:03.291629 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a06664-fc9e-421d-a92a-66c4b76eed2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=87471f314ff545cab1136805a4f7d030)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:03.291763 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c4ae56-c79c-47f3-866f-de72b9b9ca34 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:03.293875 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a06664-fc9e-421d-a92a-66c4b76eed2f admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:03.331981 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1136/2250] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:29:03 2022] POST /identity/v3/projects => generated 377 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:29:03.333453 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4ae56-c79c-47f3-866f-de72b9b9ca34 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:03.373294 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d9a06664-fc9e-421d-a92a-66c4b76eed2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87471f314ff545cab1136805a4f7d030', 'request_id': 'req-d9a06664-fc9e-421d-a92a-66c4b76eed2f'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:03.386215 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d9a06664-fc9e-421d-a92a-66c4b76eed2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87471f314ff545cab1136805a4f7d030', 'request_id': 'req-d9a06664-fc9e-421d-a92a-66c4b76eed2f'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:03.398610 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d9a06664-fc9e-421d-a92a-66c4b76eed2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87471f314ff545cab1136805a4f7d030', 'request_id': 'req-d9a06664-fc9e-421d-a92a-66c4b76eed2f'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:03.416535 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d9a06664-fc9e-421d-a92a-66c4b76eed2f admin admin] The token cache is being invalidate because project 87471f314ff545cab1136805a4f7d030 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:29:03.417370 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d9a06664-fc9e-421d-a92a-66c4b76eed2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:03.419707 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d9a06664-fc9e-421d-a92a-66c4b76eed2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:03.421929 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1115/2251] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:29:03 2022] DELETE /identity/v3/projects/87471f314ff545cab1136805a4f7d030 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:29:03.422968 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a06664-fc9e-421d-a92a-66c4b76eed2f admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:03.424527 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d9a06664-fc9e-421d-a92a-66c4b76eed2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:03.442444 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4ae56-c79c-47f3-866f-de72b9b9ca34 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:03.501985 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a06664-fc9e-421d-a92a-66c4b76eed2f admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:03.507056 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f866725-6866-4a37-9e2c-14999d86b263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:03.507694 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f866725-6866-4a37-9e2c-14999d86b263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:03.508019 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f866725-6866-4a37-9e2c-14999d86b263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:03.508292 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f866725-6866-4a37-9e2c-14999d86b263 admin admin] PATH_INFO: `/v3/projects/71257c838a024f1f96f83d4447f246ab` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:03.509427 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f866725-6866-4a37-9e2c-14999d86b263 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71257c838a024f1f96f83d4447f246ab)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:03.511322 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f866725-6866-4a37-9e2c-14999d86b263 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:03.511510 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1bfa80-a62a-45dd-8865-a568a39329c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:03.512125 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1bfa80-a62a-45dd-8865-a568a39329c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:03.512413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1bfa80-a62a-45dd-8865-a568a39329c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:03.512777 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1bfa80-a62a-45dd-8865-a568a39329c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:03.513417 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1bfa80-a62a-45dd-8865-a568a39329c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:03.515436 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1bfa80-a62a-45dd-8865-a568a39329c0 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:03.528343 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:03.539241 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1137/2252] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:29:03 2022] POST /identity/v3/users => generated 295 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:29:03.540584 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f2a13-a8fa-48fa-b5f5-e2a244b27b13 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:03.540871 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f2a13-a8fa-48fa-b5f5-e2a244b27b13 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:03.541142 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f2a13-a8fa-48fa-b5f5-e2a244b27b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:03.563172 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-ff5f2a13-a8fa-48fa-b5f5-e2a244b27b13 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:03.565131 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-ff5f2a13-a8fa-48fa-b5f5-e2a244b27b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:03.565370 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9f866725-6866-4a37-9e2c-14999d86b263 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71257c838a024f1f96f83d4447f246ab', 'request_id': 'req-9f866725-6866-4a37-9e2c-14999d86b263'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:03.572092 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9f866725-6866-4a37-9e2c-14999d86b263 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71257c838a024f1f96f83d4447f246ab', 'request_id': 'req-9f866725-6866-4a37-9e2c-14999d86b263'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:03.582100 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9f866725-6866-4a37-9e2c-14999d86b263 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71257c838a024f1f96f83d4447f246ab', 'request_id': 'req-9f866725-6866-4a37-9e2c-14999d86b263'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:03.595186 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9f866725-6866-4a37-9e2c-14999d86b263 admin admin] The token cache is being invalidate because project 71257c838a024f1f96f83d4447f246ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:29:03.595779 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9f866725-6866-4a37-9e2c-14999d86b263 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:03.596545 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9f866725-6866-4a37-9e2c-14999d86b263 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:03.598534 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1116/2253] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:29:03 2022] DELETE /identity/v3/projects/71257c838a024f1f96f83d4447f246ab => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:29:03.599330 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f866725-6866-4a37-9e2c-14999d86b263 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:03.600770 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-9f866725-6866-4a37-9e2c-14999d86b263 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:03.622005 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:03.649347 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1138/2254] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:29:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:29:03.658594 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc7772-bd06-41fd-b442-de78a3c8d2fd None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:03.658594 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc7772-bd06-41fd-b442-de78a3c8d2fd None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:03.659018 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc7772-bd06-41fd-b442-de78a3c8d2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:03.685541 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-1edc7772-bd06-41fd-b442-de78a3c8d2fd None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:03.686745 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-1edc7772-bd06-41fd-b442-de78a3c8d2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:03.695140 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f866725-6866-4a37-9e2c-14999d86b263 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:03.696588 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1139/2255] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:29:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:29:03.698445 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b727a8-71a3-43d8-98e6-0a4008f9c4dd None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:03.699069 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b727a8-71a3-43d8-98e6-0a4008f9c4dd None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:03.699791 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b727a8-71a3-43d8-98e6-0a4008f9c4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:03.700554 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48752224-7b2d-4ab1-a93b-b214bc383976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:03.701191 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48752224-7b2d-4ab1-a93b-b214bc383976 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:03.701577 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48752224-7b2d-4ab1-a93b-b214bc383976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:03.701892 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48752224-7b2d-4ab1-a93b-b214bc383976 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:03.702499 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48752224-7b2d-4ab1-a93b-b214bc383976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:03.704113 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48752224-7b2d-4ab1-a93b-b214bc383976 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:03.718565 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1117/2256] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:29:03.718565 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293e9de-ecff-46e3-a3c9-9421f88206c7 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:03.718565 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293e9de-ecff-46e3-a3c9-9421f88206c7 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:03.718565 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293e9de-ecff-46e3-a3c9-9421f88206c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:03.726388 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-a1b727a8-71a3-43d8-98e6-0a4008f9c4dd None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:03.727650 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a1b727a8-71a3-43d8-98e6-0a4008f9c4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:03.739907 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1140/2257] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:29:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:29:03.743174 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-5293e9de-ecff-46e3-a3c9-9421f88206c7 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:03.743759 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b727a8-71a3-43d8-98e6-0a4008f9c4dd None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:03.744431 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-5293e9de-ecff-46e3-a3c9-9421f88206c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:03.754169 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b727a8-71a3-43d8-98e6-0a4008f9c4dd None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:03.755084 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1118/2258] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:29:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:29:03.756310 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5293e9de-ecff-46e3-a3c9-9421f88206c7 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:03.762625 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58f454-4950-4abd-bdd4-fbb62bce9a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:03.763307 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58f454-4950-4abd-bdd4-fbb62bce9a6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:03.763586 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58f454-4950-4abd-bdd4-fbb62bce9a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:03.763850 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58f454-4950-4abd-bdd4-fbb62bce9a6c admin admin] PATH_INFO: `/v3/projects/c54f5e11508742308a8121d87e83950e/users/f65d1655bc364a329186bcb842a8e3e8/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:03.766609 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5293e9de-ecff-46e3-a3c9-9421f88206c7 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:03.775586 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a9bc9-7c2c-4266-9881-d0f52b85a1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:03.776274 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a9bc9-7c2c-4266-9881-d0f52b85a1ac admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:03.776668 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a9bc9-7c2c-4266-9881-d0f52b85a1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:03.776947 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a9bc9-7c2c-4266-9881-d0f52b85a1ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:03.777819 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687a9bc9-7c2c-4266-9881-d0f52b85a1ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:29:03.778576 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687a9bc9-7c2c-4266-9881-d0f52b85a1ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:03.780540 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687a9bc9-7c2c-4266-9881-d0f52b85a1ac admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:03.782453 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e58f454-4950-4abd-bdd4-fbb62bce9a6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c54f5e11508742308a8121d87e83950e, user_id=f65d1655bc364a329186bcb842a8e3e8, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:03.785319 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e58f454-4950-4abd-bdd4-fbb62bce9a6c admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:03.799650 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1119/2259] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:29:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:03.800982 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a9bc9-7c2c-4266-9881-d0f52b85a1ac admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:03.804993 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1141/2260] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:29:03 2022] PUT /identity/v3/projects/c54f5e11508742308a8121d87e83950e/users/f65d1655bc364a329186bcb842a8e3e8/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:29:03.805802 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58f454-4950-4abd-bdd4-fbb62bce9a6c admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:03.814204 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a9bc9-7c2c-4266-9881-d0f52b85a1ac admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:03.886462 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0936d16b-e0a2-4d91-ac94-fe741c173147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:03.887125 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936d16b-e0a2-4d91-ac94-fe741c173147 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:03.887458 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936d16b-e0a2-4d91-ac94-fe741c173147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:03.887768 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936d16b-e0a2-4d91-ac94-fe741c173147 admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:03.888376 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0936d16b-e0a2-4d91-ac94-fe741c173147 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:29:03.888731 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0936d16b-e0a2-4d91-ac94-fe741c173147 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:03.890336 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58f454-4950-4abd-bdd4-fbb62bce9a6c admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:03.890462 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0936d16b-e0a2-4d91-ac94-fe741c173147 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:03.895506 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e90f16-6b50-4476-a225-7a01cc59b488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:03.896141 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e90f16-6b50-4476-a225-7a01cc59b488 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:03.896410 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e90f16-6b50-4476-a225-7a01cc59b488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:03.896735 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e90f16-6b50-4476-a225-7a01cc59b488 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:03.897389 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e90f16-6b50-4476-a225-7a01cc59b488 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:03.899351 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e90f16-6b50-4476-a225-7a01cc59b488 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:03.903993 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1120/2261] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:29:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:03.909449 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0936d16b-e0a2-4d91-ac94-fe741c173147 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:03.921243 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0936d16b-e0a2-4d91-ac94-fe741c173147 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:03.928603 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5c944-59e3-44b2-91ee-ffd8cd924da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:03.929523 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5c944-59e3-44b2-91ee-ffd8cd924da3 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:03.929868 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5c944-59e3-44b2-91ee-ffd8cd924da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:03.930079 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5c944-59e3-44b2-91ee-ffd8cd924da3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:03.930739 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5c944-59e3-44b2-91ee-ffd8cd924da3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:03.932039 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1142/2262] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:29:03 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:29:03.932630 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5c944-59e3-44b2-91ee-ffd8cd924da3 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:03.933197 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e90f16-6b50-4476-a225-7a01cc59b488 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:03.945065 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1121/2263] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:29:03.945999 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5c944-59e3-44b2-91ee-ffd8cd924da3 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:03.952128 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:03.960292 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5c944-59e3-44b2-91ee-ffd8cd924da3 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:04.013654 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e90f16-6b50-4476-a225-7a01cc59b488 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:04.020475 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34982629-7834-4c3c-acba-2bcf6037c9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:04.021122 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34982629-7834-4c3c-acba-2bcf6037c9e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:04.021516 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34982629-7834-4c3c-acba-2bcf6037c9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:04.021728 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34982629-7834-4c3c-acba-2bcf6037c9e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:04.022908 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34982629-7834-4c3c-acba-2bcf6037c9e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:04.024916 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34982629-7834-4c3c-acba-2bcf6037c9e4 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:04.033001 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec2ca6-4ff2-4689-8436-d49ac20a0426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:04.033671 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec2ca6-4ff2-4689-8436-d49ac20a0426 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:04.033957 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec2ca6-4ff2-4689-8436-d49ac20a0426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:04.034231 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec2ca6-4ff2-4689-8436-d49ac20a0426 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:04.034898 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aec2ca6-4ff2-4689-8436-d49ac20a0426 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:04.037190 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aec2ca6-4ff2-4689-8436-d49ac20a0426 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:04.056671 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1143/2264] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:29:03 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:29:04.057869 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34982629-7834-4c3c-acba-2bcf6037c9e4 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:04.066059 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1122/2265] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:29:03 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:29:04.066059 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec2ca6-4ff2-4689-8436-d49ac20a0426 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:04.074489 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec2ca6-4ff2-4689-8436-d49ac20a0426 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:04.088916 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:04.152959 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34982629-7834-4c3c-acba-2bcf6037c9e4 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:04.154614 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90b5c0-d497-4412-ada7-67f87bcbcefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:04.155844 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90b5c0-d497-4412-ada7-67f87bcbcefa admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:04.156130 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90b5c0-d497-4412-ada7-67f87bcbcefa admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:04.156407 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90b5c0-d497-4412-ada7-67f87bcbcefa admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:04.157290 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d90b5c0-d497-4412-ada7-67f87bcbcefa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:04.159300 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d0d44-ed81-4692-9aff-c2ddc9ef52c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:04.159813 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d90b5c0-d497-4412-ada7-67f87bcbcefa admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:04.160570 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d0d44-ed81-4692-9aff-c2ddc9ef52c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:04.161092 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d0d44-ed81-4692-9aff-c2ddc9ef52c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:04.161589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d0d44-ed81-4692-9aff-c2ddc9ef52c9 admin admin] PATH_INFO: `/v3/projects/c54f5e11508742308a8121d87e83950e/users/f65d1655bc364a329186bcb842a8e3e8/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:04.163898 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5d0d44-ed81-4692-9aff-c2ddc9ef52c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c54f5e11508742308a8121d87e83950e, user_id=f65d1655bc364a329186bcb842a8e3e8, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:04.167354 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5d0d44-ed81-4692-9aff-c2ddc9ef52c9 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:04.182937 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1144/2266] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:29:04 2022] PUT /identity/v3/projects/c54f5e11508742308a8121d87e83950e/users/f65d1655bc364a329186bcb842a8e3e8/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:29:04.193193 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d0d44-ed81-4692-9aff-c2ddc9ef52c9 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:04.198277 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1123/2267] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:29:04 2022] POST /identity/v3/users => generated 293 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:29:04.199336 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90b5c0-d497-4412-ada7-67f87bcbcefa admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:04.205293 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-3d90b5c0-d497-4412-ada7-67f87bcbcefa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:04.219445 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90b5c0-d497-4412-ada7-67f87bcbcefa admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:04.303770 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d0d44-ed81-4692-9aff-c2ddc9ef52c9 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:04.306663 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef1ba4-4873-497a-a070-b83629bbdadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:04.307371 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef1ba4-4873-497a-a070-b83629bbdadf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:04.307698 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef1ba4-4873-497a-a070-b83629bbdadf admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:04.308183 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef1ba4-4873-497a-a070-b83629bbdadf admin admin] PATH_INFO: `/v3/users/7c3fc7a3138641858b00cc6eb23ce75a` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:04.309834 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d4374-304f-4448-b923-156fa4247acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:04.309993 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ef1ba4-4873-497a-a070-b83629bbdadf admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c3fc7a3138641858b00cc6eb23ce75a)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:04.310461 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d4374-304f-4448-b923-156fa4247acb admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:04.310744 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d4374-304f-4448-b923-156fa4247acb admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:04.311019 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d4374-304f-4448-b923-156fa4247acb admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:04.311682 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693d4374-304f-4448-b923-156fa4247acb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:04.312282 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ef1ba4-4873-497a-a070-b83629bbdadf admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:04.313316 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693d4374-304f-4448-b923-156fa4247acb admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:04.330325 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1145/2268] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:29:04.330325 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f6805-53aa-4dc2-8f8f-d7381010fd77 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:04.330325 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f6805-53aa-4dc2-8f8f-d7381010fd77 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:04.330325 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f6805-53aa-4dc2-8f8f-d7381010fd77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:04.344785 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=90,keystone:INSERT=6,keystone:DELETE=4 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:04.374552 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-583f6805-53aa-4dc2-8f8f-d7381010fd77 None None] MFA Rules not processed for user `f65d1655bc364a329186bcb842a8e3e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:04.375696 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-583f6805-53aa-4dc2-8f8f-d7381010fd77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:04.381824 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e1ef1ba4-4873-497a-a070-b83629bbdadf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c3fc7a3138641858b00cc6eb23ce75a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:04.390498 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e1ef1ba4-4873-497a-a070-b83629bbdadf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c3fc7a3138641858b00cc6eb23ce75a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:04.391489 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e1ef1ba4-4873-497a-a070-b83629bbdadf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c3fc7a3138641858b00cc6eb23ce75a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:04.400878 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e1ef1ba4-4873-497a-a070-b83629bbdadf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c3fc7a3138641858b00cc6eb23ce75a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:04.401550 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e1ef1ba4-4873-497a-a070-b83629bbdadf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c3fc7a3138641858b00cc6eb23ce75a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:04.426119 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1124/2269] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:29:04 2022] DELETE /identity/v3/users/7c3fc7a3138641858b00cc6eb23ce75a => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:29:04.427486 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef1ba4-4873-497a-a070-b83629bbdadf admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:04.429086 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-e1ef1ba4-4873-497a-a070-b83629bbdadf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:04.478912 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1146/2270] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:29:04 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:29:04.480545 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f6805-53aa-4dc2-8f8f-d7381010fd77 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:04.482074 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-583f6805-53aa-4dc2-8f8f-d7381010fd77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:04.502741 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f6805-53aa-4dc2-8f8f-d7381010fd77 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:04.524614 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef1ba4-4873-497a-a070-b83629bbdadf admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:04.530675 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ddaf1d-40be-4867-9bd8-90b18d45aba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:04.531312 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ddaf1d-40be-4867-9bd8-90b18d45aba4 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:04.531595 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ddaf1d-40be-4867-9bd8-90b18d45aba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:04.532079 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ddaf1d-40be-4867-9bd8-90b18d45aba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:04.533904 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ddaf1d-40be-4867-9bd8-90b18d45aba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:04.536389 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ddaf1d-40be-4867-9bd8-90b18d45aba4 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:04.544386 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:04.548875 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1125/2271] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:29:04.549772 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93425a3-de22-46a6-803a-5f322be4c477 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:04.550066 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93425a3-de22-46a6-803a-5f322be4c477 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:04.550350 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93425a3-de22-46a6-803a-5f322be4c477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:04.577516 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-b93425a3-de22-46a6-803a-5f322be4c477 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:04.579578 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b93425a3-de22-46a6-803a-5f322be4c477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:04.584731 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e037a-7a6e-4a56-9b6f-0e0d92d1d949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:04.585472 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e037a-7a6e-4a56-9b6f-0e0d92d1d949 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:04.586030 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e037a-7a6e-4a56-9b6f-0e0d92d1d949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:04.586431 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e037a-7a6e-4a56-9b6f-0e0d92d1d949 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:04.587129 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447e037a-7a6e-4a56-9b6f-0e0d92d1d949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:04.588824 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447e037a-7a6e-4a56-9b6f-0e0d92d1d949 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:04.592592 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1126/2272] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:29:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:29:04.593512 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93425a3-de22-46a6-803a-5f322be4c477 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:04.599848 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b93425a3-de22-46a6-803a-5f322be4c477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:04.614372 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1147/2273] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:29:04.615320 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e037a-7a6e-4a56-9b6f-0e0d92d1d949 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:04.630519 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e037a-7a6e-4a56-9b6f-0e0d92d1d949 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:04.639670 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f566b-6329-42d4-b5f9-ffd5d144391d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:04.640232 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f566b-6329-42d4-b5f9-ffd5d144391d admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:04.640595 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f566b-6329-42d4-b5f9-ffd5d144391d admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:04.640876 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f566b-6329-42d4-b5f9-ffd5d144391d admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:04.642141 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67f566b-6329-42d4-b5f9-ffd5d144391d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:04.643551 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67f566b-6329-42d4-b5f9-ffd5d144391d admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:04.663951 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1148/2274] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:29:04.665150 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f566b-6329-42d4-b5f9-ffd5d144391d admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:04.681076 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f566b-6329-42d4-b5f9-ffd5d144391d admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:04.687334 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd65dbf-1cfa-457d-bf52-6ca0f74ff504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:04.688076 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd65dbf-1cfa-457d-bf52-6ca0f74ff504 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:04.688358 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd65dbf-1cfa-457d-bf52-6ca0f74ff504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:04.688774 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd65dbf-1cfa-457d-bf52-6ca0f74ff504 admin admin] PATH_INFO: `/v3/projects/5d0730aea5f544e4940581050c08a3ee/users/890c0898812e4e12865a15f2253673ca/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:04.709534 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd65dbf-1cfa-457d-bf52-6ca0f74ff504 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d0730aea5f544e4940581050c08a3ee, user_id=890c0898812e4e12865a15f2253673ca, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:04.713135 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd65dbf-1cfa-457d-bf52-6ca0f74ff504 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:04.719200 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93425a3-de22-46a6-803a-5f322be4c477 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:04.724815 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f514e-7ca3-45bb-a2c7-b5b85c192f7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:04.725535 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f514e-7ca3-45bb-a2c7-b5b85c192f7e service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:04.725815 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f514e-7ca3-45bb-a2c7-b5b85c192f7e service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:04.726090 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f514e-7ca3-45bb-a2c7-b5b85c192f7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:04.731429 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1149/2275] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:29:04 2022] PUT /identity/v3/projects/5d0730aea5f544e4940581050c08a3ee/users/890c0898812e4e12865a15f2253673ca/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:29:04.732619 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd65dbf-1cfa-457d-bf52-6ca0f74ff504 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:04.737900 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ce8f514e-7ca3-45bb-a2c7-b5b85c192f7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:04.741575 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-0cd65dbf-1cfa-457d-bf52-6ca0f74ff504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:04.800429 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:04.820384 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f514e-7ca3-45bb-a2c7-b5b85c192f7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:04.822091 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f514e-7ca3-45bb-a2c7-b5b85c192f7e service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:04.832657 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1127/2276] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:29:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:29:04.833607 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f514e-7ca3-45bb-a2c7-b5b85c192f7e service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:04.846899 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f514e-7ca3-45bb-a2c7-b5b85c192f7e service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:04.860962 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd65dbf-1cfa-457d-bf52-6ca0f74ff504 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:04.865488 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a998e76f-4b0d-497e-a2f2-57ae0ba30446 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:04.866225 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998e76f-4b0d-497e-a2f2-57ae0ba30446 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:04.866622 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998e76f-4b0d-497e-a2f2-57ae0ba30446 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:04.866984 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998e76f-4b0d-497e-a2f2-57ae0ba30446 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:04.947696 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a998e76f-4b0d-497e-a2f2-57ae0ba30446 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:04.949358 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a998e76f-4b0d-497e-a2f2-57ae0ba30446 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:04.955858 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bee8d0-95a7-45f9-95d4-0dcff2287ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:04.957132 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bee8d0-95a7-45f9-95d4-0dcff2287ab6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:04.957418 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bee8d0-95a7-45f9-95d4-0dcff2287ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:04.957702 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bee8d0-95a7-45f9-95d4-0dcff2287ab6 admin admin] PATH_INFO: `/v3/projects/0388a96f235449a19d07c43443e6f3fe/users/d9d3c8d364c3460b86280682221cca46/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:04.966172 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1150/2277] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:29:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:29:04.967809 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44190276-d1ef-4690-ab73-7902dc720a16 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:04.968575 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44190276-d1ef-4690-ab73-7902dc720a16 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:04.968935 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44190276-d1ef-4690-ab73-7902dc720a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:04.977717 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bee8d0-95a7-45f9-95d4-0dcff2287ab6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0388a96f235449a19d07c43443e6f3fe, user_id=d9d3c8d364c3460b86280682221cca46, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:04.980872 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bee8d0-95a7-45f9-95d4-0dcff2287ab6 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:05.005472 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1128/2278] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:29:04 2022] PUT /identity/v3/projects/0388a96f235449a19d07c43443e6f3fe/users/d9d3c8d364c3460b86280682221cca46/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:29:05.007491 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ffa9e-3126-4a69-a4da-6fa226cdac10 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:05.008023 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ffa9e-3126-4a69-a4da-6fa226cdac10 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:05.008352 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ffa9e-3126-4a69-a4da-6fa226cdac10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:05.025967 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-44190276-d1ef-4690-ab73-7902dc720a16 None None] MFA Rules not processed for user `890c0898812e4e12865a15f2253673ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:05.028394 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-44190276-d1ef-4690-ab73-7902dc720a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:05.040541 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-7a7ffa9e-3126-4a69-a4da-6fa226cdac10 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:05.043145 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7a7ffa9e-3126-4a69-a4da-6fa226cdac10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:05.111883 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:05.147939 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1129/2279] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:29:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:29:05.159648 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1151/2280] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:29:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:29:05.164322 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ffa9e-3126-4a69-a4da-6fa226cdac10 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:05.174191 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44190276-d1ef-4690-ab73-7902dc720a16 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:05.175957 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-44190276-d1ef-4690-ab73-7902dc720a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:05.178616 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ffa9e-3126-4a69-a4da-6fa226cdac10 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:05.186654 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7b71de-25b2-4cbb-909f-24e46c673980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:05.187390 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b71de-25b2-4cbb-909f-24e46c673980 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:05.187948 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b71de-25b2-4cbb-909f-24e46c673980 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:05.188766 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b71de-25b2-4cbb-909f-24e46c673980 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:05.190596 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7b71de-25b2-4cbb-909f-24e46c673980 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:05.194049 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7b71de-25b2-4cbb-909f-24e46c673980 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:05.240990 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1130/2281] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:29:05 2022] POST /identity/v3/projects => generated 383 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:29:05.245457 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7b71de-25b2-4cbb-909f-24e46c673980 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:05.322356 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:05.338240 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44190276-d1ef-4690-ab73-7902dc720a16 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:05.358797 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7b71de-25b2-4cbb-909f-24e46c673980 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:05.368032 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bfd348-a151-4d74-949c-11279b281ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:05.368964 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bfd348-a151-4d74-949c-11279b281ff7 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:05.369322 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bfd348-a151-4d74-949c-11279b281ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:05.369716 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bfd348-a151-4d74-949c-11279b281ff7 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:05.380230 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bfd348-a151-4d74-949c-11279b281ff7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:05.383106 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bfd348-a151-4d74-949c-11279b281ff7 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:05.433950 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1131/2282] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:29:05 2022] POST /identity/v3/users => generated 298 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:29:05.437849 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bfd348-a151-4d74-949c-11279b281ff7 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:05.466698 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bfd348-a151-4d74-949c-11279b281ff7 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:05.475178 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b00583-2b89-4623-b638-d01c005da806 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:05.480252 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b00583-2b89-4623-b638-d01c005da806 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:05.481253 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b00583-2b89-4623-b638-d01c005da806 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:05.481779 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b00583-2b89-4623-b638-d01c005da806 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:05.484183 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c41e0c-76eb-49a4-98c4-aa8d718b31c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:05.486068 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c41e0c-76eb-49a4-98c4-aa8d718b31c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:05.487812 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c41e0c-76eb-49a4-98c4-aa8d718b31c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:05.488324 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c41e0c-76eb-49a4-98c4-aa8d718b31c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:05.490701 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c41e0c-76eb-49a4-98c4-aa8d718b31c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:05.493485 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c41e0c-76eb-49a4-98c4-aa8d718b31c9 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:05.505293 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b00583-2b89-4623-b638-d01c005da806 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:05.507981 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b00583-2b89-4623-b638-d01c005da806 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:05.511303 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1132/2283] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:29:05.522216 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1152/2284] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:29:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:29:05.534378 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c41e0c-76eb-49a4-98c4-aa8d718b31c9 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:05.565699 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c41e0c-76eb-49a4-98c4-aa8d718b31c9 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:05.584066 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae91da-3a07-4a9c-b88e-5ee0ee3c0068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:05.584806 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae91da-3a07-4a9c-b88e-5ee0ee3c0068 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:05.585091 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae91da-3a07-4a9c-b88e-5ee0ee3c0068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:05.585368 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae91da-3a07-4a9c-b88e-5ee0ee3c0068 admin admin] PATH_INFO: `/v3/projects/4971e3143dfc44cd8cbda8c6067b0a28/users/101bd481685d4ecd9e588bd049f511ae/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:05.636008 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b00583-2b89-4623-b638-d01c005da806 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:05.638401 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-30b00583-2b89-4623-b638-d01c005da806 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:05.639684 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ae91da-3a07-4a9c-b88e-5ee0ee3c0068 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4971e3143dfc44cd8cbda8c6067b0a28, user_id=101bd481685d4ecd9e588bd049f511ae, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:05.642742 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ae91da-3a07-4a9c-b88e-5ee0ee3c0068 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:05.662684 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1133/2285] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:29:05 2022] PUT /identity/v3/projects/4971e3143dfc44cd8cbda8c6067b0a28/users/101bd481685d4ecd9e588bd049f511ae/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:29:05.666222 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b00583-2b89-4623-b638-d01c005da806 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:05.668253 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae91da-3a07-4a9c-b88e-5ee0ee3c0068 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:05.747643 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b285f-d7b3-4c29-8aee-7557237c6520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:05.748432 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b285f-d7b3-4c29-8aee-7557237c6520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:05.750095 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b285f-d7b3-4c29-8aee-7557237c6520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:05.750398 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b285f-d7b3-4c29-8aee-7557237c6520 admin admin] PATH_INFO: `/v3/projects/a5b5ca43a4cb4166be2f8f9f5ec9c1c5` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:05.753146 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b285f-d7b3-4c29-8aee-7557237c6520 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5b5ca43a4cb4166be2f8f9f5ec9c1c5)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:05.755178 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b285f-d7b3-4c29-8aee-7557237c6520 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:05.768742 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae91da-3a07-4a9c-b88e-5ee0ee3c0068 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:05.774860 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d91b47-763a-4cc3-a5a5-5a0879164503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:05.775643 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d91b47-763a-4cc3-a5a5-5a0879164503 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:05.776044 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d91b47-763a-4cc3-a5a5-5a0879164503 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:05.776381 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d91b47-763a-4cc3-a5a5-5a0879164503 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:05.777197 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d91b47-763a-4cc3-a5a5-5a0879164503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:05.778990 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d91b47-763a-4cc3-a5a5-5a0879164503 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:05.795935 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1134/2286] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:29:05.801927 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d91b47-763a-4cc3-a5a5-5a0879164503 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:05.812172 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:05.821083 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d91b47-763a-4cc3-a5a5-5a0879164503 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:05.836627 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-0a2b285f-d7b3-4c29-8aee-7557237c6520 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5b5ca43a4cb4166be2f8f9f5ec9c1c5', 'request_id': 'req-0a2b285f-d7b3-4c29-8aee-7557237c6520'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:05.849719 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-0a2b285f-d7b3-4c29-8aee-7557237c6520 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5b5ca43a4cb4166be2f8f9f5ec9c1c5', 'request_id': 'req-0a2b285f-d7b3-4c29-8aee-7557237c6520'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:05.858727 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-0a2b285f-d7b3-4c29-8aee-7557237c6520 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5b5ca43a4cb4166be2f8f9f5ec9c1c5', 'request_id': 'req-0a2b285f-d7b3-4c29-8aee-7557237c6520'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:05.882627 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-0a2b285f-d7b3-4c29-8aee-7557237c6520 admin admin] The token cache is being invalidate because project a5b5ca43a4cb4166be2f8f9f5ec9c1c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:29:05.883412 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-0a2b285f-d7b3-4c29-8aee-7557237c6520 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:05.884194 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-0a2b285f-d7b3-4c29-8aee-7557237c6520 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:05.886736 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1153/2287] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:29:05 2022] DELETE /identity/v3/projects/a5b5ca43a4cb4166be2f8f9f5ec9c1c5 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:29:05.899481 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927cc26-5e36-422c-8fdf-fe52684bd9c4 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:05.899776 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927cc26-5e36-422c-8fdf-fe52684bd9c4 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:05.900057 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927cc26-5e36-422c-8fdf-fe52684bd9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:05.917966 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3934038d-953c-46dd-8439-088c60f51e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:05.920142 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934038d-953c-46dd-8439-088c60f51e40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:05.921304 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934038d-953c-46dd-8439-088c60f51e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:05.921778 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934038d-953c-46dd-8439-088c60f51e40 admin admin] PATH_INFO: `/v3/projects/4971e3143dfc44cd8cbda8c6067b0a28/users/101bd481685d4ecd9e588bd049f511ae/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:05.923618 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-e927cc26-5e36-422c-8fdf-fe52684bd9c4 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:05.925222 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e927cc26-5e36-422c-8fdf-fe52684bd9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:05.926415 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3934038d-953c-46dd-8439-088c60f51e40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4971e3143dfc44cd8cbda8c6067b0a28, user_id=101bd481685d4ecd9e588bd049f511ae, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:05.930044 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3934038d-953c-46dd-8439-088c60f51e40 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:05.936035 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1154/2288] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:29:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:29:05.947424 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c11cd5-cd20-4698-b5b7-018b01ab5d5d None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:05.948201 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c11cd5-cd20-4698-b5b7-018b01ab5d5d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:05.948659 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c11cd5-cd20-4698-b5b7-018b01ab5d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:05.960230 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1135/2289] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:29:05 2022] PUT /identity/v3/projects/4971e3143dfc44cd8cbda8c6067b0a28/users/101bd481685d4ecd9e588bd049f511ae/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:29:05.961938 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24718733-ba7c-46c6-9e60-e9fbc7ff341e None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:05.962333 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24718733-ba7c-46c6-9e60-e9fbc7ff341e None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:05.962637 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24718733-ba7c-46c6-9e60-e9fbc7ff341e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:05.977929 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-e0c11cd5-cd20-4698-b5b7-018b01ab5d5d None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:05.979545 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e0c11cd5-cd20-4698-b5b7-018b01ab5d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:05.999827 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-24718733-ba7c-46c6-9e60-e9fbc7ff341e None None] MFA Rules not processed for user `101bd481685d4ecd9e588bd049f511ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:06.001080 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-24718733-ba7c-46c6-9e60-e9fbc7ff341e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:06.027270 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:06.076203 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1155/2290] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:29:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:29:06.082155 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c11cd5-cd20-4698-b5b7-018b01ab5d5d None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:06.093755 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c11cd5-cd20-4698-b5b7-018b01ab5d5d None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:06.104111 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a365a1-e550-4c94-8e0d-477aaa1a8cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:06.105586 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a365a1-e550-4c94-8e0d-477aaa1a8cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:06.106013 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a365a1-e550-4c94-8e0d-477aaa1a8cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:06.106388 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a365a1-e550-4c94-8e0d-477aaa1a8cd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:06.107463 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a365a1-e550-4c94-8e0d-477aaa1a8cd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:29:06.108019 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a365a1-e550-4c94-8e0d-477aaa1a8cd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:06.110002 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a365a1-e550-4c94-8e0d-477aaa1a8cd2 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:06.114283 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1136/2291] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:29:05 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:29:06.124331 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24718733-ba7c-46c6-9e60-e9fbc7ff341e None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:06.127956 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-24718733-ba7c-46c6-9e60-e9fbc7ff341e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:06.145314 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1156/2292] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:29:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:06.146929 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a365a1-e550-4c94-8e0d-477aaa1a8cd2 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:06.162290 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a365a1-e550-4c94-8e0d-477aaa1a8cd2 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:06.170211 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e7bcfa-b492-4120-8f2f-63cd52e1c545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:06.170899 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7bcfa-b492-4120-8f2f-63cd52e1c545 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:06.171229 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7bcfa-b492-4120-8f2f-63cd52e1c545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:06.171511 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7bcfa-b492-4120-8f2f-63cd52e1c545 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:06.172612 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e7bcfa-b492-4120-8f2f-63cd52e1c545 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:06.175480 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e7bcfa-b492-4120-8f2f-63cd52e1c545 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:06.216067 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24718733-ba7c-46c6-9e60-e9fbc7ff341e None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:06.221231 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1157/2293] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:29:06 2022] POST /identity/v3/projects => generated 371 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:29:06.224481 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9eab69-2efc-477c-9142-fc11faa93c8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:06.225125 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9eab69-2efc-477c-9142-fc11faa93c8b service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:06.225410 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9eab69-2efc-477c-9142-fc11faa93c8b service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:06.225514 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e7bcfa-b492-4120-8f2f-63cd52e1c545 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:06.225687 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9eab69-2efc-477c-9142-fc11faa93c8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:06.228393 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-6b9eab69-2efc-477c-9142-fc11faa93c8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:06.316271 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9eab69-2efc-477c-9142-fc11faa93c8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:06.320136 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9eab69-2efc-477c-9142-fc11faa93c8b service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:06.346019 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1137/2294] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:29:06 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:29:06.357206 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e7bcfa-b492-4120-8f2f-63cd52e1c545 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:06.367369 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6ee216-c08d-425c-af1c-ff9857be81d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:06.367606 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ee216-c08d-425c-af1c-ff9857be81d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:06.367938 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ee216-c08d-425c-af1c-ff9857be81d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:06.368206 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ee216-c08d-425c-af1c-ff9857be81d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:06.369065 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6ee216-c08d-425c-af1c-ff9857be81d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:06.371744 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6ee216-c08d-425c-af1c-ff9857be81d9 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:06.409993 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1158/2295] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:29:06 2022] POST /identity/v3/users => generated 286 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:29:06.414566 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9eab69-2efc-477c-9142-fc11faa93c8b service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:06.431355 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9eab69-2efc-477c-9142-fc11faa93c8b service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:06.445128 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e56b0c-7776-4759-b2e7-8e077772f5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:06.447704 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e56b0c-7776-4759-b2e7-8e077772f5ef admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:06.448958 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e56b0c-7776-4759-b2e7-8e077772f5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:06.449514 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e56b0c-7776-4759-b2e7-8e077772f5ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:06.450821 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e56b0c-7776-4759-b2e7-8e077772f5ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:06.456352 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e56b0c-7776-4759-b2e7-8e077772f5ef admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:06.475171 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1138/2296] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:29:06.485275 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6ee216-c08d-425c-af1c-ff9857be81d9 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:06.509971 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6ee216-c08d-425c-af1c-ff9857be81d9 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:06.517462 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2684721a-013d-44dd-8cc6-ca5a87a5513f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:06.518281 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684721a-013d-44dd-8cc6-ca5a87a5513f admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:06.518597 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684721a-013d-44dd-8cc6-ca5a87a5513f admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:06.518921 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684721a-013d-44dd-8cc6-ca5a87a5513f admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:06.519642 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2684721a-013d-44dd-8cc6-ca5a87a5513f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:06.521537 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2684721a-013d-44dd-8cc6-ca5a87a5513f admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:06.528323 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:06.535328 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1159/2297] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:29:06.539932 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e56b0c-7776-4759-b2e7-8e077772f5ef admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:06.569349 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e56b0c-7776-4759-b2e7-8e077772f5ef admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:06.582713 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f69fd-48bb-4631-8e89-cae85b34a8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:06.583719 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f69fd-48bb-4631-8e89-cae85b34a8df admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:06.583922 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f69fd-48bb-4631-8e89-cae85b34a8df admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:06.584918 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f69fd-48bb-4631-8e89-cae85b34a8df admin admin] PATH_INFO: `/v3/projects/3632f9f9c83940ee861ef8a245c73872/users/a54596c94fd04ea2b4ec217166292973/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:06.617395 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806f69fd-48bb-4631-8e89-cae85b34a8df admin admin] RBAC: Authorizing `identity:create_grant(project_id=3632f9f9c83940ee861ef8a245c73872, user_id=a54596c94fd04ea2b4ec217166292973, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:06.622531 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806f69fd-48bb-4631-8e89-cae85b34a8df admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:06.652502 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1139/2298] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:29:06 2022] PUT /identity/v3/projects/3632f9f9c83940ee861ef8a245c73872/users/a54596c94fd04ea2b4ec217166292973/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:29:06.652712 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4593113-cea7-453d-8ef6-ba7cf2acb524 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:06.652712 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4593113-cea7-453d-8ef6-ba7cf2acb524 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:06.652712 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4593113-cea7-453d-8ef6-ba7cf2acb524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:06.694920 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-b4593113-cea7-453d-8ef6-ba7cf2acb524 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:06.697882 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b4593113-cea7-453d-8ef6-ba7cf2acb524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:06.877238 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1160/2299] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:29:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:29:06.937107 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f69fd-48bb-4631-8e89-cae85b34a8df admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:06.939555 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-806f69fd-48bb-4631-8e89-cae85b34a8df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:07.078452 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:07.140040 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f69fd-48bb-4631-8e89-cae85b34a8df admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:07.151197 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec485f3-85c3-4a59-9161-61ed35af4db8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:07.152483 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec485f3-85c3-4a59-9161-61ed35af4db8 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:07.153105 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec485f3-85c3-4a59-9161-61ed35af4db8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:07.153613 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec485f3-85c3-4a59-9161-61ed35af4db8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:07.199062 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec485f3-85c3-4a59-9161-61ed35af4db8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:07.204700 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec485f3-85c3-4a59-9161-61ed35af4db8 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:07.225813 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1140/2300] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:29:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:29:08.175706 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4593113-cea7-453d-8ef6-ba7cf2acb524 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:08.177429 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b4593113-cea7-453d-8ef6-ba7cf2acb524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:08.310086 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4593113-cea7-453d-8ef6-ba7cf2acb524 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:08.317432 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f034e215-a474-4e65-a427-e0703658a2ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:08.319494 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f034e215-a474-4e65-a427-e0703658a2ae service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:08.319784 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f034e215-a474-4e65-a427-e0703658a2ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:08.321080 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f034e215-a474-4e65-a427-e0703658a2ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:08.325216 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f034e215-a474-4e65-a427-e0703658a2ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:08.505285 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f034e215-a474-4e65-a427-e0703658a2ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:08.507855 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f034e215-a474-4e65-a427-e0703658a2ae service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:08.537445 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1161/2301] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:29:08 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:29:11.559920 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec485f3-85c3-4a59-9161-61ed35af4db8 service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:11.561475 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-2ec485f3-85c3-4a59-9161-61ed35af4db8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:11.594886 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec485f3-85c3-4a59-9161-61ed35af4db8 service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:11.612697 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4ec78-fe1e-482a-890e-6d5bbcbc4358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:11.615205 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4ec78-fe1e-482a-890e-6d5bbcbc4358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:11.616219 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4ec78-fe1e-482a-890e-6d5bbcbc4358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:11.616785 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4ec78-fe1e-482a-890e-6d5bbcbc4358 admin admin] PATH_INFO: `/v3/users/193d28d2ebbb4c5ca9d4b645d392f327` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:11.618591 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed4ec78-fe1e-482a-890e-6d5bbcbc4358 admin admin] RBAC: Authorizing `identity:delete_user(user_id=193d28d2ebbb4c5ca9d4b645d392f327)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:11.621625 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed4ec78-fe1e-482a-890e-6d5bbcbc4358 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:11.693854 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5ed4ec78-fe1e-482a-890e-6d5bbcbc4358 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '193d28d2ebbb4c5ca9d4b645d392f327'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:11.707503 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5ed4ec78-fe1e-482a-890e-6d5bbcbc4358 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '193d28d2ebbb4c5ca9d4b645d392f327'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:11.710927 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5ed4ec78-fe1e-482a-890e-6d5bbcbc4358 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '193d28d2ebbb4c5ca9d4b645d392f327'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:11.727832 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5ed4ec78-fe1e-482a-890e-6d5bbcbc4358 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '193d28d2ebbb4c5ca9d4b645d392f327'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:11.728804 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5ed4ec78-fe1e-482a-890e-6d5bbcbc4358 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '193d28d2ebbb4c5ca9d4b645d392f327'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:11.757104 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1141/2302] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:29:11 2022] DELETE /identity/v3/users/193d28d2ebbb4c5ca9d4b645d392f327 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:29:11.757581 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d51e74-c94f-422f-8d84-509d0102f299 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:11.758549 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d51e74-c94f-422f-8d84-509d0102f299 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:11.758824 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d51e74-c94f-422f-8d84-509d0102f299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:11.783883 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-a9d51e74-c94f-422f-8d84-509d0102f299 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:11.785595 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a9d51e74-c94f-422f-8d84-509d0102f299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:11.864473 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:11.878812 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1162/2303] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:29:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:29:11.949263 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4ec78-fe1e-482a-890e-6d5bbcbc4358 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:11.950941 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-5ed4ec78-fe1e-482a-890e-6d5bbcbc4358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:12.159967 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4ec78-fe1e-482a-890e-6d5bbcbc4358 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:12.172646 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab7cf2-65de-4528-8571-8a615ceaceee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:12.174319 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab7cf2-65de-4528-8571-8a615ceaceee service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:12.176211 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab7cf2-65de-4528-8571-8a615ceaceee service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:12.176753 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab7cf2-65de-4528-8571-8a615ceaceee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:12.223701 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dab7cf2-65de-4528-8571-8a615ceaceee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:12.247378 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dab7cf2-65de-4528-8571-8a615ceaceee service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:12.264492 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d51e74-c94f-422f-8d84-509d0102f299 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:12.266299 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a9d51e74-c94f-422f-8d84-509d0102f299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:12.270450 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1142/2304] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:29:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:29:12.421896 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d51e74-c94f-422f-8d84-509d0102f299 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:12.428887 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f3fea-e8e4-4929-b44f-9b2c1e8c97e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:12.429915 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f3fea-e8e4-4929-b44f-9b2c1e8c97e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:12.430198 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f3fea-e8e4-4929-b44f-9b2c1e8c97e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:12.431071 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f3fea-e8e4-4929-b44f-9b2c1e8c97e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:12.434050 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a43f3fea-e8e4-4929-b44f-9b2c1e8c97e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:12.547652 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43f3fea-e8e4-4929-b44f-9b2c1e8c97e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:12.550482 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43f3fea-e8e4-4929-b44f-9b2c1e8c97e1 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:12.567379 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1163/2305] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:29:12 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:29:13.315427 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab7cf2-65de-4528-8571-8a615ceaceee service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:13.318079 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-9dab7cf2-65de-4528-8571-8a615ceaceee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:13.380118 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab7cf2-65de-4528-8571-8a615ceaceee service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:13.406431 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498068e3-f946-447d-96ce-849fa16fe649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:13.408206 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498068e3-f946-447d-96ce-849fa16fe649 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:13.409873 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498068e3-f946-447d-96ce-849fa16fe649 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:13.411132 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498068e3-f946-447d-96ce-849fa16fe649 admin admin] PATH_INFO: `/v3/projects/b2d0abcfad774fc58544a1b408f0cc9d` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:13.415284 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498068e3-f946-447d-96ce-849fa16fe649 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2d0abcfad774fc58544a1b408f0cc9d)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:13.421298 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498068e3-f946-447d-96ce-849fa16fe649 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:13.508384 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:13.513236 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-498068e3-f946-447d-96ce-849fa16fe649 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2d0abcfad774fc58544a1b408f0cc9d', 'request_id': 'req-498068e3-f946-447d-96ce-849fa16fe649'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:13.526229 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-498068e3-f946-447d-96ce-849fa16fe649 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2d0abcfad774fc58544a1b408f0cc9d', 'request_id': 'req-498068e3-f946-447d-96ce-849fa16fe649'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:13.541203 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-498068e3-f946-447d-96ce-849fa16fe649 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2d0abcfad774fc58544a1b408f0cc9d', 'request_id': 'req-498068e3-f946-447d-96ce-849fa16fe649'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:13.577067 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-498068e3-f946-447d-96ce-849fa16fe649 admin admin] The token cache is being invalidate because project b2d0abcfad774fc58544a1b408f0cc9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:29:13.577575 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-498068e3-f946-447d-96ce-849fa16fe649 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:13.578630 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-498068e3-f946-447d-96ce-849fa16fe649 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:13.586202 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1143/2306] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:29:13 2022] DELETE /identity/v3/projects/b2d0abcfad774fc58544a1b408f0cc9d => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:29:13.587013 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164eb6fb-b47e-4880-9fe8-a310e185c283 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:13.587489 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164eb6fb-b47e-4880-9fe8-a310e185c283 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:13.587578 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164eb6fb-b47e-4880-9fe8-a310e185c283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:13.633069 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-164eb6fb-b47e-4880-9fe8-a310e185c283 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:13.633355 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-164eb6fb-b47e-4880-9fe8-a310e185c283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:13.744256 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1164/2307] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:29:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:29:13.752528 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125702ec-29c8-4590-baf0-17342f98bf06 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:13.753068 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125702ec-29c8-4590-baf0-17342f98bf06 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:13.753363 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125702ec-29c8-4590-baf0-17342f98bf06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:13.788570 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-125702ec-29c8-4590-baf0-17342f98bf06 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:13.790437 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-125702ec-29c8-4590-baf0-17342f98bf06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:13.806109 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1144/2308] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:29:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:29:13.811966 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164eb6fb-b47e-4880-9fe8-a310e185c283 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:13.828660 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164eb6fb-b47e-4880-9fe8-a310e185c283 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:13.839943 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053daea8-3a9a-4946-b439-965b0581f25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:13.840627 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053daea8-3a9a-4946-b439-965b0581f25d admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:13.840910 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053daea8-3a9a-4946-b439-965b0581f25d admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:13.841189 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053daea8-3a9a-4946-b439-965b0581f25d admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:13.841874 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053daea8-3a9a-4946-b439-965b0581f25d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:29:13.842187 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053daea8-3a9a-4946-b439-965b0581f25d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:13.844074 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053daea8-3a9a-4946-b439-965b0581f25d admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:13.878379 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1165/2309] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:29:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:13.880240 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125702ec-29c8-4590-baf0-17342f98bf06 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:13.896977 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125702ec-29c8-4590-baf0-17342f98bf06 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:13.921646 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170d17f-da01-4a21-a789-d6f8ceebb263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:13.923064 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170d17f-da01-4a21-a789-d6f8ceebb263 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:13.923468 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170d17f-da01-4a21-a789-d6f8ceebb263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:13.923892 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170d17f-da01-4a21-a789-d6f8ceebb263 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:13.925145 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3170d17f-da01-4a21-a789-d6f8ceebb263 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:13.927499 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3170d17f-da01-4a21-a789-d6f8ceebb263 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:13.989784 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1145/2310] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:29:13 2022] POST /identity/v3/projects => generated 363 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:29:13.994822 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053daea8-3a9a-4946-b439-965b0581f25d admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:14.013403 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053daea8-3a9a-4946-b439-965b0581f25d admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:14.083110 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:14.146672 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b833bb87-aa36-4fcd-a825-b90f0ee4ebfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:14.147331 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833bb87-aa36-4fcd-a825-b90f0ee4ebfe admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:14.147699 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833bb87-aa36-4fcd-a825-b90f0ee4ebfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:14.147979 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833bb87-aa36-4fcd-a825-b90f0ee4ebfe admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:14.149264 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b833bb87-aa36-4fcd-a825-b90f0ee4ebfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:14.151554 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b833bb87-aa36-4fcd-a825-b90f0ee4ebfe admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:14.185464 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1166/2311] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:29:13 2022] POST /identity/v3/users => generated 282 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:29:14.189544 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170d17f-da01-4a21-a789-d6f8ceebb263 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:14.204734 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170d17f-da01-4a21-a789-d6f8ceebb263 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:14.212232 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a3668-e01e-45db-a827-ad52c101abe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:14.213328 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a3668-e01e-45db-a827-ad52c101abe7 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:14.213890 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a3668-e01e-45db-a827-ad52c101abe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:14.215133 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a3668-e01e-45db-a827-ad52c101abe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:14.217001 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1a3668-e01e-45db-a827-ad52c101abe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:14.220647 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1a3668-e01e-45db-a827-ad52c101abe7 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:14.254193 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1146/2312] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:29:14.258798 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b833bb87-aa36-4fcd-a825-b90f0ee4ebfe admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:14.282672 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b833bb87-aa36-4fcd-a825-b90f0ee4ebfe admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:14.298563 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305cb453-7fc8-4a9a-99de-7a2cf02554cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:14.299616 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305cb453-7fc8-4a9a-99de-7a2cf02554cd admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:14.300299 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305cb453-7fc8-4a9a-99de-7a2cf02554cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:14.300299 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305cb453-7fc8-4a9a-99de-7a2cf02554cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:14.301154 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305cb453-7fc8-4a9a-99de-7a2cf02554cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:14.303226 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305cb453-7fc8-4a9a-99de-7a2cf02554cd admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:14.319155 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1167/2313] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:29:14.323187 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a3668-e01e-45db-a827-ad52c101abe7 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:14.340848 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a3668-e01e-45db-a827-ad52c101abe7 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:14.349071 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77306fa-380d-418a-b9ef-92419bd65a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:14.350134 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77306fa-380d-418a-b9ef-92419bd65a61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:14.350578 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77306fa-380d-418a-b9ef-92419bd65a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:14.351207 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77306fa-380d-418a-b9ef-92419bd65a61 admin admin] PATH_INFO: `/v3/projects/13b71a937bd04483a98e65e64842e637/users/220ece8913d34908a366817babcb4d93/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:14.386133 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77306fa-380d-418a-b9ef-92419bd65a61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13b71a937bd04483a98e65e64842e637, user_id=220ece8913d34908a366817babcb4d93, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:14.390378 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77306fa-380d-418a-b9ef-92419bd65a61 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:14.416513 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1147/2314] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:29:14 2022] PUT /identity/v3/projects/13b71a937bd04483a98e65e64842e637/users/220ece8913d34908a366817babcb4d93/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:29:14.430627 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3434ac-a176-4279-a24a-402748f49ff5 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:14.430948 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3434ac-a176-4279-a24a-402748f49ff5 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:14.431281 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3434ac-a176-4279-a24a-402748f49ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:14.485115 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-de3434ac-a176-4279-a24a-402748f49ff5 None None] MFA Rules not processed for user `220ece8913d34908a366817babcb4d93`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:14.488297 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-de3434ac-a176-4279-a24a-402748f49ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:14.722226 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1168/2315] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:29:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:29:14.735106 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77306fa-380d-418a-b9ef-92419bd65a61 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:14.737906 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b77306fa-380d-418a-b9ef-92419bd65a61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:14.861086 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77306fa-380d-418a-b9ef-92419bd65a61 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:14.877876 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8326a0-43c4-483f-a3b6-745b81f3e0ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:14.878912 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8326a0-43c4-483f-a3b6-745b81f3e0ac service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:14.879204 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8326a0-43c4-483f-a3b6-745b81f3e0ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:14.879496 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8326a0-43c4-483f-a3b6-745b81f3e0ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:14.906815 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8326a0-43c4-483f-a3b6-745b81f3e0ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:14.909639 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8326a0-43c4-483f-a3b6-745b81f3e0ac service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:14.935945 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1148/2316] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:29:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:29:16.241625 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7fd5b-641a-48e4-b729-f8198a31f079 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:16.242799 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7fd5b-641a-48e4-b729-f8198a31f079 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:16.243478 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7fd5b-641a-48e4-b729-f8198a31f079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:16.312749 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-bef7fd5b-641a-48e4-b729-f8198a31f079 None None] MFA Rules not processed for user `d9d3c8d364c3460b86280682221cca46`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:16.316076 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-bef7fd5b-641a-48e4-b729-f8198a31f079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:16.557807 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1169/2317] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:29:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:29:16.560672 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8326a0-43c4-483f-a3b6-745b81f3e0ac service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:16.562267 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ea8326a0-43c4-483f-a3b6-745b81f3e0ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:16.777170 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8326a0-43c4-483f-a3b6-745b81f3e0ac service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:16.806667 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3febeed-984d-4927-a2b2-3e0aef0779d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:16.807494 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3febeed-984d-4927-a2b2-3e0aef0779d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:16.809850 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3febeed-984d-4927-a2b2-3e0aef0779d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:16.811491 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3febeed-984d-4927-a2b2-3e0aef0779d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:16.813836 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3febeed-984d-4927-a2b2-3e0aef0779d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:16.825547 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3febeed-984d-4927-a2b2-3e0aef0779d2 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:16.884758 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:16.912015 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1149/2318] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:29:16 2022] POST /identity/v3/projects => generated 385 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:29:16.916400 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef7fd5b-641a-48e4-b729-f8198a31f079 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:16.937343 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef7fd5b-641a-48e4-b729-f8198a31f079 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:17.004341 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:17.068348 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378543bc-11fe-4fb1-b51e-8d86af99841e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:17.069243 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378543bc-11fe-4fb1-b51e-8d86af99841e admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:17.069698 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378543bc-11fe-4fb1-b51e-8d86af99841e admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:17.070124 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378543bc-11fe-4fb1-b51e-8d86af99841e admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:17.070997 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378543bc-11fe-4fb1-b51e-8d86af99841e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:17.073587 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378543bc-11fe-4fb1-b51e-8d86af99841e admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:17.127674 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1170/2319] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:29:16 2022] POST /identity/v3/users => generated 299 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:29:17.131862 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3febeed-984d-4927-a2b2-3e0aef0779d2 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:17.162728 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3febeed-984d-4927-a2b2-3e0aef0779d2 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:17.191863 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627e6c3c-3ec2-4d7f-b933-88594c1398f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:17.205943 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e6c3c-3ec2-4d7f-b933-88594c1398f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:17.206328 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e6c3c-3ec2-4d7f-b933-88594c1398f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:17.206616 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e6c3c-3ec2-4d7f-b933-88594c1398f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:17.207348 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627e6c3c-3ec2-4d7f-b933-88594c1398f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:17.209291 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627e6c3c-3ec2-4d7f-b933-88594c1398f2 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:17.276778 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1150/2320] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:29:17.277075 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378543bc-11fe-4fb1-b51e-8d86af99841e admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:17.321663 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378543bc-11fe-4fb1-b51e-8d86af99841e admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:17.335299 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a606a-d7b3-4717-9c6d-444e9fd871c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:17.336729 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a606a-d7b3-4717-9c6d-444e9fd871c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:17.337240 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a606a-d7b3-4717-9c6d-444e9fd871c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:17.337764 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a606a-d7b3-4717-9c6d-444e9fd871c6 admin admin] PATH_INFO: `/v3/projects/94be69ab6943494984878171d53dc39c/users/0a7cca06668e48b19a562d06692ecf68/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:17.391130 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92a606a-d7b3-4717-9c6d-444e9fd871c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94be69ab6943494984878171d53dc39c, user_id=0a7cca06668e48b19a562d06692ecf68, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:17.395538 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92a606a-d7b3-4717-9c6d-444e9fd871c6 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:17.423867 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1171/2321] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:29:17 2022] PUT /identity/v3/projects/94be69ab6943494984878171d53dc39c/users/0a7cca06668e48b19a562d06692ecf68/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:29:17.427723 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627e6c3c-3ec2-4d7f-b933-88594c1398f2 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:17.440878 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627e6c3c-3ec2-4d7f-b933-88594c1398f2 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:17.602623 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d555890-be89-43fd-9e3d-0e35670afd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:17.604984 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d555890-be89-43fd-9e3d-0e35670afd57 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:17.605774 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d555890-be89-43fd-9e3d-0e35670afd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:17.606330 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d555890-be89-43fd-9e3d-0e35670afd57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:17.607328 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d555890-be89-43fd-9e3d-0e35670afd57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:17.610215 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d555890-be89-43fd-9e3d-0e35670afd57 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:17.663333 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1151/2322] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:29:17.664816 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a606a-d7b3-4717-9c6d-444e9fd871c6 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:17.686590 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a606a-d7b3-4717-9c6d-444e9fd871c6 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:17.705621 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027bb69-9622-41a8-a17f-aec2df29f56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:17.706917 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027bb69-9622-41a8-a17f-aec2df29f56a admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:17.707443 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027bb69-9622-41a8-a17f-aec2df29f56a admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:17.708118 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027bb69-9622-41a8-a17f-aec2df29f56a admin admin] PATH_INFO: `/v3/projects/94be69ab6943494984878171d53dc39c/users/0a7cca06668e48b19a562d06692ecf68/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:17.713378 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f027bb69-9622-41a8-a17f-aec2df29f56a admin admin] RBAC: Authorizing `identity:create_grant(project_id=94be69ab6943494984878171d53dc39c, user_id=0a7cca06668e48b19a562d06692ecf68, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:17.716131 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f027bb69-9622-41a8-a17f-aec2df29f56a admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:17.743232 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1172/2323] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:29:17 2022] PUT /identity/v3/projects/94be69ab6943494984878171d53dc39c/users/0a7cca06668e48b19a562d06692ecf68/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:29:18.420167 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389f553-d11f-4daf-9b41-c443daddf1a7 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:18.421525 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389f553-d11f-4daf-9b41-c443daddf1a7 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:18.422183 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389f553-d11f-4daf-9b41-c443daddf1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:18.498706 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-4389f553-d11f-4daf-9b41-c443daddf1a7 None None] MFA Rules not processed for user `a54596c94fd04ea2b4ec217166292973`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:18.499961 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-4389f553-d11f-4daf-9b41-c443daddf1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:18.575187 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027bb69-9622-41a8-a17f-aec2df29f56a admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:18.577539 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f027bb69-9622-41a8-a17f-aec2df29f56a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:18.645581 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1152/2324] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:29:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:29:18.651117 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389f553-d11f-4daf-9b41-c443daddf1a7 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:18.653528 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-4389f553-d11f-4daf-9b41-c443daddf1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:18.689690 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027bb69-9622-41a8-a17f-aec2df29f56a admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:18.695315 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb54291-cbcd-4806-bc24-601e0cf3651e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:18.696286 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb54291-cbcd-4806-bc24-601e0cf3651e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:18.697152 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb54291-cbcd-4806-bc24-601e0cf3651e admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:18.697634 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb54291-cbcd-4806-bc24-601e0cf3651e admin admin] PATH_INFO: `/v3/users/890c0898812e4e12865a15f2253673ca` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:18.698935 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb54291-cbcd-4806-bc24-601e0cf3651e admin admin] RBAC: Authorizing `identity:delete_user(user_id=890c0898812e4e12865a15f2253673ca)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:18.701277 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb54291-cbcd-4806-bc24-601e0cf3651e admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:18.768422 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389f553-d11f-4daf-9b41-c443daddf1a7 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:18.775555 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd09c6-f3c5-4558-9762-b0cfa2729379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:18.776605 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd09c6-f3c5-4558-9762-b0cfa2729379 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:18.777139 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd09c6-f3c5-4558-9762-b0cfa2729379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:18.777921 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd09c6-f3c5-4558-9762-b0cfa2729379 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:18.778694 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ccb54291-cbcd-4806-bc24-601e0cf3651e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '890c0898812e4e12865a15f2253673ca'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:18.779210 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd09c6-f3c5-4558-9762-b0cfa2729379 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:18.781631 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd09c6-f3c5-4558-9762-b0cfa2729379 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:18.807644 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ccb54291-cbcd-4806-bc24-601e0cf3651e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '890c0898812e4e12865a15f2253673ca'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:18.823329 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:18.826689 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ccb54291-cbcd-4806-bc24-601e0cf3651e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '890c0898812e4e12865a15f2253673ca'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:18.827545 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ccb54291-cbcd-4806-bc24-601e0cf3651e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '890c0898812e4e12865a15f2253673ca'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:18.838885 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1153/2325] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:29:18 2022] POST /identity/v3/projects => generated 373 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:29:18.843335 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd09c6-f3c5-4558-9762-b0cfa2729379 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:18.877050 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ccb54291-cbcd-4806-bc24-601e0cf3651e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '890c0898812e4e12865a15f2253673ca'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:18.882414 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:18.901458 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1173/2326] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:29:18 2022] DELETE /identity/v3/users/890c0898812e4e12865a15f2253673ca => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:29:18.903500 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4e654-eccd-49a4-a0b6-3d05e90c2abf None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:18.903806 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4e654-eccd-49a4-a0b6-3d05e90c2abf None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:18.904064 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4e654-eccd-49a4-a0b6-3d05e90c2abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:18.948828 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-64a4e654-eccd-49a4-a0b6-3d05e90c2abf None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:18.950122 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-64a4e654-eccd-49a4-a0b6-3d05e90c2abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:18.967213 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd09c6-f3c5-4558-9762-b0cfa2729379 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:19.072345 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46012cb4-badf-445d-bd95-5ee9384b361d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:19.073217 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46012cb4-badf-445d-bd95-5ee9384b361d admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:19.073540 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46012cb4-badf-445d-bd95-5ee9384b361d admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:19.073813 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46012cb4-badf-445d-bd95-5ee9384b361d admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:19.074616 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46012cb4-badf-445d-bd95-5ee9384b361d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:19.076008 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1174/2327] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:29:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:29:19.076898 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46012cb4-badf-445d-bd95-5ee9384b361d admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:19.089163 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a4e654-eccd-49a4-a0b6-3d05e90c2abf None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:19.091154 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-64a4e654-eccd-49a4-a0b6-3d05e90c2abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:19.106509 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1154/2328] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:29:18 2022] POST /identity/v3/users => generated 293 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:29:19.111734 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46012cb4-badf-445d-bd95-5ee9384b361d admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:19.113650 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-46012cb4-badf-445d-bd95-5ee9384b361d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:19.129180 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46012cb4-badf-445d-bd95-5ee9384b361d admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:19.136052 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b721430b-48dd-448b-bc55-fe279cd9ba9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:19.136761 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721430b-48dd-448b-bc55-fe279cd9ba9b admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:19.137673 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721430b-48dd-448b-bc55-fe279cd9ba9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:19.137998 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721430b-48dd-448b-bc55-fe279cd9ba9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:19.138938 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b721430b-48dd-448b-bc55-fe279cd9ba9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:19.140978 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b721430b-48dd-448b-bc55-fe279cd9ba9b admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:19.155575 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1155/2329] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:29:19.161253 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b721430b-48dd-448b-bc55-fe279cd9ba9b admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:19.174636 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b721430b-48dd-448b-bc55-fe279cd9ba9b admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:19.180499 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd088d-4ff5-4cef-897f-d91caa12dd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:19.181226 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd088d-4ff5-4cef-897f-d91caa12dd68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:19.181579 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd088d-4ff5-4cef-897f-d91caa12dd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:19.182129 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd088d-4ff5-4cef-897f-d91caa12dd68 admin admin] PATH_INFO: `/v3/projects/59093efeac7644e39bb7f040c72c3f16/users/2264e8d00e884206aa214b88dadbe759/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:19.200695 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a4e654-eccd-49a4-a0b6-3d05e90c2abf None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:19.212279 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f162668-3d20-4f80-8b32-d60d37c5f8c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:19.213879 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f162668-3d20-4f80-8b32-d60d37c5f8c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:19.214328 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f162668-3d20-4f80-8b32-d60d37c5f8c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:19.214721 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f162668-3d20-4f80-8b32-d60d37c5f8c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:19.217620 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd088d-4ff5-4cef-897f-d91caa12dd68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59093efeac7644e39bb7f040c72c3f16, user_id=2264e8d00e884206aa214b88dadbe759, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:19.222919 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd088d-4ff5-4cef-897f-d91caa12dd68 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:19.257412 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f162668-3d20-4f80-8b32-d60d37c5f8c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:19.259277 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f162668-3d20-4f80-8b32-d60d37c5f8c5 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:19.263157 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1156/2330] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:29:19 2022] PUT /identity/v3/projects/59093efeac7644e39bb7f040c72c3f16/users/2264e8d00e884206aa214b88dadbe759/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:29:19.267913 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd088d-4ff5-4cef-897f-d91caa12dd68 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:19.277743 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1175/2331] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:29:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:29:19.396001 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd088d-4ff5-4cef-897f-d91caa12dd68 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:19.411307 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a1599-a7c1-4166-a5a0-4249e61c39ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:19.412704 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a1599-a7c1-4166-a5a0-4249e61c39ff admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:19.413283 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a1599-a7c1-4166-a5a0-4249e61c39ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:19.413799 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a1599-a7c1-4166-a5a0-4249e61c39ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:19.417055 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a1599-a7c1-4166-a5a0-4249e61c39ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:19.419444 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a1599-a7c1-4166-a5a0-4249e61c39ff admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:19.423248 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:19.441238 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1157/2332] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:29:19.441904 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f162668-3d20-4f80-8b32-d60d37c5f8c5 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:19.460889 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f162668-3d20-4f80-8b32-d60d37c5f8c5 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:19.473163 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e0849-1959-4936-9810-20a1d297cc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:19.474207 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e0849-1959-4936-9810-20a1d297cc9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:19.474687 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e0849-1959-4936-9810-20a1d297cc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:19.475073 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e0849-1959-4936-9810-20a1d297cc9d admin admin] PATH_INFO: `/v3/projects/59093efeac7644e39bb7f040c72c3f16/users/2264e8d00e884206aa214b88dadbe759/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:19.477590 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e0849-1959-4936-9810-20a1d297cc9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=59093efeac7644e39bb7f040c72c3f16, user_id=2264e8d00e884206aa214b88dadbe759, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:19.480953 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e0849-1959-4936-9810-20a1d297cc9d admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:19.498828 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1176/2333] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:29:19 2022] PUT /identity/v3/projects/59093efeac7644e39bb7f040c72c3f16/users/2264e8d00e884206aa214b88dadbe759/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:29:20.249744 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a1599-a7c1-4166-a5a0-4249e61c39ff admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:20.252394 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d99a1599-a7c1-4166-a5a0-4249e61c39ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:20.284062 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a1599-a7c1-4166-a5a0-4249e61c39ff admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:20.422213 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941c5c4-373e-44a2-b4d3-2f9d72059b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:20.423467 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941c5c4-373e-44a2-b4d3-2f9d72059b6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:20.423810 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941c5c4-373e-44a2-b4d3-2f9d72059b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:20.425498 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941c5c4-373e-44a2-b4d3-2f9d72059b6c admin admin] PATH_INFO: `/v3/projects/5d0730aea5f544e4940581050c08a3ee` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:20.427107 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8941c5c4-373e-44a2-b4d3-2f9d72059b6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d0730aea5f544e4940581050c08a3ee)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:20.430758 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8941c5c4-373e-44a2-b4d3-2f9d72059b6c admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:20.592197 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8941c5c4-373e-44a2-b4d3-2f9d72059b6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d0730aea5f544e4940581050c08a3ee', 'request_id': 'req-8941c5c4-373e-44a2-b4d3-2f9d72059b6c'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:20.609104 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8941c5c4-373e-44a2-b4d3-2f9d72059b6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d0730aea5f544e4940581050c08a3ee', 'request_id': 'req-8941c5c4-373e-44a2-b4d3-2f9d72059b6c'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:20.625240 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8941c5c4-373e-44a2-b4d3-2f9d72059b6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d0730aea5f544e4940581050c08a3ee', 'request_id': 'req-8941c5c4-373e-44a2-b4d3-2f9d72059b6c'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:20.650312 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8941c5c4-373e-44a2-b4d3-2f9d72059b6c admin admin] The token cache is being invalidate because project 5d0730aea5f544e4940581050c08a3ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:29:20.651050 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8941c5c4-373e-44a2-b4d3-2f9d72059b6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:20.654049 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8941c5c4-373e-44a2-b4d3-2f9d72059b6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:20.659360 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1158/2334] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:29:20 2022] DELETE /identity/v3/projects/5d0730aea5f544e4940581050c08a3ee => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:29:20.663892 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e0849-1959-4936-9810-20a1d297cc9d admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:20.669292 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-8c3e0849-1959-4936-9810-20a1d297cc9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:20.702996 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e0849-1959-4936-9810-20a1d297cc9d admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:20.833273 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d400200-3d0d-483e-b1c7-684f39d67f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:20.834721 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d400200-3d0d-483e-b1c7-684f39d67f0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:20.835389 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d400200-3d0d-483e-b1c7-684f39d67f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:20.835963 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d400200-3d0d-483e-b1c7-684f39d67f0d admin admin] PATH_INFO: `/v3/users/101bd481685d4ecd9e588bd049f511ae` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:20.838332 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d400200-3d0d-483e-b1c7-684f39d67f0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=101bd481685d4ecd9e588bd049f511ae)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:20.843024 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d400200-3d0d-483e-b1c7-684f39d67f0d admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:20.961259 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:21.002011 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-3d400200-3d0d-483e-b1c7-684f39d67f0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '101bd481685d4ecd9e588bd049f511ae'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:21.022140 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-3d400200-3d0d-483e-b1c7-684f39d67f0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '101bd481685d4ecd9e588bd049f511ae'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:21.038468 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-3d400200-3d0d-483e-b1c7-684f39d67f0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '101bd481685d4ecd9e588bd049f511ae'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:21.039415 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-3d400200-3d0d-483e-b1c7-684f39d67f0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '101bd481685d4ecd9e588bd049f511ae'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:21.058620 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-3d400200-3d0d-483e-b1c7-684f39d67f0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '101bd481685d4ecd9e588bd049f511ae'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:21.067325 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1177/2335] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:29:20 2022] DELETE /identity/v3/users/101bd481685d4ecd9e588bd049f511ae => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:29:22.135125 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941c5c4-373e-44a2-b4d3-2f9d72059b6c admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:22.155837 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941c5c4-373e-44a2-b4d3-2f9d72059b6c admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:22.337042 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231f995-2639-4ed4-bf1b-4c2f508341f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:22.338076 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231f995-2639-4ed4-bf1b-4c2f508341f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:22.339011 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231f995-2639-4ed4-bf1b-4c2f508341f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:22.339317 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231f995-2639-4ed4-bf1b-4c2f508341f0 admin admin] PATH_INFO: `/v3/projects/4971e3143dfc44cd8cbda8c6067b0a28` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:22.341186 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8231f995-2639-4ed4-bf1b-4c2f508341f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4971e3143dfc44cd8cbda8c6067b0a28)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:22.344838 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8231f995-2639-4ed4-bf1b-4c2f508341f0 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:22.409100 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:22.445433 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8231f995-2639-4ed4-bf1b-4c2f508341f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4971e3143dfc44cd8cbda8c6067b0a28', 'request_id': 'req-8231f995-2639-4ed4-bf1b-4c2f508341f0'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:22.456983 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8231f995-2639-4ed4-bf1b-4c2f508341f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4971e3143dfc44cd8cbda8c6067b0a28', 'request_id': 'req-8231f995-2639-4ed4-bf1b-4c2f508341f0'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:22.470362 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8231f995-2639-4ed4-bf1b-4c2f508341f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4971e3143dfc44cd8cbda8c6067b0a28', 'request_id': 'req-8231f995-2639-4ed4-bf1b-4c2f508341f0'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:22.495957 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8231f995-2639-4ed4-bf1b-4c2f508341f0 admin admin] The token cache is being invalidate because project 4971e3143dfc44cd8cbda8c6067b0a28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:29:22.496242 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8231f995-2639-4ed4-bf1b-4c2f508341f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:22.496991 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8231f995-2639-4ed4-bf1b-4c2f508341f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:22.499673 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1159/2336] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:29:22 2022] DELETE /identity/v3/projects/4971e3143dfc44cd8cbda8c6067b0a28 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:29:22.506624 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015a40a-1b15-4c70-8d39-f43d6104d6d6 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:22.507561 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015a40a-1b15-4c70-8d39-f43d6104d6d6 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:22.514948 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015a40a-1b15-4c70-8d39-f43d6104d6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:22.555362 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-9015a40a-1b15-4c70-8d39-f43d6104d6d6 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:22.555835 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-9015a40a-1b15-4c70-8d39-f43d6104d6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:22.697815 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1178/2337] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:29:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:29:22.706377 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64009964-c2ca-4208-bf17-c7cc89377731 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:22.706724 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64009964-c2ca-4208-bf17-c7cc89377731 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:22.706924 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64009964-c2ca-4208-bf17-c7cc89377731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:22.748345 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-64009964-c2ca-4208-bf17-c7cc89377731 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:22.749656 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-64009964-c2ca-4208-bf17-c7cc89377731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:22.765369 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1160/2338] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:29:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:29:22.766297 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9015a40a-1b15-4c70-8d39-f43d6104d6d6 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:22.787250 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9015a40a-1b15-4c70-8d39-f43d6104d6d6 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:22.794118 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a4302-a00a-4a95-89a9-cff5f95814c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:22.794989 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a4302-a00a-4a95-89a9-cff5f95814c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:22.795441 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a4302-a00a-4a95-89a9-cff5f95814c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:22.795865 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a4302-a00a-4a95-89a9-cff5f95814c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:22.796728 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a4302-a00a-4a95-89a9-cff5f95814c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:29:22.797229 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a4302-a00a-4a95-89a9-cff5f95814c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:22.801347 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a4302-a00a-4a95-89a9-cff5f95814c2 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:22.845437 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64009964-c2ca-4208-bf17-c7cc89377731 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:22.861196 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1179/2339] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:29:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:22.863498 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64009964-c2ca-4208-bf17-c7cc89377731 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:22.869579 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec92bc0a-4655-46fe-86f9-987b312d1ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:22.870209 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92bc0a-4655-46fe-86f9-987b312d1ff4 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:22.870486 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92bc0a-4655-46fe-86f9-987b312d1ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:22.870766 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92bc0a-4655-46fe-86f9-987b312d1ff4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:22.871534 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec92bc0a-4655-46fe-86f9-987b312d1ff4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:22.874672 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec92bc0a-4655-46fe-86f9-987b312d1ff4 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:23.010761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a4302-a00a-4a95-89a9-cff5f95814c2 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:23.023209 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a4302-a00a-4a95-89a9-cff5f95814c2 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:23.023886 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1161/2340] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:29:22 2022] POST /identity/v3/projects => generated 377 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:29:23.224357 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b72348-0c18-4029-984a-85a4000b94e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:23.225534 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b72348-0c18-4029-984a-85a4000b94e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:23.225996 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b72348-0c18-4029-984a-85a4000b94e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:23.226437 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b72348-0c18-4029-984a-85a4000b94e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:23.227248 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b72348-0c18-4029-984a-85a4000b94e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:23.229598 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b72348-0c18-4029-984a-85a4000b94e9 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:23.272566 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1180/2341] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:29:23 2022] POST /identity/v3/users => generated 289 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:29:23.278757 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec92bc0a-4655-46fe-86f9-987b312d1ff4 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:23.294995 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec92bc0a-4655-46fe-86f9-987b312d1ff4 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:23.302150 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102966b4-5475-4131-8901-166445e57d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:23.302999 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102966b4-5475-4131-8901-166445e57d5c admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:23.303568 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102966b4-5475-4131-8901-166445e57d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:23.303897 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102966b4-5475-4131-8901-166445e57d5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:23.304916 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102966b4-5475-4131-8901-166445e57d5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:23.307021 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102966b4-5475-4131-8901-166445e57d5c admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:23.324411 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1162/2342] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:29:23.324656 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b72348-0c18-4029-984a-85a4000b94e9 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:23.366624 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b72348-0c18-4029-984a-85a4000b94e9 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:23.392231 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782dcdb2-a731-4684-b9c7-ff606dadaed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:23.393073 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782dcdb2-a731-4684-b9c7-ff606dadaed6 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:23.393341 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782dcdb2-a731-4684-b9c7-ff606dadaed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:23.393625 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782dcdb2-a731-4684-b9c7-ff606dadaed6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:23.394303 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782dcdb2-a731-4684-b9c7-ff606dadaed6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:23.406696 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782dcdb2-a731-4684-b9c7-ff606dadaed6 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:23.437606 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1181/2343] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:29:23.441890 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102966b4-5475-4131-8901-166445e57d5c admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:23.452765 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102966b4-5475-4131-8901-166445e57d5c admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:23.470308 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64800648-cb83-4869-8c62-ba109505a148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:23.471183 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64800648-cb83-4869-8c62-ba109505a148 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:23.471870 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64800648-cb83-4869-8c62-ba109505a148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:23.472237 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64800648-cb83-4869-8c62-ba109505a148 admin admin] PATH_INFO: `/v3/projects/92d283c0db804a5c8537d708307dd6d2/users/57320216642d485abd1201b81eb0eb78/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:23.495025 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64800648-cb83-4869-8c62-ba109505a148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92d283c0db804a5c8537d708307dd6d2, user_id=57320216642d485abd1201b81eb0eb78, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:23.498030 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64800648-cb83-4869-8c62-ba109505a148 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:23.543681 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1163/2344] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:29:23 2022] PUT /identity/v3/projects/92d283c0db804a5c8537d708307dd6d2/users/57320216642d485abd1201b81eb0eb78/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:29:23.545769 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9675a-cbef-42d4-b359-1b3c6f01fb9d None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:23.546561 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9675a-cbef-42d4-b359-1b3c6f01fb9d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:23.546994 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9675a-cbef-42d4-b359-1b3c6f01fb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:23.606302 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:23.610657 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-dca9675a-cbef-42d4-b359-1b3c6f01fb9d None None] MFA Rules not processed for user `57320216642d485abd1201b81eb0eb78`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:23.615567 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-dca9675a-cbef-42d4-b359-1b3c6f01fb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:23.755058 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1182/2345] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:29:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:29:23.758440 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64800648-cb83-4869-8c62-ba109505a148 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:23.764881 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-64800648-cb83-4869-8c62-ba109505a148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:23.902856 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64800648-cb83-4869-8c62-ba109505a148 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:23.909100 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab455953-8ee5-4919-af22-f89967df0030 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:23.910122 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab455953-8ee5-4919-af22-f89967df0030 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:23.910610 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab455953-8ee5-4919-af22-f89967df0030 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:23.911087 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab455953-8ee5-4919-af22-f89967df0030 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:23.931308 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab455953-8ee5-4919-af22-f89967df0030 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:23.933335 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab455953-8ee5-4919-af22-f89967df0030 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:23.947391 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1164/2346] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:29:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:29:24.246577 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca9675a-cbef-42d4-b359-1b3c6f01fb9d None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:24.248441 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-dca9675a-cbef-42d4-b359-1b3c6f01fb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:24.490807 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca9675a-cbef-42d4-b359-1b3c6f01fb9d None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:24.525376 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7495f-48be-4380-8704-86d174d176c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:24.530302 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7495f-48be-4380-8704-86d174d176c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:24.530816 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7495f-48be-4380-8704-86d174d176c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:24.531073 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7495f-48be-4380-8704-86d174d176c1 admin admin] PATH_INFO: `/v3/users/b63b9634a8934b9bb40520251722a632` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:24.533349 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce7495f-48be-4380-8704-86d174d176c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b63b9634a8934b9bb40520251722a632)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:24.539531 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce7495f-48be-4380-8704-86d174d176c1 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:24.896657 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9ce7495f-48be-4380-8704-86d174d176c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b63b9634a8934b9bb40520251722a632'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:24.949113 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9ce7495f-48be-4380-8704-86d174d176c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b63b9634a8934b9bb40520251722a632'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:24.961961 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9ce7495f-48be-4380-8704-86d174d176c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b63b9634a8934b9bb40520251722a632'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:24.963349 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9ce7495f-48be-4380-8704-86d174d176c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b63b9634a8934b9bb40520251722a632'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:25.011560 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9ce7495f-48be-4380-8704-86d174d176c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b63b9634a8934b9bb40520251722a632'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:25.044057 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f805ad-0d14-4ed1-b691-edeadf91ff41 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:25.044635 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f805ad-0d14-4ed1-b691-edeadf91ff41 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:25.044823 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f805ad-0d14-4ed1-b691-edeadf91ff41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:25.051863 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1183/2347] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:29:24 2022] DELETE /identity/v3/users/b63b9634a8934b9bb40520251722a632 => generated 0 bytes in 793 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:29:25.082480 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-45f805ad-0d14-4ed1-b691-edeadf91ff41 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:25.083742 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-45f805ad-0d14-4ed1-b691-edeadf91ff41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:25.229063 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:25.252631 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1165/2348] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:29:25.267378 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7495f-48be-4380-8704-86d174d176c1 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:25.269081 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-9ce7495f-48be-4380-8704-86d174d176c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:25.339504 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:25.404003 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7495f-48be-4380-8704-86d174d176c1 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:25.416769 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f02c9-9e1a-41a1-b608-0c0590168e71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:25.417524 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f02c9-9e1a-41a1-b608-0c0590168e71 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:25.419452 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f02c9-9e1a-41a1-b608-0c0590168e71 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:25.420717 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f02c9-9e1a-41a1-b608-0c0590168e71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:25.439561 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f02c9-9e1a-41a1-b608-0c0590168e71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:25.442750 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f02c9-9e1a-41a1-b608-0c0590168e71 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:25.457508 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1184/2349] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:29:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:29:26.169350 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f805ad-0d14-4ed1-b691-edeadf91ff41 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:26.171328 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-45f805ad-0d14-4ed1-b691-edeadf91ff41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:26.200498 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f805ad-0d14-4ed1-b691-edeadf91ff41 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:26.209653 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3ec6a-f109-41b8-9f8c-8b1c3be0300b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:26.211515 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3ec6a-f109-41b8-9f8c-8b1c3be0300b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:26.212033 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3ec6a-f109-41b8-9f8c-8b1c3be0300b admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:26.212571 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3ec6a-f109-41b8-9f8c-8b1c3be0300b admin admin] PATH_INFO: `/v3/projects/e61bef10efc846148f727411ef87163d` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:26.216619 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce3ec6a-f109-41b8-9f8c-8b1c3be0300b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e61bef10efc846148f727411ef87163d)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:26.222985 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce3ec6a-f109-41b8-9f8c-8b1c3be0300b admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:26.316722 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9ce3ec6a-f109-41b8-9f8c-8b1c3be0300b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e61bef10efc846148f727411ef87163d', 'request_id': 'req-9ce3ec6a-f109-41b8-9f8c-8b1c3be0300b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:26.325867 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9ce3ec6a-f109-41b8-9f8c-8b1c3be0300b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e61bef10efc846148f727411ef87163d', 'request_id': 'req-9ce3ec6a-f109-41b8-9f8c-8b1c3be0300b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:26.337424 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9ce3ec6a-f109-41b8-9f8c-8b1c3be0300b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e61bef10efc846148f727411ef87163d', 'request_id': 'req-9ce3ec6a-f109-41b8-9f8c-8b1c3be0300b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:26.353706 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9ce3ec6a-f109-41b8-9f8c-8b1c3be0300b admin admin] The token cache is being invalidate because project e61bef10efc846148f727411ef87163d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:29:26.354405 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9ce3ec6a-f109-41b8-9f8c-8b1c3be0300b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:26.355824 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9ce3ec6a-f109-41b8-9f8c-8b1c3be0300b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:26.358386 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1166/2350] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:29:26 2022] DELETE /identity/v3/projects/e61bef10efc846148f727411ef87163d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:29:26.363277 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f02c9-9e1a-41a1-b608-0c0590168e71 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:26.383202 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f02c9-9e1a-41a1-b608-0c0590168e71 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:26.550046 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4430936-cdb6-483c-a6b9-19d147da0fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:26.550735 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4430936-cdb6-483c-a6b9-19d147da0fea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:26.551412 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4430936-cdb6-483c-a6b9-19d147da0fea admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:26.551998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4430936-cdb6-483c-a6b9-19d147da0fea admin admin] PATH_INFO: `/v3/users/f65d1655bc364a329186bcb842a8e3e8` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:26.555317 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4430936-cdb6-483c-a6b9-19d147da0fea admin admin] RBAC: Authorizing `identity:delete_user(user_id=f65d1655bc364a329186bcb842a8e3e8)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:26.558706 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4430936-cdb6-483c-a6b9-19d147da0fea admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:26.722037 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b4430936-cdb6-483c-a6b9-19d147da0fea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f65d1655bc364a329186bcb842a8e3e8'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:26.749315 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b4430936-cdb6-483c-a6b9-19d147da0fea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f65d1655bc364a329186bcb842a8e3e8'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:26.774707 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b4430936-cdb6-483c-a6b9-19d147da0fea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f65d1655bc364a329186bcb842a8e3e8'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:26.777227 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b4430936-cdb6-483c-a6b9-19d147da0fea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f65d1655bc364a329186bcb842a8e3e8'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:26.822873 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b4430936-cdb6-483c-a6b9-19d147da0fea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f65d1655bc364a329186bcb842a8e3e8'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:26.851136 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1185/2351] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:29:26 2022] DELETE /identity/v3/users/f65d1655bc364a329186bcb842a8e3e8 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:29:28.111956 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3ec6a-f109-41b8-9f8c-8b1c3be0300b admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:28.120715 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-9ce3ec6a-f109-41b8-9f8c-8b1c3be0300b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:28.156552 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3ec6a-f109-41b8-9f8c-8b1c3be0300b admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:28.397169 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae508b7-356a-41c0-b09a-4f30c2149f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:28.398002 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae508b7-356a-41c0-b09a-4f30c2149f9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:28.402404 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae508b7-356a-41c0-b09a-4f30c2149f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:28.402888 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae508b7-356a-41c0-b09a-4f30c2149f9c admin admin] PATH_INFO: `/v3/projects/c54f5e11508742308a8121d87e83950e` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:28.406363 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae508b7-356a-41c0-b09a-4f30c2149f9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c54f5e11508742308a8121d87e83950e)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:28.411181 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae508b7-356a-41c0-b09a-4f30c2149f9c admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:28.585911 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-2ae508b7-356a-41c0-b09a-4f30c2149f9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c54f5e11508742308a8121d87e83950e', 'request_id': 'req-2ae508b7-356a-41c0-b09a-4f30c2149f9c'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:28.593356 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-2ae508b7-356a-41c0-b09a-4f30c2149f9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c54f5e11508742308a8121d87e83950e', 'request_id': 'req-2ae508b7-356a-41c0-b09a-4f30c2149f9c'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:28.610397 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-2ae508b7-356a-41c0-b09a-4f30c2149f9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c54f5e11508742308a8121d87e83950e', 'request_id': 'req-2ae508b7-356a-41c0-b09a-4f30c2149f9c'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:28.643790 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-2ae508b7-356a-41c0-b09a-4f30c2149f9c admin admin] The token cache is being invalidate because project c54f5e11508742308a8121d87e83950e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:29:28.644122 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-2ae508b7-356a-41c0-b09a-4f30c2149f9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:28.645357 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-2ae508b7-356a-41c0-b09a-4f30c2149f9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:28.649033 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1167/2352] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:29:28 2022] DELETE /identity/v3/projects/c54f5e11508742308a8121d87e83950e => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:29:28.654184 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26afde6-b751-473a-9b20-4eb8131bbfe7 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:28.654844 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26afde6-b751-473a-9b20-4eb8131bbfe7 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:28.655067 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26afde6-b751-473a-9b20-4eb8131bbfe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:28.709135 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-c26afde6-b751-473a-9b20-4eb8131bbfe7 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:28.714604 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c26afde6-b751-473a-9b20-4eb8131bbfe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:28.849050 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:28.928601 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1186/2353] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:29:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:29:28.936972 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea391f4-4de0-41ab-b9bc-9a132979b2e9 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:28.937610 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea391f4-4de0-41ab-b9bc-9a132979b2e9 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:28.937989 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea391f4-4de0-41ab-b9bc-9a132979b2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:29.000339 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-1ea391f4-4de0-41ab-b9bc-9a132979b2e9 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:29.007545 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-1ea391f4-4de0-41ab-b9bc-9a132979b2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:29.026023 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1168/2354] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:29:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:29:29.031428 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26afde6-b751-473a-9b20-4eb8131bbfe7 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:29.044213 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26afde6-b751-473a-9b20-4eb8131bbfe7 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:29.058118 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd59e19e-fcb7-4629-a5d1-b2ac6b45e7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:29.059133 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59e19e-fcb7-4629-a5d1-b2ac6b45e7c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:29.059614 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59e19e-fcb7-4629-a5d1-b2ac6b45e7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:29.060000 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59e19e-fcb7-4629-a5d1-b2ac6b45e7c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:29.060918 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd59e19e-fcb7-4629-a5d1-b2ac6b45e7c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:29:29.061307 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd59e19e-fcb7-4629-a5d1-b2ac6b45e7c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:29.063196 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd59e19e-fcb7-4629-a5d1-b2ac6b45e7c1 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:29.085848 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1187/2355] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:29:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:29.090164 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea391f4-4de0-41ab-b9bc-9a132979b2e9 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:29.100790 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:29.109302 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea391f4-4de0-41ab-b9bc-9a132979b2e9 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:29.118044 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec4abd-f278-45a7-9dde-df39414190ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:29.120555 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec4abd-f278-45a7-9dde-df39414190ec admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:29.121094 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec4abd-f278-45a7-9dde-df39414190ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:29.121593 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec4abd-f278-45a7-9dde-df39414190ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:29.123528 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daec4abd-f278-45a7-9dde-df39414190ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:29.127176 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daec4abd-f278-45a7-9dde-df39414190ec admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:29.202503 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1169/2356] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:29:29 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:29:29.209902 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd59e19e-fcb7-4629-a5d1-b2ac6b45e7c1 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:29.227298 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd59e19e-fcb7-4629-a5d1-b2ac6b45e7c1 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:29.391097 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22845e6-33ae-4af8-a09d-ff7410db8ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:29.392328 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22845e6-33ae-4af8-a09d-ff7410db8ccb admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:29.393069 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22845e6-33ae-4af8-a09d-ff7410db8ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:29.393497 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22845e6-33ae-4af8-a09d-ff7410db8ccb admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:29.394312 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22845e6-33ae-4af8-a09d-ff7410db8ccb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:29.399356 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22845e6-33ae-4af8-a09d-ff7410db8ccb admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:29.435356 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1188/2357] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:29:29 2022] POST /identity/v3/users => generated 293 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:29:29.439756 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec4abd-f278-45a7-9dde-df39414190ec admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:29.457425 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec4abd-f278-45a7-9dde-df39414190ec admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:29.471058 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd096e-b0fb-4d18-adf9-4806b95bd6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:29.473347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd096e-b0fb-4d18-adf9-4806b95bd6d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:29.474157 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd096e-b0fb-4d18-adf9-4806b95bd6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:29.474727 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd096e-b0fb-4d18-adf9-4806b95bd6d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:29.475899 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bd096e-b0fb-4d18-adf9-4806b95bd6d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:29.491021 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bd096e-b0fb-4d18-adf9-4806b95bd6d4 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:29.518627 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22845e6-33ae-4af8-a09d-ff7410db8ccb admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:29.519414 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1170/2358] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:29:29.535869 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22845e6-33ae-4af8-a09d-ff7410db8ccb admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:29.550923 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f7fca-d8c5-4944-a315-327ff5d1bd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:29.552424 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f7fca-d8c5-4944-a315-327ff5d1bd31 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:29.556758 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f7fca-d8c5-4944-a315-327ff5d1bd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:29.557769 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f7fca-d8c5-4944-a315-327ff5d1bd31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:29.561393 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6f7fca-d8c5-4944-a315-327ff5d1bd31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:29.566671 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6f7fca-d8c5-4944-a315-327ff5d1bd31 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:29.591488 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd096e-b0fb-4d18-adf9-4806b95bd6d4 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:29.603622 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1189/2359] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:29:29.606324 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd096e-b0fb-4d18-adf9-4806b95bd6d4 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:29.612502 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2478ce-a861-42e3-a34e-91c59881e2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:29.613701 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2478ce-a861-42e3-a34e-91c59881e2e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:29.614236 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2478ce-a861-42e3-a34e-91c59881e2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:29.615030 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2478ce-a861-42e3-a34e-91c59881e2e6 admin admin] PATH_INFO: `/v3/projects/ab17f8652f39468d9f4ecd0527d8a107/users/ce4b3d260ae3475b89d179e7e57757b8/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:29.660957 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2478ce-a861-42e3-a34e-91c59881e2e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab17f8652f39468d9f4ecd0527d8a107, user_id=ce4b3d260ae3475b89d179e7e57757b8, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:29.663171 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2478ce-a861-42e3-a34e-91c59881e2e6 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:29.710059 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d33207-fdd6-4a4f-a4a7-346a41d98767 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:29.710708 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d33207-fdd6-4a4f-a4a7-346a41d98767 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:29.710708 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d33207-fdd6-4a4f-a4a7-346a41d98767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:29.713455 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1171/2360] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:29:29 2022] PUT /identity/v3/projects/ab17f8652f39468d9f4ecd0527d8a107/users/ce4b3d260ae3475b89d179e7e57757b8/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:29:29.788465 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-07d33207-fdd6-4a4f-a4a7-346a41d98767 None None] MFA Rules not processed for user `ce4b3d260ae3475b89d179e7e57757b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:29.790036 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-07d33207-fdd6-4a4f-a4a7-346a41d98767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:29.986237 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1190/2361] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:29:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:29:29.987719 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2478ce-a861-42e3-a34e-91c59881e2e6 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:30.127917 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2478ce-a861-42e3-a34e-91c59881e2e6 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:30.141589 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a111a562-a2cc-4530-a0e9-9a7d5ef9e8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:30.143548 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a111a562-a2cc-4530-a0e9-9a7d5ef9e8a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:30.143956 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a111a562-a2cc-4530-a0e9-9a7d5ef9e8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:30.145592 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a111a562-a2cc-4530-a0e9-9a7d5ef9e8a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:30.146545 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a111a562-a2cc-4530-a0e9-9a7d5ef9e8a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:30.148927 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a111a562-a2cc-4530-a0e9-9a7d5ef9e8a5 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:30.200126 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1172/2362] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:29:29 2022] POST /identity/v3/projects => generated 387 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:29:30.204505 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d33207-fdd6-4a4f-a4a7-346a41d98767 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:30.230299 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d33207-fdd6-4a4f-a4a7-346a41d98767 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:30.338704 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:30.397978 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e8312-32f7-4a52-9ba8-a0489c113c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:30.399035 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e8312-32f7-4a52-9ba8-a0489c113c75 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:30.399035 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e8312-32f7-4a52-9ba8-a0489c113c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:30.399319 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e8312-32f7-4a52-9ba8-a0489c113c75 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:30.403714 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5e8312-32f7-4a52-9ba8-a0489c113c75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:30.411737 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5e8312-32f7-4a52-9ba8-a0489c113c75 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:30.485345 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1191/2363] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:29:30 2022] POST /identity/v3/users => generated 300 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:29:30.489996 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a111a562-a2cc-4530-a0e9-9a7d5ef9e8a5 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:30.530485 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a111a562-a2cc-4530-a0e9-9a7d5ef9e8a5 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:30.567224 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19262bdc-3b24-4d86-b87a-ec19b3a94164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:30.572378 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19262bdc-3b24-4d86-b87a-ec19b3a94164 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:30.575227 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19262bdc-3b24-4d86-b87a-ec19b3a94164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:30.576982 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19262bdc-3b24-4d86-b87a-ec19b3a94164 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:30.578396 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19262bdc-3b24-4d86-b87a-ec19b3a94164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:30.588015 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19262bdc-3b24-4d86-b87a-ec19b3a94164 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:30.636242 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1173/2364] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:29:30.636727 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e8312-32f7-4a52-9ba8-a0489c113c75 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:30.653412 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e8312-32f7-4a52-9ba8-a0489c113c75 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:30.666026 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db5529-569a-4e41-bb5d-8248b5866f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:30.667066 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db5529-569a-4e41-bb5d-8248b5866f74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:30.667465 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db5529-569a-4e41-bb5d-8248b5866f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:30.667783 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db5529-569a-4e41-bb5d-8248b5866f74 admin admin] PATH_INFO: `/v3/projects/c34e8043554342818ac8b382ce6f0db6/users/d79fe0c162c94ea099d0ca81491beb75/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:30.708862 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db5529-569a-4e41-bb5d-8248b5866f74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c34e8043554342818ac8b382ce6f0db6, user_id=d79fe0c162c94ea099d0ca81491beb75, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:30.711786 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db5529-569a-4e41-bb5d-8248b5866f74 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:30.748590 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1192/2365] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:29:30 2022] PUT /identity/v3/projects/c34e8043554342818ac8b382ce6f0db6/users/d79fe0c162c94ea099d0ca81491beb75/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:29:30.754124 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19262bdc-3b24-4d86-b87a-ec19b3a94164 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:30.780816 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19262bdc-3b24-4d86-b87a-ec19b3a94164 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:31.018742 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29f7603-4d9c-43aa-aa03-79e6ec49419f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:31.019411 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f7603-4d9c-43aa-aa03-79e6ec49419f admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:31.019863 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f7603-4d9c-43aa-aa03-79e6ec49419f admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:31.020306 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f7603-4d9c-43aa-aa03-79e6ec49419f admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:31.022315 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29f7603-4d9c-43aa-aa03-79e6ec49419f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:31.025125 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29f7603-4d9c-43aa-aa03-79e6ec49419f admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:31.053593 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1174/2366] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:29:31.055045 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db5529-569a-4e41-bb5d-8248b5866f74 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:31.084497 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db5529-569a-4e41-bb5d-8248b5866f74 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:31.100715 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64339313-1651-43d9-9f47-4d5bf2c7e1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:31.101463 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64339313-1651-43d9-9f47-4d5bf2c7e1f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:31.101754 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64339313-1651-43d9-9f47-4d5bf2c7e1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:31.102033 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64339313-1651-43d9-9f47-4d5bf2c7e1f8 admin admin] PATH_INFO: `/v3/projects/c34e8043554342818ac8b382ce6f0db6/users/d79fe0c162c94ea099d0ca81491beb75/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:31.105764 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64339313-1651-43d9-9f47-4d5bf2c7e1f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c34e8043554342818ac8b382ce6f0db6, user_id=d79fe0c162c94ea099d0ca81491beb75, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:31.108753 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64339313-1651-43d9-9f47-4d5bf2c7e1f8 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:31.149306 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1193/2367] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:29:31 2022] PUT /identity/v3/projects/c34e8043554342818ac8b382ce6f0db6/users/d79fe0c162c94ea099d0ca81491beb75/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:29:31.150679 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f982a-eb79-448c-b9b9-2cbb3cc15aee None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:31.151847 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f982a-eb79-448c-b9b9-2cbb3cc15aee None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:31.152561 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f982a-eb79-448c-b9b9-2cbb3cc15aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:31.224725 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-c75f982a-eb79-448c-b9b9-2cbb3cc15aee None None] MFA Rules not processed for user `d79fe0c162c94ea099d0ca81491beb75`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:31.226179 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c75f982a-eb79-448c-b9b9-2cbb3cc15aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:31.240601 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:31.403299 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1175/2368] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:29:31 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:29:31.417137 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64339313-1651-43d9-9f47-4d5bf2c7e1f8 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:31.421916 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-64339313-1651-43d9-9f47-4d5bf2c7e1f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:31.629258 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64339313-1651-43d9-9f47-4d5bf2c7e1f8 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:31.648898 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee176a-3ec3-446d-b300-0c3f16e15161 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:31.650112 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee176a-3ec3-446d-b300-0c3f16e15161 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:31.650603 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee176a-3ec3-446d-b300-0c3f16e15161 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:31.651115 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee176a-3ec3-446d-b300-0c3f16e15161 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:31.678378 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ee176a-3ec3-446d-b300-0c3f16e15161 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:31.680162 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ee176a-3ec3-446d-b300-0c3f16e15161 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:31.705575 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1194/2369] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:29:31 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:29:31.777846 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f982a-eb79-448c-b9b9-2cbb3cc15aee None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:32.082003 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f982a-eb79-448c-b9b9-2cbb3cc15aee None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:32.094332 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316fc23c-4d2a-458f-8cd9-859cefe07fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:32.095505 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316fc23c-4d2a-458f-8cd9-859cefe07fed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:32.096216 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316fc23c-4d2a-458f-8cd9-859cefe07fed admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:32.096623 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316fc23c-4d2a-458f-8cd9-859cefe07fed admin admin] PATH_INFO: `/v3/users/ce4b3d260ae3475b89d179e7e57757b8` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:32.105381 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316fc23c-4d2a-458f-8cd9-859cefe07fed admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce4b3d260ae3475b89d179e7e57757b8)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:32.107542 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316fc23c-4d2a-458f-8cd9-859cefe07fed admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:32.239101 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-316fc23c-4d2a-458f-8cd9-859cefe07fed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce4b3d260ae3475b89d179e7e57757b8'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:32.274196 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-316fc23c-4d2a-458f-8cd9-859cefe07fed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce4b3d260ae3475b89d179e7e57757b8'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:32.278463 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-316fc23c-4d2a-458f-8cd9-859cefe07fed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce4b3d260ae3475b89d179e7e57757b8'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:32.315008 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-316fc23c-4d2a-458f-8cd9-859cefe07fed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce4b3d260ae3475b89d179e7e57757b8'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:32.315915 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-316fc23c-4d2a-458f-8cd9-859cefe07fed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce4b3d260ae3475b89d179e7e57757b8'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:32.429390 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1176/2370] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:29:31 2022] DELETE /identity/v3/users/ce4b3d260ae3475b89d179e7e57757b8 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:29:32.434620 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c2f7f-f023-4d45-9c6d-92b456b7a076 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:32.435232 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c2f7f-f023-4d45-9c6d-92b456b7a076 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:32.435232 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c2f7f-f023-4d45-9c6d-92b456b7a076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:32.469304 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-046c2f7f-f023-4d45-9c6d-92b456b7a076 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:32.483632 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-046c2f7f-f023-4d45-9c6d-92b456b7a076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:32.628624 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1195/2371] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:29:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:29:32.651944 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316fc23c-4d2a-458f-8cd9-859cefe07fed admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:32.653506 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-316fc23c-4d2a-458f-8cd9-859cefe07fed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:32.708266 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:32.798505 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316fc23c-4d2a-458f-8cd9-859cefe07fed admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:32.805419 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c658f2-9e1d-460b-8be8-36de9f41fa1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:32.806825 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c658f2-9e1d-460b-8be8-36de9f41fa1b service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:32.807280 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c658f2-9e1d-460b-8be8-36de9f41fa1b service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:32.807970 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c658f2-9e1d-460b-8be8-36de9f41fa1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:32.830089 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c658f2-9e1d-460b-8be8-36de9f41fa1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:32.832081 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c658f2-9e1d-460b-8be8-36de9f41fa1b service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:32.866674 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1177/2372] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:29:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:29:33.934141 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3993b-46ca-48c0-a92c-0fe7af6ea0a8 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:33.934797 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3993b-46ca-48c0-a92c-0fe7af6ea0a8 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:33.934797 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3993b-46ca-48c0-a92c-0fe7af6ea0a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:33.998510 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-90f3993b-46ca-48c0-a92c-0fe7af6ea0a8 None None] MFA Rules not processed for user `0a7cca06668e48b19a562d06692ecf68`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:34.001090 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-90f3993b-46ca-48c0-a92c-0fe7af6ea0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:34.055049 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:34.146177 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1196/2373] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:29:33 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:29:34.165103 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c658f2-9e1d-460b-8be8-36de9f41fa1b service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:34.169037 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c7c658f2-9e1d-460b-8be8-36de9f41fa1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:34.280866 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3993b-46ca-48c0-a92c-0fe7af6ea0a8 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:34.282890 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-90f3993b-46ca-48c0-a92c-0fe7af6ea0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:34.315334 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3993b-46ca-48c0-a92c-0fe7af6ea0a8 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:34.320119 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5caf293-5447-4bd4-8736-acd04fadef7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:34.320813 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5caf293-5447-4bd4-8736-acd04fadef7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:34.321234 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5caf293-5447-4bd4-8736-acd04fadef7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:34.321389 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5caf293-5447-4bd4-8736-acd04fadef7a admin admin] PATH_INFO: `/v3/projects/ab17f8652f39468d9f4ecd0527d8a107` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:34.322583 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5caf293-5447-4bd4-8736-acd04fadef7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab17f8652f39468d9f4ecd0527d8a107)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:34.327603 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5caf293-5447-4bd4-8736-acd04fadef7a admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:34.394069 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c658f2-9e1d-460b-8be8-36de9f41fa1b service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:34.454585 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b5caf293-5447-4bd4-8736-acd04fadef7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab17f8652f39468d9f4ecd0527d8a107', 'request_id': 'req-b5caf293-5447-4bd4-8736-acd04fadef7a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:34.477490 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b5caf293-5447-4bd4-8736-acd04fadef7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab17f8652f39468d9f4ecd0527d8a107', 'request_id': 'req-b5caf293-5447-4bd4-8736-acd04fadef7a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:34.491590 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b5caf293-5447-4bd4-8736-acd04fadef7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab17f8652f39468d9f4ecd0527d8a107', 'request_id': 'req-b5caf293-5447-4bd4-8736-acd04fadef7a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:34.519496 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b5caf293-5447-4bd4-8736-acd04fadef7a admin admin] The token cache is being invalidate because project ab17f8652f39468d9f4ecd0527d8a107 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:29:34.519496 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b5caf293-5447-4bd4-8736-acd04fadef7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:34.519829 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b5caf293-5447-4bd4-8736-acd04fadef7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:34.521717 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1197/2374] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:29:34 2022] DELETE /identity/v3/projects/ab17f8652f39468d9f4ecd0527d8a107 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:29:34.530046 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5caf293-5447-4bd4-8736-acd04fadef7a admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:34.531070 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62647b19-281d-4235-82a9-899233305ec3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a399ee5db44100a88a4ffb451512aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:34.531990 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62647b19-281d-4235-82a9-899233305ec3 service glance] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:34.532562 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62647b19-281d-4235-82a9-899233305ec3 service glance] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:34.533059 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62647b19-281d-4235-82a9-899233305ec3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:34.537837 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b5caf293-5447-4bd4-8736-acd04fadef7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:34.538820 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-62647b19-281d-4235-82a9-899233305ec3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:34.638028 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62647b19-281d-4235-82a9-899233305ec3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:34.639768 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62647b19-281d-4235-82a9-899233305ec3 service glance] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:34.654836 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1178/2375] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:29:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:29:34.719075 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5caf293-5447-4bd4-8736-acd04fadef7a admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:34.724282 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7075f40-4cbb-48cf-9e52-93431c4a6bc7 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:34.724282 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7075f40-4cbb-48cf-9e52-93431c4a6bc7 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:34.724282 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7075f40-4cbb-48cf-9e52-93431c4a6bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:34.738227 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e3009-09ea-4447-9f56-d63967539daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:34.739205 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e3009-09ea-4447-9f56-d63967539daf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:34.739672 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e3009-09ea-4447-9f56-d63967539daf admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:34.740141 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e3009-09ea-4447-9f56-d63967539daf admin admin] PATH_INFO: `/v3/users/d79fe0c162c94ea099d0ca81491beb75` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:34.741817 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980e3009-09ea-4447-9f56-d63967539daf admin admin] RBAC: Authorizing `identity:delete_user(user_id=d79fe0c162c94ea099d0ca81491beb75)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:34.744108 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980e3009-09ea-4447-9f56-d63967539daf admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:34.778618 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-c7075f40-4cbb-48cf-9e52-93431c4a6bc7 None None] MFA Rules not processed for user `2264e8d00e884206aa214b88dadbe759`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:34.780107 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c7075f40-4cbb-48cf-9e52-93431c4a6bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:34.848922 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:34.880418 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-980e3009-09ea-4447-9f56-d63967539daf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd79fe0c162c94ea099d0ca81491beb75'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:34.885073 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:34.899917 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-980e3009-09ea-4447-9f56-d63967539daf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd79fe0c162c94ea099d0ca81491beb75'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:34.921123 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-980e3009-09ea-4447-9f56-d63967539daf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd79fe0c162c94ea099d0ca81491beb75'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:34.923120 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-980e3009-09ea-4447-9f56-d63967539daf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd79fe0c162c94ea099d0ca81491beb75'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:34.948553 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-980e3009-09ea-4447-9f56-d63967539daf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd79fe0c162c94ea099d0ca81491beb75'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:34.957509 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1198/2376] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:29:34 2022] DELETE /identity/v3/users/d79fe0c162c94ea099d0ca81491beb75 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:29:34.959995 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a3807f-65b9-41fd-8367-4e5a372fb71d None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:34.960722 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a3807f-65b9-41fd-8367-4e5a372fb71d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:34.961817 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a3807f-65b9-41fd-8367-4e5a372fb71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:34.986069 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-40a3807f-65b9-41fd-8367-4e5a372fb71d None None] MFA Rules not processed for user `b32922d090564162810dd8b28c3a322b`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:34.988206 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-40a3807f-65b9-41fd-8367-4e5a372fb71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:35.039071 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1179/2377] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:29:34 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:29:35.057385 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1199/2378] 10.222.0.36 () {58 vars in 1009 bytes} [Mon Aug 29 22:29:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:29:35.068956 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7075f40-4cbb-48cf-9e52-93431c4a6bc7 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:35.071952 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c7075f40-4cbb-48cf-9e52-93431c4a6bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:35.164479 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a3807f-65b9-41fd-8367-4e5a372fb71d None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:35.165938 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-40a3807f-65b9-41fd-8367-4e5a372fb71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:35.239450 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7075f40-4cbb-48cf-9e52-93431c4a6bc7 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:35.354170 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a3807f-65b9-41fd-8367-4e5a372fb71d None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:35.367381 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc680cb6-7817-43ae-b267-a888f8f6bd10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b7213b7111456a93e294ce40b95b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:35.368560 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc680cb6-7817-43ae-b267-a888f8f6bd10 service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:35.368764 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc680cb6-7817-43ae-b267-a888f8f6bd10 service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:35.369043 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc680cb6-7817-43ae-b267-a888f8f6bd10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:35.371938 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-cc680cb6-7817-43ae-b267-a888f8f6bd10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:35.390759 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c8e98-57ab-4e6d-ba0e-7c2f596d86ab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3472d8ffa748d8828c6a2d89ee7ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:35.391892 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c8e98-57ab-4e6d-ba0e-7c2f596d86ab service swift] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:35.391892 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c8e98-57ab-4e6d-ba0e-7c2f596d86ab service swift] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:35.392158 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c8e98-57ab-4e6d-ba0e-7c2f596d86ab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:35.410295 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c8e98-57ab-4e6d-ba0e-7c2f596d86ab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:35.411996 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c8e98-57ab-4e6d-ba0e-7c2f596d86ab service swift] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:35.425555 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1200/2379] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Aug 29 22:29:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 22:29:35.531278 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:35.536923 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc680cb6-7817-43ae-b267-a888f8f6bd10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:35.539982 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc680cb6-7817-43ae-b267-a888f8f6bd10 service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:35.563251 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1180/2380] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:29:35 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:29:36.328924 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c8e98-57ab-4e6d-ba0e-7c2f596d86ab service swift] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:36.331768 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-1c5c8e98-57ab-4e6d-ba0e-7c2f596d86ab service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:36.627190 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:36.649005 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c8e98-57ab-4e6d-ba0e-7c2f596d86ab service swift] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:36.669633 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf73820-c4ae-45df-b8d8-0f9887c81ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:36.670367 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf73820-c4ae-45df-b8d8-0f9887c81ab8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:36.671219 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf73820-c4ae-45df-b8d8-0f9887c81ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:36.672827 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf73820-c4ae-45df-b8d8-0f9887c81ab8 admin admin] PATH_INFO: `/v3/projects/c34e8043554342818ac8b382ce6f0db6` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:36.679816 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf73820-c4ae-45df-b8d8-0f9887c81ab8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c34e8043554342818ac8b382ce6f0db6)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:36.684530 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf73820-c4ae-45df-b8d8-0f9887c81ab8 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:36.808892 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-dbf73820-c4ae-45df-b8d8-0f9887c81ab8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c34e8043554342818ac8b382ce6f0db6', 'request_id': 'req-dbf73820-c4ae-45df-b8d8-0f9887c81ab8'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:36.835329 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-dbf73820-c4ae-45df-b8d8-0f9887c81ab8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c34e8043554342818ac8b382ce6f0db6', 'request_id': 'req-dbf73820-c4ae-45df-b8d8-0f9887c81ab8'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:36.873322 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-dbf73820-c4ae-45df-b8d8-0f9887c81ab8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c34e8043554342818ac8b382ce6f0db6', 'request_id': 'req-dbf73820-c4ae-45df-b8d8-0f9887c81ab8'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:36.907567 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-dbf73820-c4ae-45df-b8d8-0f9887c81ab8 admin admin] The token cache is being invalidate because project c34e8043554342818ac8b382ce6f0db6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:29:36.907870 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-dbf73820-c4ae-45df-b8d8-0f9887c81ab8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:36.908569 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-dbf73820-c4ae-45df-b8d8-0f9887c81ab8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:36.910697 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1201/2381] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:29:36 2022] DELETE /identity/v3/projects/c34e8043554342818ac8b382ce6f0db6 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:29:36.917757 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8c035-68a5-413e-9610-7b026744036f None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:36.918838 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8c035-68a5-413e-9610-7b026744036f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:36.919331 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8c035-68a5-413e-9610-7b026744036f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:37.020667 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-72d8c035-68a5-413e-9610-7b026744036f None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:37.022620 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-72d8c035-68a5-413e-9610-7b026744036f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:37.233704 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1181/2382] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:29:37.243828 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a34b2-2174-41d8-a02c-e397884dfad2 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:37.244601 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a34b2-2174-41d8-a02c-e397884dfad2 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:37.244926 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a34b2-2174-41d8-a02c-e397884dfad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:37.332175 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-ca2a34b2-2174-41d8-a02c-e397884dfad2 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:37.333528 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-ca2a34b2-2174-41d8-a02c-e397884dfad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:37.368629 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1202/2383] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:29:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:29:37.374435 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8c035-68a5-413e-9610-7b026744036f None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:37.392092 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8c035-68a5-413e-9610-7b026744036f None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:37.397737 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310cb603-1a87-40e4-887c-8c04c2b83881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:37.398603 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310cb603-1a87-40e4-887c-8c04c2b83881 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:37.398979 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310cb603-1a87-40e4-887c-8c04c2b83881 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:37.399553 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310cb603-1a87-40e4-887c-8c04c2b83881 admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:37.400366 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310cb603-1a87-40e4-887c-8c04c2b83881 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:29:37.400831 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310cb603-1a87-40e4-887c-8c04c2b83881 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:37.405608 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310cb603-1a87-40e4-887c-8c04c2b83881 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:37.432423 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1182/2384] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:29:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:37.436516 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a34b2-2174-41d8-a02c-e397884dfad2 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:37.458289 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a34b2-2174-41d8-a02c-e397884dfad2 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:37.486115 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22239f9-fef2-4cae-a12c-94179c8bc147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:37.486950 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22239f9-fef2-4cae-a12c-94179c8bc147 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:37.487330 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22239f9-fef2-4cae-a12c-94179c8bc147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:37.487703 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22239f9-fef2-4cae-a12c-94179c8bc147 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:37.488481 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22239f9-fef2-4cae-a12c-94179c8bc147 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:37.490674 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22239f9-fef2-4cae-a12c-94179c8bc147 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:37.620119 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1203/2385] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:29:37 2022] POST /identity/v3/projects => generated 409 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:29:37.627615 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310cb603-1a87-40e4-887c-8c04c2b83881 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:37.647021 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310cb603-1a87-40e4-887c-8c04c2b83881 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:37.798423 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903aa55e-36d3-446c-aa27-0f4a6342415d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:37.799704 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903aa55e-36d3-446c-aa27-0f4a6342415d admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:37.800343 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903aa55e-36d3-446c-aa27-0f4a6342415d admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:37.800979 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903aa55e-36d3-446c-aa27-0f4a6342415d admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:37.801530 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903aa55e-36d3-446c-aa27-0f4a6342415d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:37.806065 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903aa55e-36d3-446c-aa27-0f4a6342415d admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:37.843702 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1183/2386] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:29:37 2022] POST /identity/v3/users => generated 305 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:29:37.848246 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22239f9-fef2-4cae-a12c-94179c8bc147 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:37.879820 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22239f9-fef2-4cae-a12c-94179c8bc147 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:37.906414 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4fc35-1710-41e4-81f0-a6d4467b76c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:37.907570 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4fc35-1710-41e4-81f0-a6d4467b76c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:37.908301 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4fc35-1710-41e4-81f0-a6d4467b76c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:37.908616 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4fc35-1710-41e4-81f0-a6d4467b76c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:37.909289 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a4fc35-1710-41e4-81f0-a6d4467b76c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:37.918404 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a4fc35-1710-41e4-81f0-a6d4467b76c5 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:37.973371 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1204/2387] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:29:37.977639 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903aa55e-36d3-446c-aa27-0f4a6342415d admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:37.993091 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903aa55e-36d3-446c-aa27-0f4a6342415d admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:38.017773 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d6acaf-d374-44eb-aba9-d1e57a1d38c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:38.020060 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6acaf-d374-44eb-aba9-d1e57a1d38c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:38.032756 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6acaf-d374-44eb-aba9-d1e57a1d38c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:38.033077 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6acaf-d374-44eb-aba9-d1e57a1d38c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:38.034030 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d6acaf-d374-44eb-aba9-d1e57a1d38c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:38.040321 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d6acaf-d374-44eb-aba9-d1e57a1d38c5 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:38.099577 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1184/2388] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:29:38.104548 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4fc35-1710-41e4-81f0-a6d4467b76c5 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:38.149951 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4fc35-1710-41e4-81f0-a6d4467b76c5 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:38.185852 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c15416-584e-46cf-b8a3-005cbf4e4f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:38.186551 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c15416-584e-46cf-b8a3-005cbf4e4f41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:38.186835 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c15416-584e-46cf-b8a3-005cbf4e4f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:38.187111 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c15416-584e-46cf-b8a3-005cbf4e4f41 admin admin] PATH_INFO: `/v3/projects/447d0f4a462e4b5c989454cd9fcc3f82/users/41bfee25e15e45eb8721b2813fd5056e/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:38.231083 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c15416-584e-46cf-b8a3-005cbf4e4f41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=447d0f4a462e4b5c989454cd9fcc3f82, user_id=41bfee25e15e45eb8721b2813fd5056e, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:38.236488 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c15416-584e-46cf-b8a3-005cbf4e4f41 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:38.285760 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1205/2389] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:29:38 2022] PUT /identity/v3/projects/447d0f4a462e4b5c989454cd9fcc3f82/users/41bfee25e15e45eb8721b2813fd5056e/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:29:38.298907 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220646cd-4f3c-4e05-982d-1b33560879a0 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:38.299224 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220646cd-4f3c-4e05-982d-1b33560879a0 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:38.299507 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220646cd-4f3c-4e05-982d-1b33560879a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:38.383335 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-220646cd-4f3c-4e05-982d-1b33560879a0 None None] MFA Rules not processed for user `41bfee25e15e45eb8721b2813fd5056e`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:38.385278 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-220646cd-4f3c-4e05-982d-1b33560879a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:38.508624 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:38.565186 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1185/2390] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:29:38 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:29:38.567546 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c15416-584e-46cf-b8a3-005cbf4e4f41 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:38.824551 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c15416-584e-46cf-b8a3-005cbf4e4f41 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:38.898728 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac808d6d-b9d8-49cb-bdf7-f1b25a58f181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:38.899589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac808d6d-b9d8-49cb-bdf7-f1b25a58f181 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:38.900284 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac808d6d-b9d8-49cb-bdf7-f1b25a58f181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:38.902593 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac808d6d-b9d8-49cb-bdf7-f1b25a58f181 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:38.905718 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac808d6d-b9d8-49cb-bdf7-f1b25a58f181 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:38.917233 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac808d6d-b9d8-49cb-bdf7-f1b25a58f181 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:38.979975 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220646cd-4f3c-4e05-982d-1b33560879a0 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:38.981802 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-220646cd-4f3c-4e05-982d-1b33560879a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:39.022972 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220646cd-4f3c-4e05-982d-1b33560879a0 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:39.025451 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1206/2391] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:29:38 2022] POST /identity/v3/projects => generated 407 bytes in 458 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:29:39.047979 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac808d6d-b9d8-49cb-bdf7-f1b25a58f181 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:39.064284 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:39.268859 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc9add-88f8-47e2-bfb9-218c8f735417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:39.269726 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc9add-88f8-47e2-bfb9-218c8f735417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:39.270013 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc9add-88f8-47e2-bfb9-218c8f735417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:39.273242 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc9add-88f8-47e2-bfb9-218c8f735417 admin admin] PATH_INFO: `/v3/users/57320216642d485abd1201b81eb0eb78` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:39.277946 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc9add-88f8-47e2-bfb9-218c8f735417 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57320216642d485abd1201b81eb0eb78)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:39.279941 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc9add-88f8-47e2-bfb9-218c8f735417 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:39.336319 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac808d6d-b9d8-49cb-bdf7-f1b25a58f181 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:39.350470 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e233b-fc2d-4ea5-af81-cb63070b2a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:39.351221 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e233b-fc2d-4ea5-af81-cb63070b2a13 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:39.351556 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e233b-fc2d-4ea5-af81-cb63070b2a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:39.351834 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e233b-fc2d-4ea5-af81-cb63070b2a13 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:39.365186 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33e233b-fc2d-4ea5-af81-cb63070b2a13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:39.367345 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33e233b-fc2d-4ea5-af81-cb63070b2a13 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:39.426876 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c4fc9add-88f8-47e2-bfb9-218c8f735417 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57320216642d485abd1201b81eb0eb78'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:39.456701 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1207/2392] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:29:39 2022] POST /identity/v3/users => generated 310 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:29:39.456701 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c785f38-5a79-4974-96e0-25bafc920b7c None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:39.456701 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c785f38-5a79-4974-96e0-25bafc920b7c None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:39.456701 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c785f38-5a79-4974-96e0-25bafc920b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:39.470887 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c4fc9add-88f8-47e2-bfb9-218c8f735417 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57320216642d485abd1201b81eb0eb78'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:39.475752 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c4fc9add-88f8-47e2-bfb9-218c8f735417 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57320216642d485abd1201b81eb0eb78'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:39.499750 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c4fc9add-88f8-47e2-bfb9-218c8f735417 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57320216642d485abd1201b81eb0eb78'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:39.502957 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c4fc9add-88f8-47e2-bfb9-218c8f735417 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57320216642d485abd1201b81eb0eb78'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:39.505869 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-2c785f38-5a79-4974-96e0-25bafc920b7c None None] MFA Rules not processed for user `a54596c94fd04ea2b4ec217166292973`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:39.511478 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-2c785f38-5a79-4974-96e0-25bafc920b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:39.576359 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1186/2393] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:29:38 2022] DELETE /identity/v3/users/57320216642d485abd1201b81eb0eb78 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:29:39.577520 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc9add-88f8-47e2-bfb9-218c8f735417 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:39.579103 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c4fc9add-88f8-47e2-bfb9-218c8f735417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:39.692781 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1208/2394] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:29:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:29:39.692781 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968411d-ba13-45e7-ae2b-7f4fff47c878 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:39.692781 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968411d-ba13-45e7-ae2b-7f4fff47c878 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:39.692781 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968411d-ba13-45e7-ae2b-7f4fff47c878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:39.770443 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-3968411d-ba13-45e7-ae2b-7f4fff47c878 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:39.771712 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3968411d-ba13-45e7-ae2b-7f4fff47c878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:39.863988 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc9add-88f8-47e2-bfb9-218c8f735417 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:39.870445 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fb2d77-3e11-4842-b6c1-bfd3c612a575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:39.871087 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb2d77-3e11-4842-b6c1-bfd3c612a575 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:39.871369 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb2d77-3e11-4842-b6c1-bfd3c612a575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:39.872088 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb2d77-3e11-4842-b6c1-bfd3c612a575 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:39.872822 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fb2d77-3e11-4842-b6c1-bfd3c612a575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:39.874875 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fb2d77-3e11-4842-b6c1-bfd3c612a575 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:39.937896 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1187/2395] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:29:39.939166 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fb2d77-3e11-4842-b6c1-bfd3c612a575 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:39.967143 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fb2d77-3e11-4842-b6c1-bfd3c612a575 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:39.974891 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c1ffd-dfe6-4349-ad02-497ca34679a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:39.975683 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c1ffd-dfe6-4349-ad02-497ca34679a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:39.975866 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c1ffd-dfe6-4349-ad02-497ca34679a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:39.976143 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c1ffd-dfe6-4349-ad02-497ca34679a1 admin admin] PATH_INFO: `/v3/projects/6d8ef7a086984994835f0b060fbb497c/users/7e47b92d325d4f65add347b899288dac/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:39.981695 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:40.018948 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56c1ffd-dfe6-4349-ad02-497ca34679a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d8ef7a086984994835f0b060fbb497c, user_id=7e47b92d325d4f65add347b899288dac, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:40.030651 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56c1ffd-dfe6-4349-ad02-497ca34679a1 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:40.031559 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1209/2396] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:29:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:29:40.080959 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1188/2397] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:29:39 2022] PUT /identity/v3/projects/6d8ef7a086984994835f0b060fbb497c/users/7e47b92d325d4f65add347b899288dac/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:29:40.085929 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968411d-ba13-45e7-ae2b-7f4fff47c878 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:40.114695 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968411d-ba13-45e7-ae2b-7f4fff47c878 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:40.204052 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c1ffd-dfe6-4349-ad02-497ca34679a1 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:40.208526 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f56c1ffd-dfe6-4349-ad02-497ca34679a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:40.269279 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:40.354186 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c6a2c-bb21-44f5-9717-dddb1559ccec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:40.355087 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c6a2c-bb21-44f5-9717-dddb1559ccec admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:40.355416 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c6a2c-bb21-44f5-9717-dddb1559ccec admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:40.355796 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c6a2c-bb21-44f5-9717-dddb1559ccec admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:40.356658 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2c6a2c-bb21-44f5-9717-dddb1559ccec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:40.358308 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2c6a2c-bb21-44f5-9717-dddb1559ccec admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:40.359996 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c1ffd-dfe6-4349-ad02-497ca34679a1 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:40.377690 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c5b7ef-8cb9-478e-92a6-529dfba20fca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:40.378776 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5b7ef-8cb9-478e-92a6-529dfba20fca service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:40.379104 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5b7ef-8cb9-478e-92a6-529dfba20fca service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:40.379375 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5b7ef-8cb9-478e-92a6-529dfba20fca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:40.388163 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1210/2398] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:29:40.394530 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c6a2c-bb21-44f5-9717-dddb1559ccec admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:40.407565 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c5b7ef-8cb9-478e-92a6-529dfba20fca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:40.409102 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c5b7ef-8cb9-478e-92a6-529dfba20fca service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:40.414295 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c6a2c-bb21-44f5-9717-dddb1559ccec admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:40.426385 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34852cd3-1aa2-427a-9a31-b6e459d1e647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:40.428321 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34852cd3-1aa2-427a-9a31-b6e459d1e647 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:40.430402 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34852cd3-1aa2-427a-9a31-b6e459d1e647 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:40.431970 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34852cd3-1aa2-427a-9a31-b6e459d1e647 admin admin] PATH_INFO: `/v3/projects/6d8ef7a086984994835f0b060fbb497c/users/7e47b92d325d4f65add347b899288dac/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:40.435417 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1189/2399] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:29:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:29:40.447838 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34852cd3-1aa2-427a-9a31-b6e459d1e647 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d8ef7a086984994835f0b060fbb497c, user_id=7e47b92d325d4f65add347b899288dac, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:40.456112 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34852cd3-1aa2-427a-9a31-b6e459d1e647 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:40.504998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1211/2400] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:29:40 2022] PUT /identity/v3/projects/6d8ef7a086984994835f0b060fbb497c/users/7e47b92d325d4f65add347b899288dac/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:29:40.507982 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78718f7-f3f4-4fbd-bec2-8defde57a180 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:40.508535 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78718f7-f3f4-4fbd-bec2-8defde57a180 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:40.508981 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78718f7-f3f4-4fbd-bec2-8defde57a180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:40.571579 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-c78718f7-f3f4-4fbd-bec2-8defde57a180 None None] MFA Rules not processed for user `7e47b92d325d4f65add347b899288dac`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:40.573867 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c78718f7-f3f4-4fbd-bec2-8defde57a180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:40.765600 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1190/2401] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:29:40 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:29:40.772587 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34852cd3-1aa2-427a-9a31-b6e459d1e647 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:40.786543 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-34852cd3-1aa2-427a-9a31-b6e459d1e647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:40.915812 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34852cd3-1aa2-427a-9a31-b6e459d1e647 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:40.922556 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764c9e2-b09c-48f9-9986-bb55953ccff6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:40.923426 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764c9e2-b09c-48f9-9986-bb55953ccff6 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:40.926085 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764c9e2-b09c-48f9-9986-bb55953ccff6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:40.926400 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764c9e2-b09c-48f9-9986-bb55953ccff6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:40.997600 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0764c9e2-b09c-48f9-9986-bb55953ccff6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:40.999114 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0764c9e2-b09c-48f9-9986-bb55953ccff6 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:41.046407 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1212/2402] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:29:40 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:29:41.303026 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78718f7-f3f4-4fbd-bec2-8defde57a180 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:41.305400 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c78718f7-f3f4-4fbd-bec2-8defde57a180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:41.552832 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764c9e2-b09c-48f9-9986-bb55953ccff6 service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:41.563904 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764c9e2-b09c-48f9-9986-bb55953ccff6 service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:41.574718 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78718f7-f3f4-4fbd-bec2-8defde57a180 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:41.582052 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7e615-a04d-4070-a686-143a25c3771d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:41.582790 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7e615-a04d-4070-a686-143a25c3771d service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:41.583064 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7e615-a04d-4070-a686-143a25c3771d service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:41.584638 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7e615-a04d-4070-a686-143a25c3771d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:41.592761 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-9ac7e615-a04d-4070-a686-143a25c3771d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:41.598696 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2c21d-c633-4e31-997c-8d57ec275241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:41.599404 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2c21d-c633-4e31-997c-8d57ec275241 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:41.600691 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2c21d-c633-4e31-997c-8d57ec275241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:41.600995 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2c21d-c633-4e31-997c-8d57ec275241 admin admin] PATH_INFO: `/v3/projects/92d283c0db804a5c8537d708307dd6d2` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:41.606369 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2c21d-c633-4e31-997c-8d57ec275241 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92d283c0db804a5c8537d708307dd6d2)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:41.614456 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2c21d-c633-4e31-997c-8d57ec275241 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:41.666469 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:41.750085 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4cc2c21d-c633-4e31-997c-8d57ec275241 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92d283c0db804a5c8537d708307dd6d2', 'request_id': 'req-4cc2c21d-c633-4e31-997c-8d57ec275241'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:41.759106 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4cc2c21d-c633-4e31-997c-8d57ec275241 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92d283c0db804a5c8537d708307dd6d2', 'request_id': 'req-4cc2c21d-c633-4e31-997c-8d57ec275241'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:41.791556 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac7e615-a04d-4070-a686-143a25c3771d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:41.795999 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac7e615-a04d-4070-a686-143a25c3771d service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:41.796421 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4cc2c21d-c633-4e31-997c-8d57ec275241 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92d283c0db804a5c8537d708307dd6d2', 'request_id': 'req-4cc2c21d-c633-4e31-997c-8d57ec275241'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:41.820127 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4cc2c21d-c633-4e31-997c-8d57ec275241 admin admin] The token cache is being invalidate because project 92d283c0db804a5c8537d708307dd6d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:29:41.821362 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4cc2c21d-c633-4e31-997c-8d57ec275241 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:41.822463 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4cc2c21d-c633-4e31-997c-8d57ec275241 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:41.825747 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1191/2403] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:29:41 2022] DELETE /identity/v3/projects/92d283c0db804a5c8537d708307dd6d2 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:29:41.835733 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8757e-5430-4daa-ad7f-7ef97bba7145 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:41.836372 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8757e-5430-4daa-ad7f-7ef97bba7145 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:41.836889 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8757e-5430-4daa-ad7f-7ef97bba7145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:41.846328 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1213/2404] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:29:41 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:29:41.871577 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-0cc8757e-5430-4daa-ad7f-7ef97bba7145 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:41.873265 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-0cc8757e-5430-4daa-ad7f-7ef97bba7145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:42.017444 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1192/2405] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:29:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:29:42.028769 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad00bcc-b6de-472f-b499-5003ce6c969d None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:42.029693 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad00bcc-b6de-472f-b499-5003ce6c969d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:42.030410 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad00bcc-b6de-472f-b499-5003ce6c969d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:42.071777 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-dad00bcc-b6de-472f-b499-5003ce6c969d None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:42.077760 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-dad00bcc-b6de-472f-b499-5003ce6c969d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:42.089980 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1214/2406] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:29:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:29:42.094776 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8757e-5430-4daa-ad7f-7ef97bba7145 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:42.111356 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8757e-5430-4daa-ad7f-7ef97bba7145 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:42.118623 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea61afe8-1a0f-46b7-9b2c-fa9f530286b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:42.120916 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61afe8-1a0f-46b7-9b2c-fa9f530286b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:42.122025 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61afe8-1a0f-46b7-9b2c-fa9f530286b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:42.123858 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61afe8-1a0f-46b7-9b2c-fa9f530286b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:42.125231 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea61afe8-1a0f-46b7-9b2c-fa9f530286b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:29:42.126545 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea61afe8-1a0f-46b7-9b2c-fa9f530286b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:42.135470 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea61afe8-1a0f-46b7-9b2c-fa9f530286b2 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:42.154389 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1193/2407] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:29:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:42.159750 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad00bcc-b6de-472f-b499-5003ce6c969d None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:42.188771 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad00bcc-b6de-472f-b499-5003ce6c969d None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:42.205148 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d1d99-f87b-4da3-833f-840b92adcc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:42.205980 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d1d99-f87b-4da3-833f-840b92adcc47 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:42.206358 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d1d99-f87b-4da3-833f-840b92adcc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:42.206724 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d1d99-f87b-4da3-833f-840b92adcc47 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:42.209144 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9d1d99-f87b-4da3-833f-840b92adcc47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:42.213954 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9d1d99-f87b-4da3-833f-840b92adcc47 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:42.294363 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1215/2408] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:29:42 2022] POST /identity/v3/projects => generated 375 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:29:42.299590 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea61afe8-1a0f-46b7-9b2c-fa9f530286b2 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:42.336520 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea61afe8-1a0f-46b7-9b2c-fa9f530286b2 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:42.442175 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e40d90e-c01f-49cc-8c9a-cfa729ed4eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:42.443493 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40d90e-c01f-49cc-8c9a-cfa729ed4eab admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:42.443854 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40d90e-c01f-49cc-8c9a-cfa729ed4eab admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:42.444134 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40d90e-c01f-49cc-8c9a-cfa729ed4eab admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:42.444975 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e40d90e-c01f-49cc-8c9a-cfa729ed4eab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:42.447620 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e40d90e-c01f-49cc-8c9a-cfa729ed4eab admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:42.529636 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1194/2409] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:29:42 2022] POST /identity/v3/users => generated 288 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:29:42.535783 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d1d99-f87b-4da3-833f-840b92adcc47 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:42.571918 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d1d99-f87b-4da3-833f-840b92adcc47 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:42.588876 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b12d74-5656-4aa3-a027-78959f497613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:42.592408 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b12d74-5656-4aa3-a027-78959f497613 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:42.592938 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b12d74-5656-4aa3-a027-78959f497613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:42.593828 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b12d74-5656-4aa3-a027-78959f497613 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:42.597164 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b12d74-5656-4aa3-a027-78959f497613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:42.599372 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b12d74-5656-4aa3-a027-78959f497613 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:42.634470 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1216/2410] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:29:42.638533 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e40d90e-c01f-49cc-8c9a-cfa729ed4eab admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:42.658343 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e40d90e-c01f-49cc-8c9a-cfa729ed4eab admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:42.678686 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae0ecf4-df13-480a-8b3b-d73310fb3914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:42.683520 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae0ecf4-df13-480a-8b3b-d73310fb3914 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:42.684033 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae0ecf4-df13-480a-8b3b-d73310fb3914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:42.684400 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae0ecf4-df13-480a-8b3b-d73310fb3914 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:42.686341 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae0ecf4-df13-480a-8b3b-d73310fb3914 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:42.693944 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae0ecf4-df13-480a-8b3b-d73310fb3914 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:42.746139 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1195/2411] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:29:42.755913 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b12d74-5656-4aa3-a027-78959f497613 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:42.803083 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b12d74-5656-4aa3-a027-78959f497613 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:42.814784 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c43b68e-1f75-47f2-9fff-483bfa4b0ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:42.817925 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43b68e-1f75-47f2-9fff-483bfa4b0ab4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:42.818211 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43b68e-1f75-47f2-9fff-483bfa4b0ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:42.818489 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43b68e-1f75-47f2-9fff-483bfa4b0ab4 admin admin] PATH_INFO: `/v3/projects/445d5b5fffe14050a9615782032dc8bf/users/9dd813748e8a40b598195785d53d1792/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:42.886826 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c43b68e-1f75-47f2-9fff-483bfa4b0ab4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=445d5b5fffe14050a9615782032dc8bf, user_id=9dd813748e8a40b598195785d53d1792, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:42.889762 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c43b68e-1f75-47f2-9fff-483bfa4b0ab4 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:42.925058 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1217/2412] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:29:42 2022] PUT /identity/v3/projects/445d5b5fffe14050a9615782032dc8bf/users/9dd813748e8a40b598195785d53d1792/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:29:42.939837 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d278b73-544c-4360-bebf-f81acc0b2d90 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:42.941678 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d278b73-544c-4360-bebf-f81acc0b2d90 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:42.942164 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d278b73-544c-4360-bebf-f81acc0b2d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:42.974911 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:43.031307 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-3d278b73-544c-4360-bebf-f81acc0b2d90 None None] MFA Rules not processed for user `9dd813748e8a40b598195785d53d1792`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:43.034439 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-3d278b73-544c-4360-bebf-f81acc0b2d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:43.085700 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0a906-7f87-43c5-a3d9-d64c43b51ec1 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:43.086246 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0a906-7f87-43c5-a3d9-d64c43b51ec1 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:43.086792 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0a906-7f87-43c5-a3d9-d64c43b51ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:43.115431 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:43.127154 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-98a0a906-7f87-43c5-a3d9-d64c43b51ec1 None None] MFA Rules not processed for user `bef91a59d5a343d886ac09ae35d7c10e`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:43.128778 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-98a0a906-7f87-43c5-a3d9-d64c43b51ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:43.232612 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1218/2413] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:29:43 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:29:43.324709 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1196/2414] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:29:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:29:43.325768 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0a906-7f87-43c5-a3d9-d64c43b51ec1 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:43.330582 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-98a0a906-7f87-43c5-a3d9-d64c43b51ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:43.463567 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0a906-7f87-43c5-a3d9-d64c43b51ec1 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:43.469040 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2522a1-cf89-40ab-8705-160fa4f317f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:43.469939 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2522a1-cf89-40ab-8705-160fa4f317f1 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:43.470283 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2522a1-cf89-40ab-8705-160fa4f317f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:43.470620 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2522a1-cf89-40ab-8705-160fa4f317f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:43.485413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2522a1-cf89-40ab-8705-160fa4f317f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:43.487381 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2522a1-cf89-40ab-8705-160fa4f317f1 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:43.500118 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1219/2415] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:29:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:29:49.028675 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d278b73-544c-4360-bebf-f81acc0b2d90 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:49.030156 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-3d278b73-544c-4360-bebf-f81acc0b2d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:49.191198 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d278b73-544c-4360-bebf-f81acc0b2d90 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:49.207520 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d2958-91c2-4f77-83d1-3ab009462486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:49.208220 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d2958-91c2-4f77-83d1-3ab009462486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:49.208533 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d2958-91c2-4f77-83d1-3ab009462486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:49.208802 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d2958-91c2-4f77-83d1-3ab009462486 admin admin] PATH_INFO: `/v3/users/41bfee25e15e45eb8721b2813fd5056e` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:49.210093 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2d2958-91c2-4f77-83d1-3ab009462486 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41bfee25e15e45eb8721b2813fd5056e)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:49.212639 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2d2958-91c2-4f77-83d1-3ab009462486 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:49.300213 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-0c2d2958-91c2-4f77-83d1-3ab009462486 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41bfee25e15e45eb8721b2813fd5056e'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:49.331028 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-0c2d2958-91c2-4f77-83d1-3ab009462486 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41bfee25e15e45eb8721b2813fd5056e'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:49.332231 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-0c2d2958-91c2-4f77-83d1-3ab009462486 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41bfee25e15e45eb8721b2813fd5056e'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:49.344341 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-0c2d2958-91c2-4f77-83d1-3ab009462486 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41bfee25e15e45eb8721b2813fd5056e'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:49.345849 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-0c2d2958-91c2-4f77-83d1-3ab009462486 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41bfee25e15e45eb8721b2813fd5056e'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:49.388045 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1197/2416] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:29:49 2022] DELETE /identity/v3/users/41bfee25e15e45eb8721b2813fd5056e => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:29:49.394694 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af42d5b-53ba-43e6-982f-04a3e8e84df8 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:49.395591 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af42d5b-53ba-43e6-982f-04a3e8e84df8 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:49.395591 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af42d5b-53ba-43e6-982f-04a3e8e84df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:49.433677 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-4af42d5b-53ba-43e6-982f-04a3e8e84df8 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:49.435306 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-4af42d5b-53ba-43e6-982f-04a3e8e84df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:49.596432 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1220/2417] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:29:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:29:49.616900 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d2958-91c2-4f77-83d1-3ab009462486 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:49.616900 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-0c2d2958-91c2-4f77-83d1-3ab009462486 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:49.670180 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:49.873953 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d2958-91c2-4f77-83d1-3ab009462486 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:49.879845 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0563473-8078-490b-9321-a066d113bf17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:49.881251 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0563473-8078-490b-9321-a066d113bf17 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:49.881772 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0563473-8078-490b-9321-a066d113bf17 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:49.882295 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0563473-8078-490b-9321-a066d113bf17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:49.927973 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0563473-8078-490b-9321-a066d113bf17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:49.933707 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0563473-8078-490b-9321-a066d113bf17 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:49.980915 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1198/2418] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:29:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:29:51.121994 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af42d5b-53ba-43e6-982f-04a3e8e84df8 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:51.125057 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-4af42d5b-53ba-43e6-982f-04a3e8e84df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:51.161844 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af42d5b-53ba-43e6-982f-04a3e8e84df8 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:51.172747 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf325c1-fab2-4fed-96f4-6cf80b8d1777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:51.174122 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf325c1-fab2-4fed-96f4-6cf80b8d1777 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:51.175431 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf325c1-fab2-4fed-96f4-6cf80b8d1777 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:51.176089 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf325c1-fab2-4fed-96f4-6cf80b8d1777 admin admin] PATH_INFO: `/v3/projects/447d0f4a462e4b5c989454cd9fcc3f82` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:51.178184 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf325c1-fab2-4fed-96f4-6cf80b8d1777 admin admin] RBAC: Authorizing `identity:delete_project(project_id=447d0f4a462e4b5c989454cd9fcc3f82)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:51.181451 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf325c1-fab2-4fed-96f4-6cf80b8d1777 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:51.310249 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:51.320747 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-dcf325c1-fab2-4fed-96f4-6cf80b8d1777 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '447d0f4a462e4b5c989454cd9fcc3f82', 'request_id': 'req-dcf325c1-fab2-4fed-96f4-6cf80b8d1777'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:51.343701 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-dcf325c1-fab2-4fed-96f4-6cf80b8d1777 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '447d0f4a462e4b5c989454cd9fcc3f82', 'request_id': 'req-dcf325c1-fab2-4fed-96f4-6cf80b8d1777'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:51.359830 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-dcf325c1-fab2-4fed-96f4-6cf80b8d1777 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '447d0f4a462e4b5c989454cd9fcc3f82', 'request_id': 'req-dcf325c1-fab2-4fed-96f4-6cf80b8d1777'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:51.395392 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-dcf325c1-fab2-4fed-96f4-6cf80b8d1777 admin admin] The token cache is being invalidate because project 447d0f4a462e4b5c989454cd9fcc3f82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:29:51.396412 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-dcf325c1-fab2-4fed-96f4-6cf80b8d1777 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:51.400395 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-dcf325c1-fab2-4fed-96f4-6cf80b8d1777 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:51.408782 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1221/2419] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:29:51 2022] DELETE /identity/v3/projects/447d0f4a462e4b5c989454cd9fcc3f82 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:29:51.412635 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0563473-8078-490b-9321-a066d113bf17 service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:51.427095 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0563473-8078-490b-9321-a066d113bf17 service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:51.583462 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543b065-f3af-4517-a8d4-bb5afc923e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:51.584574 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543b065-f3af-4517-a8d4-bb5afc923e07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:51.585073 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543b065-f3af-4517-a8d4-bb5afc923e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:51.585711 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543b065-f3af-4517-a8d4-bb5afc923e07 admin admin] PATH_INFO: `/v3/users/7e47b92d325d4f65add347b899288dac` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:51.595860 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f543b065-f3af-4517-a8d4-bb5afc923e07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e47b92d325d4f65add347b899288dac)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:51.599420 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f543b065-f3af-4517-a8d4-bb5afc923e07 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:51.732747 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f543b065-f3af-4517-a8d4-bb5afc923e07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e47b92d325d4f65add347b899288dac'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:51.779054 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f543b065-f3af-4517-a8d4-bb5afc923e07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e47b92d325d4f65add347b899288dac'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:51.782339 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f543b065-f3af-4517-a8d4-bb5afc923e07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e47b92d325d4f65add347b899288dac'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:51.811497 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f543b065-f3af-4517-a8d4-bb5afc923e07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e47b92d325d4f65add347b899288dac'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:51.812798 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f543b065-f3af-4517-a8d4-bb5afc923e07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e47b92d325d4f65add347b899288dac'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:51.927637 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1199/2420] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:29:51 2022] DELETE /identity/v3/users/7e47b92d325d4f65add347b899288dac => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:29:52.895599 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf325c1-fab2-4fed-96f4-6cf80b8d1777 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:52.897862 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-dcf325c1-fab2-4fed-96f4-6cf80b8d1777 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:52.952768 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf325c1-fab2-4fed-96f4-6cf80b8d1777 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:53.040439 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f9f3f-2ecc-4f10-b911-a9bb76145ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:53.041771 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f9f3f-2ecc-4f10-b911-a9bb76145ad9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:53.042405 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f9f3f-2ecc-4f10-b911-a9bb76145ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:53.043178 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f9f3f-2ecc-4f10-b911-a9bb76145ad9 admin admin] PATH_INFO: `/v3/projects/6d8ef7a086984994835f0b060fbb497c` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:53.045257 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89f9f3f-2ecc-4f10-b911-a9bb76145ad9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d8ef7a086984994835f0b060fbb497c)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:53.049994 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89f9f3f-2ecc-4f10-b911-a9bb76145ad9 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:53.184365 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b89f9f3f-2ecc-4f10-b911-a9bb76145ad9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d8ef7a086984994835f0b060fbb497c', 'request_id': 'req-b89f9f3f-2ecc-4f10-b911-a9bb76145ad9'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:53.197460 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b89f9f3f-2ecc-4f10-b911-a9bb76145ad9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d8ef7a086984994835f0b060fbb497c', 'request_id': 'req-b89f9f3f-2ecc-4f10-b911-a9bb76145ad9'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:53.212548 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b89f9f3f-2ecc-4f10-b911-a9bb76145ad9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d8ef7a086984994835f0b060fbb497c', 'request_id': 'req-b89f9f3f-2ecc-4f10-b911-a9bb76145ad9'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:53.252600 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b89f9f3f-2ecc-4f10-b911-a9bb76145ad9 admin admin] The token cache is being invalidate because project 6d8ef7a086984994835f0b060fbb497c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:29:53.253147 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b89f9f3f-2ecc-4f10-b911-a9bb76145ad9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:53.260913 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b89f9f3f-2ecc-4f10-b911-a9bb76145ad9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:53.264151 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1222/2421] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:29:52 2022] DELETE /identity/v3/projects/6d8ef7a086984994835f0b060fbb497c => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:29:53.270620 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bbbb82-3b10-4677-8fce-ef282eeb5359 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:53.271363 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bbbb82-3b10-4677-8fce-ef282eeb5359 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:53.271961 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bbbb82-3b10-4677-8fce-ef282eeb5359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:53.320148 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-63bbbb82-3b10-4677-8fce-ef282eeb5359 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:53.322109 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-63bbbb82-3b10-4677-8fce-ef282eeb5359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:53.374497 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:53.422252 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1200/2422] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:29:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:29:53.431567 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225a8e9-05d7-4e25-8ced-91f946a8c43c None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:53.431961 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225a8e9-05d7-4e25-8ced-91f946a8c43c None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:53.432336 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225a8e9-05d7-4e25-8ced-91f946a8c43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:53.471024 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-2225a8e9-05d7-4e25-8ced-91f946a8c43c None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:53.472522 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-2225a8e9-05d7-4e25-8ced-91f946a8c43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:53.482517 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1223/2423] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:29:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:29:53.487874 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bbbb82-3b10-4677-8fce-ef282eeb5359 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:53.504339 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bbbb82-3b10-4677-8fce-ef282eeb5359 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:53.513908 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55275520-08a0-409a-8ee2-458ff610dd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:53.515041 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55275520-08a0-409a-8ee2-458ff610dd47 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:53.515522 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55275520-08a0-409a-8ee2-458ff610dd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:53.515994 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55275520-08a0-409a-8ee2-458ff610dd47 admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:53.518235 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55275520-08a0-409a-8ee2-458ff610dd47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:29:53.518808 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55275520-08a0-409a-8ee2-458ff610dd47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:53.522362 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55275520-08a0-409a-8ee2-458ff610dd47 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:53.542952 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1201/2424] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:29:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:53.543966 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2225a8e9-05d7-4e25-8ced-91f946a8c43c None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:53.568141 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2225a8e9-05d7-4e25-8ced-91f946a8c43c None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:53.575765 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5b3d7-850b-4b67-92ad-28e8ebe4983a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:53.577207 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5b3d7-850b-4b67-92ad-28e8ebe4983a admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:53.577914 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5b3d7-850b-4b67-92ad-28e8ebe4983a admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:53.578682 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5b3d7-850b-4b67-92ad-28e8ebe4983a admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:53.580098 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c5b3d7-850b-4b67-92ad-28e8ebe4983a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:53.583780 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c5b3d7-850b-4b67-92ad-28e8ebe4983a admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:53.652562 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55275520-08a0-409a-8ee2-458ff610dd47 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:53.684562 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1224/2425] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:29:53 2022] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:29:53.685051 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55275520-08a0-409a-8ee2-458ff610dd47 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:53.877818 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd671ce-1d0b-450a-8770-2e79c68d8f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:53.879002 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd671ce-1d0b-450a-8770-2e79c68d8f23 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:53.879302 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd671ce-1d0b-450a-8770-2e79c68d8f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:53.879747 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd671ce-1d0b-450a-8770-2e79c68d8f23 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:53.881150 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd671ce-1d0b-450a-8770-2e79c68d8f23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:53.885879 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd671ce-1d0b-450a-8770-2e79c68d8f23 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:53.949311 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1202/2426] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:29:53 2022] POST /identity/v3/users => generated 292 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:29:53.955230 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5b3d7-850b-4b67-92ad-28e8ebe4983a admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:53.990547 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5b3d7-850b-4b67-92ad-28e8ebe4983a admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:54.009730 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10cc49-75a7-476c-a6a6-230084c73bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:54.011150 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10cc49-75a7-476c-a6a6-230084c73bf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:54.011799 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10cc49-75a7-476c-a6a6-230084c73bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:54.012331 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10cc49-75a7-476c-a6a6-230084c73bf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:54.016235 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a10cc49-75a7-476c-a6a6-230084c73bf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:54.021901 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a10cc49-75a7-476c-a6a6-230084c73bf8 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:54.052626 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1225/2427] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:29:54.054457 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd671ce-1d0b-450a-8770-2e79c68d8f23 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:54.066286 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3564f56-1559-47fc-8da8-0708c3e62923 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:54.067288 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3564f56-1559-47fc-8da8-0708c3e62923 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:54.067894 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3564f56-1559-47fc-8da8-0708c3e62923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:54.068529 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd671ce-1d0b-450a-8770-2e79c68d8f23 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:54.077314 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468346d-3ee9-49ae-8ab1-4860f9890302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:54.078052 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468346d-3ee9-49ae-8ab1-4860f9890302 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:54.078489 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468346d-3ee9-49ae-8ab1-4860f9890302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:54.078797 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468346d-3ee9-49ae-8ab1-4860f9890302 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:54.079903 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e468346d-3ee9-49ae-8ab1-4860f9890302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:54.082959 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e468346d-3ee9-49ae-8ab1-4860f9890302 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:54.097594 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-a3564f56-1559-47fc-8da8-0708c3e62923 None None] MFA Rules not processed for user `d9d3c8d364c3460b86280682221cca46`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:54.098092 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1203/2428] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:29:54.100506 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a3564f56-1559-47fc-8da8-0708c3e62923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:54.104525 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468346d-3ee9-49ae-8ab1-4860f9890302 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:54.116471 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468346d-3ee9-49ae-8ab1-4860f9890302 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:54.122882 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7909504-1926-4e7c-898d-07a7c5192006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:54.123592 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7909504-1926-4e7c-898d-07a7c5192006 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:54.123872 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7909504-1926-4e7c-898d-07a7c5192006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:54.124143 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7909504-1926-4e7c-898d-07a7c5192006 admin admin] PATH_INFO: `/v3/projects/f30f32ef94e04214bb9ec6ca21d3cb62/users/1f84af712c884d08a18fe85ec2d0b980/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:54.138724 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:54.143409 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7909504-1926-4e7c-898d-07a7c5192006 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f30f32ef94e04214bb9ec6ca21d3cb62, user_id=1f84af712c884d08a18fe85ec2d0b980, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:54.146845 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7909504-1926-4e7c-898d-07a7c5192006 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:54.190072 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1204/2429] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:29:54 2022] PUT /identity/v3/projects/f30f32ef94e04214bb9ec6ca21d3cb62/users/1f84af712c884d08a18fe85ec2d0b980/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:29:54.192037 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5769d52-501d-40af-afa3-cd2c7da1c5cc None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:54.192378 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5769d52-501d-40af-afa3-cd2c7da1c5cc None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:54.194898 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5769d52-501d-40af-afa3-cd2c7da1c5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:54.205024 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1226/2430] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:29:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:29:54.252080 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-f5769d52-501d-40af-afa3-cd2c7da1c5cc None None] MFA Rules not processed for user `1f84af712c884d08a18fe85ec2d0b980`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:54.254216 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f5769d52-501d-40af-afa3-cd2c7da1c5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:54.374172 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1205/2431] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:29:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:29:54.388473 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3564f56-1559-47fc-8da8-0708c3e62923 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:54.390047 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a3564f56-1559-47fc-8da8-0708c3e62923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:54.469885 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3564f56-1559-47fc-8da8-0708c3e62923 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:54.531747 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1276a8-2c29-496e-a98d-ccfe15f1727a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:54.532609 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1276a8-2c29-496e-a98d-ccfe15f1727a service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:54.532793 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1276a8-2c29-496e-a98d-ccfe15f1727a service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:54.533030 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1276a8-2c29-496e-a98d-ccfe15f1727a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:54.542641 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1276a8-2c29-496e-a98d-ccfe15f1727a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:54.544194 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1276a8-2c29-496e-a98d-ccfe15f1727a service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:54.554776 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1227/2432] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:29:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:29:54.574173 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5769d52-501d-40af-afa3-cd2c7da1c5cc None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:54.584551 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:54.648299 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5769d52-501d-40af-afa3-cd2c7da1c5cc None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:54.652958 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88672c07-20db-49e7-bdab-35602d8a2ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:54.653633 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88672c07-20db-49e7-bdab-35602d8a2ab8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:54.653910 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88672c07-20db-49e7-bdab-35602d8a2ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:54.654189 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88672c07-20db-49e7-bdab-35602d8a2ab8 admin admin] PATH_INFO: `/v3/users/1f84af712c884d08a18fe85ec2d0b980` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:54.655311 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88672c07-20db-49e7-bdab-35602d8a2ab8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f84af712c884d08a18fe85ec2d0b980)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:54.657550 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88672c07-20db-49e7-bdab-35602d8a2ab8 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:54.712414 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-88672c07-20db-49e7-bdab-35602d8a2ab8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f84af712c884d08a18fe85ec2d0b980'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:54.719848 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-88672c07-20db-49e7-bdab-35602d8a2ab8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f84af712c884d08a18fe85ec2d0b980'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:54.720625 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-88672c07-20db-49e7-bdab-35602d8a2ab8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f84af712c884d08a18fe85ec2d0b980'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:54.729089 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-88672c07-20db-49e7-bdab-35602d8a2ab8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f84af712c884d08a18fe85ec2d0b980'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:54.729698 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-88672c07-20db-49e7-bdab-35602d8a2ab8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f84af712c884d08a18fe85ec2d0b980'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:54.747949 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1206/2433] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:29:54 2022] DELETE /identity/v3/users/1f84af712c884d08a18fe85ec2d0b980 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:29:54.752816 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708bb08c-d159-473a-81a1-c6416496e7d1 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:54.753130 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708bb08c-d159-473a-81a1-c6416496e7d1 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:54.753483 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708bb08c-d159-473a-81a1-c6416496e7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:54.775891 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-708bb08c-d159-473a-81a1-c6416496e7d1 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:54.777995 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-708bb08c-d159-473a-81a1-c6416496e7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:54.868216 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1228/2434] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:29:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:29:54.882496 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88672c07-20db-49e7-bdab-35602d8a2ab8 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:54.884299 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-88672c07-20db-49e7-bdab-35602d8a2ab8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:55.002216 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88672c07-20db-49e7-bdab-35602d8a2ab8 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:55.007876 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140cfd3d-5070-43d6-a578-b48a74fbf419 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:55.008795 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140cfd3d-5070-43d6-a578-b48a74fbf419 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:55.009166 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140cfd3d-5070-43d6-a578-b48a74fbf419 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:55.009565 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140cfd3d-5070-43d6-a578-b48a74fbf419 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:55.037603 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140cfd3d-5070-43d6-a578-b48a74fbf419 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:55.039092 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140cfd3d-5070-43d6-a578-b48a74fbf419 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:55.050777 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1207/2435] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:29:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:29:55.474941 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708bb08c-d159-473a-81a1-c6416496e7d1 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:55.478862 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-708bb08c-d159-473a-81a1-c6416496e7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:55.515263 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708bb08c-d159-473a-81a1-c6416496e7d1 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:55.522679 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74791df-d7f1-4cac-a82d-20eeedf8339e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:55.523624 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74791df-d7f1-4cac-a82d-20eeedf8339e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:55.523971 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74791df-d7f1-4cac-a82d-20eeedf8339e admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:55.524463 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74791df-d7f1-4cac-a82d-20eeedf8339e admin admin] PATH_INFO: `/v3/projects/f30f32ef94e04214bb9ec6ca21d3cb62` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:55.525805 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74791df-d7f1-4cac-a82d-20eeedf8339e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f30f32ef94e04214bb9ec6ca21d3cb62)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:55.527863 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74791df-d7f1-4cac-a82d-20eeedf8339e admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:55.579624 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:55.615257 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f74791df-d7f1-4cac-a82d-20eeedf8339e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f30f32ef94e04214bb9ec6ca21d3cb62', 'request_id': 'req-f74791df-d7f1-4cac-a82d-20eeedf8339e'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:55.624684 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f74791df-d7f1-4cac-a82d-20eeedf8339e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f30f32ef94e04214bb9ec6ca21d3cb62', 'request_id': 'req-f74791df-d7f1-4cac-a82d-20eeedf8339e'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:55.633344 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f74791df-d7f1-4cac-a82d-20eeedf8339e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f30f32ef94e04214bb9ec6ca21d3cb62', 'request_id': 'req-f74791df-d7f1-4cac-a82d-20eeedf8339e'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:55.652833 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f74791df-d7f1-4cac-a82d-20eeedf8339e admin admin] The token cache is being invalidate because project f30f32ef94e04214bb9ec6ca21d3cb62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:29:55.653527 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f74791df-d7f1-4cac-a82d-20eeedf8339e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:55.655905 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f74791df-d7f1-4cac-a82d-20eeedf8339e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:55.659400 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1229/2436] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:29:55 2022] DELETE /identity/v3/projects/f30f32ef94e04214bb9ec6ca21d3cb62 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:29:55.666965 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766f0dc-0088-410b-aca2-7ec69023a6fe None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:55.667942 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766f0dc-0088-410b-aca2-7ec69023a6fe None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:55.668489 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766f0dc-0088-410b-aca2-7ec69023a6fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:55.694292 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-a766f0dc-0088-410b-aca2-7ec69023a6fe None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:55.695673 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-a766f0dc-0088-410b-aca2-7ec69023a6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:55.738228 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:55.820485 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1208/2437] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:29:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:29:55.827529 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f145d2d-0fda-4686-a5ac-875951b3c2fa None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:55.829403 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f145d2d-0fda-4686-a5ac-875951b3c2fa None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:55.829797 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f145d2d-0fda-4686-a5ac-875951b3c2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:55.858995 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-0f145d2d-0fda-4686-a5ac-875951b3c2fa None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:55.860845 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-0f145d2d-0fda-4686-a5ac-875951b3c2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:55.873246 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1230/2438] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:29:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:29:55.879375 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766f0dc-0088-410b-aca2-7ec69023a6fe None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:55.896180 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766f0dc-0088-410b-aca2-7ec69023a6fe None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:55.914541 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807229e8-c7bc-47d3-805a-0073d7a91fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:55.914541 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807229e8-c7bc-47d3-805a-0073d7a91fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:55.914541 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807229e8-c7bc-47d3-805a-0073d7a91fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:55.916278 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807229e8-c7bc-47d3-805a-0073d7a91fa7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:55.916278 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807229e8-c7bc-47d3-805a-0073d7a91fa7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:29:55.916278 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807229e8-c7bc-47d3-805a-0073d7a91fa7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:55.917319 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807229e8-c7bc-47d3-805a-0073d7a91fa7 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:55.937315 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1209/2439] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:29:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:55.938333 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f145d2d-0fda-4686-a5ac-875951b3c2fa None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:55.949372 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f145d2d-0fda-4686-a5ac-875951b3c2fa None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:55.954843 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3788e-f126-431e-be3d-281063bd6419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:55.955558 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3788e-f126-431e-be3d-281063bd6419 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:55.955845 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3788e-f126-431e-be3d-281063bd6419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:55.956140 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3788e-f126-431e-be3d-281063bd6419 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:55.957131 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f3788e-f126-431e-be3d-281063bd6419 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:55.959664 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f3788e-f126-431e-be3d-281063bd6419 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:56.008148 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1231/2440] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:29:55 2022] POST /identity/v3/projects => generated 375 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:29:56.013418 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807229e8-c7bc-47d3-805a-0073d7a91fa7 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:56.027740 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807229e8-c7bc-47d3-805a-0073d7a91fa7 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:56.153277 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215c741-3241-43c1-9be5-dab0bbb45d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:56.153928 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215c741-3241-43c1-9be5-dab0bbb45d62 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:56.154215 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215c741-3241-43c1-9be5-dab0bbb45d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:56.154493 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215c741-3241-43c1-9be5-dab0bbb45d62 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:56.155377 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0215c741-3241-43c1-9be5-dab0bbb45d62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:56.158219 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0215c741-3241-43c1-9be5-dab0bbb45d62 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:56.189937 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1210/2441] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:29:56 2022] POST /identity/v3/users => generated 288 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:29:56.198550 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3788e-f126-431e-be3d-281063bd6419 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:56.222004 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3788e-f126-431e-be3d-281063bd6419 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:56.228580 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d018e-08c9-4587-9019-6a4e4e28a70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:56.229549 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d018e-08c9-4587-9019-6a4e4e28a70a admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:56.229937 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d018e-08c9-4587-9019-6a4e4e28a70a admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:56.230370 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d018e-08c9-4587-9019-6a4e4e28a70a admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:56.231370 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69d018e-08c9-4587-9019-6a4e4e28a70a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:56.234049 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69d018e-08c9-4587-9019-6a4e4e28a70a admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:56.254722 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1232/2442] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:29:56.258573 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215c741-3241-43c1-9be5-dab0bbb45d62 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:56.276280 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215c741-3241-43c1-9be5-dab0bbb45d62 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:56.282383 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff73183b-e384-48e0-b1fe-0796682306e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:56.284265 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73183b-e384-48e0-b1fe-0796682306e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:56.285264 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73183b-e384-48e0-b1fe-0796682306e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:56.286097 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73183b-e384-48e0-b1fe-0796682306e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:56.288812 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff73183b-e384-48e0-b1fe-0796682306e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:56.291653 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff73183b-e384-48e0-b1fe-0796682306e5 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:56.307386 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1211/2443] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:29:56.312672 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d018e-08c9-4587-9019-6a4e4e28a70a admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:56.323870 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d018e-08c9-4587-9019-6a4e4e28a70a admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:56.332133 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9127c6-8dc1-40c3-adb7-20e4c744ab16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:56.332900 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9127c6-8dc1-40c3-adb7-20e4c744ab16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:56.333277 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9127c6-8dc1-40c3-adb7-20e4c744ab16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:56.333659 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9127c6-8dc1-40c3-adb7-20e4c744ab16 admin admin] PATH_INFO: `/v3/projects/1714d4c909e4490b97e7f12e8a09fb4d/users/67aff48d02fe4167a10cef70004d39d6/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:56.352318 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9127c6-8dc1-40c3-adb7-20e4c744ab16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1714d4c909e4490b97e7f12e8a09fb4d, user_id=67aff48d02fe4167a10cef70004d39d6, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:56.357090 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9127c6-8dc1-40c3-adb7-20e4c744ab16 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:56.377014 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1233/2444] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:29:56 2022] PUT /identity/v3/projects/1714d4c909e4490b97e7f12e8a09fb4d/users/67aff48d02fe4167a10cef70004d39d6/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:29:56.389999 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0173b-c2ff-457d-8ac8-67a2b3615e50 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:56.390297 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0173b-c2ff-457d-8ac8-67a2b3615e50 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:56.390601 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0173b-c2ff-457d-8ac8-67a2b3615e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:56.429942 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-c4b0173b-c2ff-457d-8ac8-67a2b3615e50 None None] MFA Rules not processed for user `67aff48d02fe4167a10cef70004d39d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:56.432679 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c4b0173b-c2ff-457d-8ac8-67a2b3615e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:56.530531 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1212/2445] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:29:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:29:56.543118 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9127c6-8dc1-40c3-adb7-20e4c744ab16 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:56.544953 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-ad9127c6-8dc1-40c3-adb7-20e4c744ab16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:56.618912 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9127c6-8dc1-40c3-adb7-20e4c744ab16 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:56.622932 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba9344-9ea6-4470-ac4a-305947a4aa31 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a399ee5db44100a88a4ffb451512aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:56.623563 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba9344-9ea6-4470-ac4a-305947a4aa31 service glance] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:56.623848 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba9344-9ea6-4470-ac4a-305947a4aa31 service glance] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:56.624123 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba9344-9ea6-4470-ac4a-305947a4aa31 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:56.633150 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ba9344-9ea6-4470-ac4a-305947a4aa31 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:56.634608 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ba9344-9ea6-4470-ac4a-305947a4aa31 service glance] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:56.644156 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1234/2446] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:29:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:29:57.461243 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07da033-57bb-422e-acf7-e54660fd9f83 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:57.462316 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07da033-57bb-422e-acf7-e54660fd9f83 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:57.462667 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07da033-57bb-422e-acf7-e54660fd9f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:57.490607 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-d07da033-57bb-422e-acf7-e54660fd9f83 None None] MFA Rules not processed for user `b32922d090564162810dd8b28c3a322b`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:57.492052 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d07da033-57bb-422e-acf7-e54660fd9f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:57.517498 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:57.567590 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1213/2447] 10.222.0.36 () {58 vars in 1009 bytes} [Mon Aug 29 22:29:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:29:57.587313 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba9344-9ea6-4470-ac4a-305947a4aa31 service glance] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:57.588799 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c6ba9344-9ea6-4470-ac4a-305947a4aa31 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:57.623173 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07da033-57bb-422e-acf7-e54660fd9f83 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:57.625172 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d07da033-57bb-422e-acf7-e54660fd9f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:57.666807 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:57.703910 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba9344-9ea6-4470-ac4a-305947a4aa31 service glance] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:57.713215 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026bbfa8-2f2f-4a72-b808-c477ef900553 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3472d8ffa748d8828c6a2d89ee7ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:57.714076 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026bbfa8-2f2f-4a72-b808-c477ef900553 service swift] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:57.714854 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026bbfa8-2f2f-4a72-b808-c477ef900553 service swift] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:57.715159 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026bbfa8-2f2f-4a72-b808-c477ef900553 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:57.729438 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026bbfa8-2f2f-4a72-b808-c477ef900553 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:57.732091 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026bbfa8-2f2f-4a72-b808-c477ef900553 service swift] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:57.744331 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1235/2448] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Aug 29 22:29:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 22:29:57.752864 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07da033-57bb-422e-acf7-e54660fd9f83 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:57.762431 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23386da-50ac-4b59-bc8d-254552d858fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:57.763125 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23386da-50ac-4b59-bc8d-254552d858fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:57.763411 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23386da-50ac-4b59-bc8d-254552d858fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:57.763689 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23386da-50ac-4b59-bc8d-254552d858fa admin admin] PATH_INFO: `/v3/users/9dd813748e8a40b598195785d53d1792` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:57.765732 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23386da-50ac-4b59-bc8d-254552d858fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dd813748e8a40b598195785d53d1792)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:57.769758 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23386da-50ac-4b59-bc8d-254552d858fa admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:57.880255 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-b23386da-50ac-4b59-bc8d-254552d858fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dd813748e8a40b598195785d53d1792'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:57.891484 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-b23386da-50ac-4b59-bc8d-254552d858fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dd813748e8a40b598195785d53d1792'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:57.894069 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-b23386da-50ac-4b59-bc8d-254552d858fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dd813748e8a40b598195785d53d1792'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:57.912315 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-b23386da-50ac-4b59-bc8d-254552d858fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dd813748e8a40b598195785d53d1792'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:57.931028 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-b23386da-50ac-4b59-bc8d-254552d858fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dd813748e8a40b598195785d53d1792'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:58.023107 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1214/2449] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:29:57 2022] DELETE /identity/v3/users/9dd813748e8a40b598195785d53d1792 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:29:58.026737 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760fc5c-f256-406a-b51b-96724c02ffae None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:58.027286 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760fc5c-f256-406a-b51b-96724c02ffae None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:58.027744 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760fc5c-f256-406a-b51b-96724c02ffae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:58.131618 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-e760fc5c-f256-406a-b51b-96724c02ffae None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:58.137326 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e760fc5c-f256-406a-b51b-96724c02ffae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:58.381431 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1236/2450] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:29:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:29:58.394698 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23386da-50ac-4b59-bc8d-254552d858fa admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:58.396636 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b23386da-50ac-4b59-bc8d-254552d858fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:58.566551 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23386da-50ac-4b59-bc8d-254552d858fa admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:58.582775 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7c65b-5881-4d9b-b266-1296f3619d0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:58.584520 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7c65b-5881-4d9b-b266-1296f3619d0c service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:58.585332 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7c65b-5881-4d9b-b266-1296f3619d0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:58.586016 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7c65b-5881-4d9b-b266-1296f3619d0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:58.608387 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:58.631779 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f7c65b-5881-4d9b-b266-1296f3619d0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:58.635589 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f7c65b-5881-4d9b-b266-1296f3619d0c service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:58.687191 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1215/2451] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:29:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:29:59.191581 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e760fc5c-f256-406a-b51b-96724c02ffae None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:59.193233 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e760fc5c-f256-406a-b51b-96724c02ffae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:59.213543 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e760fc5c-f256-406a-b51b-96724c02ffae None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:59.239903 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7485f0d-b9ea-4b26-bdaa-4684d262e9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:59.241196 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7485f0d-b9ea-4b26-bdaa-4684d262e9a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:59.241642 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7485f0d-b9ea-4b26-bdaa-4684d262e9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:59.242137 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7485f0d-b9ea-4b26-bdaa-4684d262e9a6 admin admin] PATH_INFO: `/v3/projects/445d5b5fffe14050a9615782032dc8bf` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:59.246233 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7485f0d-b9ea-4b26-bdaa-4684d262e9a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=445d5b5fffe14050a9615782032dc8bf)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:59.252867 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7485f0d-b9ea-4b26-bdaa-4684d262e9a6 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:59.368890 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f7485f0d-b9ea-4b26-bdaa-4684d262e9a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '445d5b5fffe14050a9615782032dc8bf', 'request_id': 'req-f7485f0d-b9ea-4b26-bdaa-4684d262e9a6'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:59.384184 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f7485f0d-b9ea-4b26-bdaa-4684d262e9a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '445d5b5fffe14050a9615782032dc8bf', 'request_id': 'req-f7485f0d-b9ea-4b26-bdaa-4684d262e9a6'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:59.408805 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f7485f0d-b9ea-4b26-bdaa-4684d262e9a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '445d5b5fffe14050a9615782032dc8bf', 'request_id': 'req-f7485f0d-b9ea-4b26-bdaa-4684d262e9a6'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:59.429712 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f7485f0d-b9ea-4b26-bdaa-4684d262e9a6 admin admin] The token cache is being invalidate because project 445d5b5fffe14050a9615782032dc8bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:29:59.430162 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f7485f0d-b9ea-4b26-bdaa-4684d262e9a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:59.432142 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f7485f0d-b9ea-4b26-bdaa-4684d262e9a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:29:59.447734 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1237/2452] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:29:59 2022] DELETE /identity/v3/projects/445d5b5fffe14050a9615782032dc8bf => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:30:03.396341 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7c65b-5881-4d9b-b266-1296f3619d0c service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:03.398309 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f5f7c65b-5881-4d9b-b266-1296f3619d0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:03.414672 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7c65b-5881-4d9b-b266-1296f3619d0c service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:03.495714 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0198ac-dc45-4a43-bf7a-0dd3e28c17a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:03.496406 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0198ac-dc45-4a43-bf7a-0dd3e28c17a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:03.497037 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0198ac-dc45-4a43-bf7a-0dd3e28c17a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:03.497325 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0198ac-dc45-4a43-bf7a-0dd3e28c17a8 admin admin] PATH_INFO: `/v3/users/220ece8913d34908a366817babcb4d93` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:03.498509 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0198ac-dc45-4a43-bf7a-0dd3e28c17a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=220ece8913d34908a366817babcb4d93)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:03.500538 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0198ac-dc45-4a43-bf7a-0dd3e28c17a8 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:03.572163 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4e0198ac-dc45-4a43-bf7a-0dd3e28c17a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '220ece8913d34908a366817babcb4d93'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:30:03.588764 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4e0198ac-dc45-4a43-bf7a-0dd3e28c17a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '220ece8913d34908a366817babcb4d93'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:30:03.590142 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4e0198ac-dc45-4a43-bf7a-0dd3e28c17a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '220ece8913d34908a366817babcb4d93'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:30:03.601603 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4e0198ac-dc45-4a43-bf7a-0dd3e28c17a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '220ece8913d34908a366817babcb4d93'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:30:03.602574 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4e0198ac-dc45-4a43-bf7a-0dd3e28c17a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '220ece8913d34908a366817babcb4d93'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:30:03.632229 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1216/2453] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:30:03 2022] DELETE /identity/v3/users/220ece8913d34908a366817babcb4d93 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:30:03.636685 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5e6d8-ab70-436e-8790-9db48c261ff4 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:03.637310 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5e6d8-ab70-436e-8790-9db48c261ff4 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:03.637310 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5e6d8-ab70-436e-8790-9db48c261ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:03.659466 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-14a5e6d8-ab70-436e-8790-9db48c261ff4 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:30:03.661080 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-14a5e6d8-ab70-436e-8790-9db48c261ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:03.816949 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1238/2454] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:30:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:30:03.827545 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0198ac-dc45-4a43-bf7a-0dd3e28c17a8 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:03.829505 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-4e0198ac-dc45-4a43-bf7a-0dd3e28c17a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:03.924189 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0198ac-dc45-4a43-bf7a-0dd3e28c17a8 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:03.934079 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8abe062-54c1-4982-ab12-8373bcd60844 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:03.934738 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8abe062-54c1-4982-ab12-8373bcd60844 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:03.935018 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8abe062-54c1-4982-ab12-8373bcd60844 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:03.935286 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8abe062-54c1-4982-ab12-8373bcd60844 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:03.949022 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8abe062-54c1-4982-ab12-8373bcd60844 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:03.951016 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8abe062-54c1-4982-ab12-8373bcd60844 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:03.962961 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1217/2455] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:30:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:30:04.430868 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5e6d8-ab70-436e-8790-9db48c261ff4 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:04.432692 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-14a5e6d8-ab70-436e-8790-9db48c261ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:04.459385 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5e6d8-ab70-436e-8790-9db48c261ff4 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:04.466622 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f4d157-8fb5-49e9-ae4e-139df4c92697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:04.467510 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4d157-8fb5-49e9-ae4e-139df4c92697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:04.467901 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4d157-8fb5-49e9-ae4e-139df4c92697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:04.468271 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4d157-8fb5-49e9-ae4e-139df4c92697 admin admin] PATH_INFO: `/v3/projects/13b71a937bd04483a98e65e64842e637` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:04.470589 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f4d157-8fb5-49e9-ae4e-139df4c92697 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13b71a937bd04483a98e65e64842e637)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:04.472749 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f4d157-8fb5-49e9-ae4e-139df4c92697 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:04.474881 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:04.546324 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-04f4d157-8fb5-49e9-ae4e-139df4c92697 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13b71a937bd04483a98e65e64842e637', 'request_id': 'req-04f4d157-8fb5-49e9-ae4e-139df4c92697'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:30:04.556063 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-04f4d157-8fb5-49e9-ae4e-139df4c92697 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13b71a937bd04483a98e65e64842e637', 'request_id': 'req-04f4d157-8fb5-49e9-ae4e-139df4c92697'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:30:04.565411 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-04f4d157-8fb5-49e9-ae4e-139df4c92697 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13b71a937bd04483a98e65e64842e637', 'request_id': 'req-04f4d157-8fb5-49e9-ae4e-139df4c92697'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:30:04.589210 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-04f4d157-8fb5-49e9-ae4e-139df4c92697 admin admin] The token cache is being invalidate because project 13b71a937bd04483a98e65e64842e637 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:30:04.589651 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-04f4d157-8fb5-49e9-ae4e-139df4c92697 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:30:04.590860 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-04f4d157-8fb5-49e9-ae4e-139df4c92697 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:30:04.592120 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1239/2456] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:30:04 2022] DELETE /identity/v3/projects/13b71a937bd04483a98e65e64842e637 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:30:13.957562 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=82,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:14.584074 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=24,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:21.259420 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8abe062-54c1-4982-ab12-8373bcd60844 service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:21.261630 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d8abe062-54c1-4982-ab12-8373bcd60844 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:21.285063 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8abe062-54c1-4982-ab12-8373bcd60844 service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:21.362234 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c31e80-8acd-4ee5-ae2f-87ba91c72a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:21.362975 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c31e80-8acd-4ee5-ae2f-87ba91c72a06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:21.363329 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c31e80-8acd-4ee5-ae2f-87ba91c72a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:21.363614 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c31e80-8acd-4ee5-ae2f-87ba91c72a06 admin admin] PATH_INFO: `/v3/users/67aff48d02fe4167a10cef70004d39d6` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:21.364813 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c31e80-8acd-4ee5-ae2f-87ba91c72a06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67aff48d02fe4167a10cef70004d39d6)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:21.366741 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c31e80-8acd-4ee5-ae2f-87ba91c72a06 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:21.415771 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-56c31e80-8acd-4ee5-ae2f-87ba91c72a06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67aff48d02fe4167a10cef70004d39d6'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:30:21.422825 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-56c31e80-8acd-4ee5-ae2f-87ba91c72a06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67aff48d02fe4167a10cef70004d39d6'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:30:21.423590 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-56c31e80-8acd-4ee5-ae2f-87ba91c72a06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67aff48d02fe4167a10cef70004d39d6'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:30:21.431418 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-56c31e80-8acd-4ee5-ae2f-87ba91c72a06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67aff48d02fe4167a10cef70004d39d6'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:30:21.432145 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-56c31e80-8acd-4ee5-ae2f-87ba91c72a06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67aff48d02fe4167a10cef70004d39d6'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:30:21.451221 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1218/2457] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:30:21 2022] DELETE /identity/v3/users/67aff48d02fe4167a10cef70004d39d6 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:30:21.456764 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc766e5-3bd4-40f4-b01b-f5afbfe3689d None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:21.457247 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc766e5-3bd4-40f4-b01b-f5afbfe3689d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:21.457362 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc766e5-3bd4-40f4-b01b-f5afbfe3689d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:21.477851 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-fcc766e5-3bd4-40f4-b01b-f5afbfe3689d None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:30:21.479068 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-fcc766e5-3bd4-40f4-b01b-f5afbfe3689d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:21.554584 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1240/2458] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:30:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:30:21.566672 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c31e80-8acd-4ee5-ae2f-87ba91c72a06 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:21.568181 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-56c31e80-8acd-4ee5-ae2f-87ba91c72a06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:21.633864 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c31e80-8acd-4ee5-ae2f-87ba91c72a06 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:21.637915 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23654f11-3875-43ad-8260-ce73681d802a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:21.638702 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23654f11-3875-43ad-8260-ce73681d802a service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:21.639090 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23654f11-3875-43ad-8260-ce73681d802a service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:21.639442 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23654f11-3875-43ad-8260-ce73681d802a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:21.650310 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23654f11-3875-43ad-8260-ce73681d802a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:21.651873 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23654f11-3875-43ad-8260-ce73681d802a service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:21.664490 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1219/2459] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:30:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:30:21.990392 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc766e5-3bd4-40f4-b01b-f5afbfe3689d None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:21.992587 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-fcc766e5-3bd4-40f4-b01b-f5afbfe3689d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:22.009096 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc766e5-3bd4-40f4-b01b-f5afbfe3689d None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:22.014542 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51110e9d-d927-40ca-8354-bcbb36080acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:22.015469 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51110e9d-d927-40ca-8354-bcbb36080acc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:22.015822 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51110e9d-d927-40ca-8354-bcbb36080acc admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:22.016239 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51110e9d-d927-40ca-8354-bcbb36080acc admin admin] PATH_INFO: `/v3/projects/1714d4c909e4490b97e7f12e8a09fb4d` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:22.018403 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51110e9d-d927-40ca-8354-bcbb36080acc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1714d4c909e4490b97e7f12e8a09fb4d)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:22.020680 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51110e9d-d927-40ca-8354-bcbb36080acc admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:22.086129 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-51110e9d-d927-40ca-8354-bcbb36080acc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1714d4c909e4490b97e7f12e8a09fb4d', 'request_id': 'req-51110e9d-d927-40ca-8354-bcbb36080acc'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:30:22.092626 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-51110e9d-d927-40ca-8354-bcbb36080acc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1714d4c909e4490b97e7f12e8a09fb4d', 'request_id': 'req-51110e9d-d927-40ca-8354-bcbb36080acc'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:30:22.099327 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-51110e9d-d927-40ca-8354-bcbb36080acc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1714d4c909e4490b97e7f12e8a09fb4d', 'request_id': 'req-51110e9d-d927-40ca-8354-bcbb36080acc'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:30:22.113254 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-51110e9d-d927-40ca-8354-bcbb36080acc admin admin] The token cache is being invalidate because project 1714d4c909e4490b97e7f12e8a09fb4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:30:22.113547 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-51110e9d-d927-40ca-8354-bcbb36080acc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:30:22.114169 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-51110e9d-d927-40ca-8354-bcbb36080acc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:30:22.115842 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1241/2460] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:30:21 2022] DELETE /identity/v3/projects/1714d4c909e4490b97e7f12e8a09fb4d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:30:22.716490 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23654f11-3875-43ad-8260-ce73681d802a service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:22.719103 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-23654f11-3875-43ad-8260-ce73681d802a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:22.737210 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23654f11-3875-43ad-8260-ce73681d802a service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:22.758465 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:22.790742 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075ff289-2b61-416b-902b-aed0d9c27361 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:22.791353 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ff289-2b61-416b-902b-aed0d9c27361 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:22.791616 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ff289-2b61-416b-902b-aed0d9c27361 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:22.791912 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ff289-2b61-416b-902b-aed0d9c27361 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:22.793806 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-075ff289-2b61-416b-902b-aed0d9c27361 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:22.858361 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075ff289-2b61-416b-902b-aed0d9c27361 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:22.859798 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075ff289-2b61-416b-902b-aed0d9c27361 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:22.870358 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1220/2461] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:30:22 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:30:26.206388 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51110e9d-d927-40ca-8354-bcbb36080acc admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:26.207834 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-51110e9d-d927-40ca-8354-bcbb36080acc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:26.223521 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51110e9d-d927-40ca-8354-bcbb36080acc admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:26.230163 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c89173-9c66-44aa-b2d6-6700f7238837 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:26.230932 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c89173-9c66-44aa-b2d6-6700f7238837 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:26.231233 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c89173-9c66-44aa-b2d6-6700f7238837 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:26.231520 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c89173-9c66-44aa-b2d6-6700f7238837 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:26.233532 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-24c89173-9c66-44aa-b2d6-6700f7238837 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:26.325823 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c89173-9c66-44aa-b2d6-6700f7238837 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:26.327620 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c89173-9c66-44aa-b2d6-6700f7238837 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:26.357378 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1242/2462] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:30:26 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:30:32.866032 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=40 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:36.336644 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:40.670379 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6757b5a-6016-4322-8935-ad80ebc55c2a None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:40.670954 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6757b5a-6016-4322-8935-ad80ebc55c2a None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:40.670954 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6757b5a-6016-4322-8935-ad80ebc55c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:40.692631 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-a6757b5a-6016-4322-8935-ad80ebc55c2a None None] MFA Rules not processed for user `b32922d090564162810dd8b28c3a322b`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:30:40.693865 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-a6757b5a-6016-4322-8935-ad80ebc55c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:40.755140 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1221/2463] 10.222.0.36 () {58 vars in 1009 bytes} [Mon Aug 29 22:30:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:30:40.780639 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c89173-9c66-44aa-b2d6-6700f7238837 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:40.782583 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-24c89173-9c66-44aa-b2d6-6700f7238837 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:40.869461 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c89173-9c66-44aa-b2d6-6700f7238837 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:40.875010 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82ec2b-5e38-49d8-a9f4-d0954a9a7321 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3472d8ffa748d8828c6a2d89ee7ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:40.875655 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82ec2b-5e38-49d8-a9f4-d0954a9a7321 service swift] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:40.875908 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82ec2b-5e38-49d8-a9f4-d0954a9a7321 service swift] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:40.876183 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82ec2b-5e38-49d8-a9f4-d0954a9a7321 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:40.886006 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b82ec2b-5e38-49d8-a9f4-d0954a9a7321 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:40.887698 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b82ec2b-5e38-49d8-a9f4-d0954a9a7321 service swift] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:40.898754 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1243/2464] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Aug 29 22:30:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 22:30:50.747410 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=25 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:50.894940 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=32 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:54.478467 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6757b5a-6016-4322-8935-ad80ebc55c2a None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:54.480880 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-a6757b5a-6016-4322-8935-ad80ebc55c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:54.564671 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6757b5a-6016-4322-8935-ad80ebc55c2a None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:54.570663 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573e6a9-86ff-408b-8cdd-b54d399e2c4e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce3d9397cca4ae58e14c8a5ae844f8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:54.571322 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573e6a9-86ff-408b-8cdd-b54d399e2c4e service placement] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:54.571594 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573e6a9-86ff-408b-8cdd-b54d399e2c4e service placement] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:54.571892 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573e6a9-86ff-408b-8cdd-b54d399e2c4e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:54.573831 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-a573e6a9-86ff-408b-8cdd-b54d399e2c4e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:54.586877 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a573e6a9-86ff-408b-8cdd-b54d399e2c4e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:54.588552 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a573e6a9-86ff-408b-8cdd-b54d399e2c4e service placement] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:54.599141 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1222/2465] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:30:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:30:56.674077 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6427919-8769-4397-accd-1e8e39d52f4a None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:56.674638 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6427919-8769-4397-accd-1e8e39d52f4a None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:56.674638 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6427919-8769-4397-accd-1e8e39d52f4a None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:56.676154 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1244/2466] 10.222.0.36 () {54 vars in 921 bytes} [Mon Aug 29 22:30:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:30:56.685902 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaef781-8dad-4efe-ac28-5d5a469c3f97 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:56.686490 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaef781-8dad-4efe-ac28-5d5a469c3f97 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:56.686490 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaef781-8dad-4efe-ac28-5d5a469c3f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:56.707607 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-2eaef781-8dad-4efe-ac28-5d5a469c3f97 None None] MFA Rules not processed for user `90b7213b7111456a93e294ce40b95b21`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:30:56.708868 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-2eaef781-8dad-4efe-ac28-5d5a469c3f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:56.786272 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1223/2467] 10.222.0.36 () {58 vars in 1018 bytes} [Mon Aug 29 22:30:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:30:56.800873 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6427919-8769-4397-accd-1e8e39d52f4a None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:56.802730 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f6427919-8769-4397-accd-1e8e39d52f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:56.870883 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6427919-8769-4397-accd-1e8e39d52f4a None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:56.874991 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51fd842-c65f-463e-a5dc-a53a128125ba service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a399ee5db44100a88a4ffb451512aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:56.875623 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51fd842-c65f-463e-a5dc-a53a128125ba service glance] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:56.875933 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51fd842-c65f-463e-a5dc-a53a128125ba service glance] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:56.876342 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51fd842-c65f-463e-a5dc-a53a128125ba service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:56.888436 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51fd842-c65f-463e-a5dc-a53a128125ba service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:56.889965 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51fd842-c65f-463e-a5dc-a53a128125ba service glance] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:56.901975 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1245/2468] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:30:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:30:56.975182 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487dd36-e9c4-44f5-9bbf-1a4016016d0f None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:56.975464 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487dd36-e9c4-44f5-9bbf-1a4016016d0f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:56.975804 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487dd36-e9c4-44f5-9bbf-1a4016016d0f None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:56.977296 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1224/2469] 10.222.0.36 () {54 vars in 921 bytes} [Mon Aug 29 22:30:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:30:56.983339 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d358160-9d1b-48c3-b54f-d45beb5e7221 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:56.983612 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d358160-9d1b-48c3-b54f-d45beb5e7221 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:56.983880 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d358160-9d1b-48c3-b54f-d45beb5e7221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:57.007693 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-2d358160-9d1b-48c3-b54f-d45beb5e7221 None None] MFA Rules not processed for user `204c597d751c420796bd972f10a3d149`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:30:57.009008 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-2d358160-9d1b-48c3-b54f-d45beb5e7221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:57.016770 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1246/2470] 10.222.0.36 () {58 vars in 1018 bytes} [Mon Aug 29 22:30:56 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:30:57.029847 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c487dd36-e9c4-44f5-9bbf-1a4016016d0f None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:57.032191 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c487dd36-e9c4-44f5-9bbf-1a4016016d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:57.048188 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c487dd36-e9c4-44f5-9bbf-1a4016016d0f None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:57.052796 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ed0ad-751d-47fd-94a7-a561ebe911ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:57.053672 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ed0ad-751d-47fd-94a7-a561ebe911ff service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:57.053672 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ed0ad-751d-47fd-94a7-a561ebe911ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:57.054276 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ed0ad-751d-47fd-94a7-a561ebe911ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:57.062076 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36ed0ad-751d-47fd-94a7-a561ebe911ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:57.063539 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36ed0ad-751d-47fd-94a7-a561ebe911ff service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:57.072100 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1225/2471] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:30:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:30:57.166944 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023931b-ae22-45a2-95c2-dd822d4efc16 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:57.167233 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023931b-ae22-45a2-95c2-dd822d4efc16 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:57.167515 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023931b-ae22-45a2-95c2-dd822d4efc16 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:57.168902 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1247/2472] 10.222.0.36 () {54 vars in 921 bytes} [Mon Aug 29 22:30:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:30:57.174846 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3e5d7-d0c7-4aed-8402-04d58ef080a4 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:57.175136 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3e5d7-d0c7-4aed-8402-04d58ef080a4 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:57.175405 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3e5d7-d0c7-4aed-8402-04d58ef080a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:57.198020 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-a8c3e5d7-d0c7-4aed-8402-04d58ef080a4 None None] MFA Rules not processed for user `90b7213b7111456a93e294ce40b95b21`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:30:57.199145 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-a8c3e5d7-d0c7-4aed-8402-04d58ef080a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:57.209786 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1226/2473] 10.222.0.36 () {58 vars in 1018 bytes} [Mon Aug 29 22:30:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:30:57.220805 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023931b-ae22-45a2-95c2-dd822d4efc16 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:57.233581 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023931b-ae22-45a2-95c2-dd822d4efc16 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:57.237312 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d6ee43-abe1-4f03-af66-8bbaafd24af4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:57.237938 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6ee43-abe1-4f03-af66-8bbaafd24af4 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:57.238219 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6ee43-abe1-4f03-af66-8bbaafd24af4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:57.238487 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6ee43-abe1-4f03-af66-8bbaafd24af4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:57.250123 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d6ee43-abe1-4f03-af66-8bbaafd24af4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:57.251580 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d6ee43-abe1-4f03-af66-8bbaafd24af4 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:57.263395 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1248/2474] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:30:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:31:00.073534 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0299aa-b14a-4da4-a812-dc97974ec691 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:00.074194 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0299aa-b14a-4da4-a812-dc97974ec691 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:00.074194 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0299aa-b14a-4da4-a812-dc97974ec691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:00.094555 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-bc0299aa-b14a-4da4-a812-dc97974ec691 None None] MFA Rules not processed for user `b32922d090564162810dd8b28c3a322b`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:00.095653 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-bc0299aa-b14a-4da4-a812-dc97974ec691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:00.103584 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1227/2475] 10.222.0.36 () {58 vars in 1009 bytes} [Mon Aug 29 22:31:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:31:00.115820 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d6ee43-abe1-4f03-af66-8bbaafd24af4 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:00.128647 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d6ee43-abe1-4f03-af66-8bbaafd24af4 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:00.135099 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf5d85-60c3-4dd0-849b-4d65eaf2fcce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3472d8ffa748d8828c6a2d89ee7ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:00.135723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf5d85-60c3-4dd0-849b-4d65eaf2fcce service swift] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:00.135999 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf5d85-60c3-4dd0-849b-4d65eaf2fcce service swift] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:00.136271 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf5d85-60c3-4dd0-849b-4d65eaf2fcce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:00.145208 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cf5d85-60c3-4dd0-849b-4d65eaf2fcce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:00.146805 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cf5d85-60c3-4dd0-849b-4d65eaf2fcce service swift] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:00.156234 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1249/2476] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Aug 29 22:31:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 22:31:10.088857 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=75 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:10.153491 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=41 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:19.507563 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3187c2-2877-4383-bb46-88433b36d237 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:19.508102 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3187c2-2877-4383-bb46-88433b36d237 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:19.508102 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3187c2-2877-4383-bb46-88433b36d237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:19.530423 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-7c3187c2-2877-4383-bb46-88433b36d237 None None] MFA Rules not processed for user `b32922d090564162810dd8b28c3a322b`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:19.532176 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7c3187c2-2877-4383-bb46-88433b36d237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:19.542222 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1228/2477] 10.222.0.36 () {58 vars in 967 bytes} [Mon Aug 29 22:31:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:31:19.560730 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf5d85-60c3-4dd0-849b-4d65eaf2fcce service swift] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:19.572708 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf5d85-60c3-4dd0-849b-4d65eaf2fcce service swift] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:19.579076 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82443b-e6d9-49e6-b376-995a8eeaf987 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3472d8ffa748d8828c6a2d89ee7ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:19.579731 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82443b-e6d9-49e6-b376-995a8eeaf987 service swift] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:19.580008 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82443b-e6d9-49e6-b376-995a8eeaf987 service swift] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:19.580276 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82443b-e6d9-49e6-b376-995a8eeaf987 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:19.589612 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af82443b-e6d9-49e6-b376-995a8eeaf987 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:19.591394 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af82443b-e6d9-49e6-b376-995a8eeaf987 service swift] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:19.600077 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1250/2478] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Aug 29 22:31:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 22:31:29.524059 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:29.596480 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=6 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:44.062703 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529cf926-15f7-475b-a2a4-170aaab0756c None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:44.063301 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529cf926-15f7-475b-a2a4-170aaab0756c None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:44.063301 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529cf926-15f7-475b-a2a4-170aaab0756c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:44.085399 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-529cf926-15f7-475b-a2a4-170aaab0756c None None] MFA Rules not processed for user `bef91a59d5a343d886ac09ae35d7c10e`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:44.086636 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-529cf926-15f7-475b-a2a4-170aaab0756c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:44.154348 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1229/2479] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:31:44 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:31:54.146681 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=25 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:11.439521 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a131290-c192-4041-9651-2b125e924c6d None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:11.440068 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a131290-c192-4041-9651-2b125e924c6d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:11.440068 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a131290-c192-4041-9651-2b125e924c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:11.460225 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-0a131290-c192-4041-9651-2b125e924c6d None None] MFA Rules not processed for user `41eeb2403f4748b7931680835e47f113`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:11.461464 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-0a131290-c192-4041-9651-2b125e924c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:11.518748 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1251/2480] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:32:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:32:18.638424 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b79281-ab7f-40f9-a902-d4b1f293d22e None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:18.639306 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b79281-ab7f-40f9-a902-d4b1f293d22e None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:18.639460 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b79281-ab7f-40f9-a902-d4b1f293d22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:18.664312 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-75b79281-ab7f-40f9-a902-d4b1f293d22e None None] MFA Rules not processed for user `91fc37814c4f421687ab653f9062da27`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:18.665582 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-75b79281-ab7f-40f9-a902-d4b1f293d22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:18.723982 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1230/2481] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:32:18 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:32:21.511887 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=25 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:28.716687 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=25 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:39.941730 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cbef39-43ec-456b-be76-808c9b9ce7a7 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:39.942231 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cbef39-43ec-456b-be76-808c9b9ce7a7 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:39.942537 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cbef39-43ec-456b-be76-808c9b9ce7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:39.962774 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-99cbef39-43ec-456b-be76-808c9b9ce7a7 None None] MFA Rules not processed for user `b32922d090564162810dd8b28c3a322b`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:39.964149 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-99cbef39-43ec-456b-be76-808c9b9ce7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:39.971771 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1252/2482] 10.222.0.36 () {58 vars in 967 bytes} [Mon Aug 29 22:32:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:32:40.025934 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b79281-ab7f-40f9-a902-d4b1f293d22e None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:40.048553 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b79281-ab7f-40f9-a902-d4b1f293d22e None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:40.055348 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb006fc-3ae7-44c8-834b-83ac78ad160a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3472d8ffa748d8828c6a2d89ee7ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:40.056713 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb006fc-3ae7-44c8-834b-83ac78ad160a service swift] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:40.057135 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb006fc-3ae7-44c8-834b-83ac78ad160a service swift] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:40.057706 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb006fc-3ae7-44c8-834b-83ac78ad160a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:40.069061 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb006fc-3ae7-44c8-834b-83ac78ad160a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:40.071708 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb006fc-3ae7-44c8-834b-83ac78ad160a service swift] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:40.082378 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1231/2483] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Aug 29 22:32:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 22:32:40.294343 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cbef39-43ec-456b-be76-808c9b9ce7a7 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:40.311655 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cbef39-43ec-456b-be76-808c9b9ce7a7 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:40.316744 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf447819-5086-41a5-914f-fe6b652a95c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:40.317513 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf447819-5086-41a5-914f-fe6b652a95c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:40.317962 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf447819-5086-41a5-914f-fe6b652a95c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:40.318285 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf447819-5086-41a5-914f-fe6b652a95c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:40.320403 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-bf447819-5086-41a5-914f-fe6b652a95c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:40.337561 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf447819-5086-41a5-914f-fe6b652a95c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:40.339773 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf447819-5086-41a5-914f-fe6b652a95c1 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:40.352766 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1253/2484] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:32:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:32:45.896772 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb006fc-3ae7-44c8-834b-83ac78ad160a service swift] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:45.908059 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb006fc-3ae7-44c8-834b-83ac78ad160a service swift] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:45.912645 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978a633-7485-43b2-aa7c-2a0b31f2ec82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:45.913370 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978a633-7485-43b2-aa7c-2a0b31f2ec82 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:45.914169 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978a633-7485-43b2-aa7c-2a0b31f2ec82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:45.914532 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978a633-7485-43b2-aa7c-2a0b31f2ec82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:45.916747 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7978a633-7485-43b2-aa7c-2a0b31f2ec82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:45.934303 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7978a633-7485-43b2-aa7c-2a0b31f2ec82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:45.936200 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7978a633-7485-43b2-aa7c-2a0b31f2ec82 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:45.950219 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1232/2485] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:32:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:32:47.545968 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf447819-5086-41a5-914f-fe6b652a95c1 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:47.548187 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-bf447819-5086-41a5-914f-fe6b652a95c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:47.628586 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf447819-5086-41a5-914f-fe6b652a95c1 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:47.634890 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd01d4-bea9-4734-b06e-b521fc17a671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:47.635750 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd01d4-bea9-4734-b06e-b521fc17a671 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:47.636036 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd01d4-bea9-4734-b06e-b521fc17a671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:47.636337 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd01d4-bea9-4734-b06e-b521fc17a671 admin admin] PATH_INFO: `/v3/users/d9d3c8d364c3460b86280682221cca46` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:47.637619 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cd01d4-bea9-4734-b06e-b521fc17a671 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9d3c8d364c3460b86280682221cca46)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:47.639574 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cd01d4-bea9-4734-b06e-b521fc17a671 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:47.708836 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a5cd01d4-bea9-4734-b06e-b521fc17a671 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9d3c8d364c3460b86280682221cca46'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:32:47.720750 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a5cd01d4-bea9-4734-b06e-b521fc17a671 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9d3c8d364c3460b86280682221cca46'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:32:47.731063 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a5cd01d4-bea9-4734-b06e-b521fc17a671 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9d3c8d364c3460b86280682221cca46'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:32:47.731797 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a5cd01d4-bea9-4734-b06e-b521fc17a671 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9d3c8d364c3460b86280682221cca46'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:32:47.744742 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a5cd01d4-bea9-4734-b06e-b521fc17a671 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9d3c8d364c3460b86280682221cca46'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:32:47.752994 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1254/2486] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:32:47 2022] DELETE /identity/v3/users/d9d3c8d364c3460b86280682221cca46 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:32:47.965352 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978a633-7485-43b2-aa7c-2a0b31f2ec82 service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:47.978632 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978a633-7485-43b2-aa7c-2a0b31f2ec82 service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:48.047694 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66753b85-a579-46d7-9225-a57907a33106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:48.048820 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66753b85-a579-46d7-9225-a57907a33106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:48.048820 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66753b85-a579-46d7-9225-a57907a33106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:48.048993 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66753b85-a579-46d7-9225-a57907a33106 admin admin] PATH_INFO: `/v3/projects/0388a96f235449a19d07c43443e6f3fe` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:48.050072 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66753b85-a579-46d7-9225-a57907a33106 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0388a96f235449a19d07c43443e6f3fe)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:48.052000 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66753b85-a579-46d7-9225-a57907a33106 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:48.105141 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-66753b85-a579-46d7-9225-a57907a33106 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0388a96f235449a19d07c43443e6f3fe', 'request_id': 'req-66753b85-a579-46d7-9225-a57907a33106'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:32:48.111548 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-66753b85-a579-46d7-9225-a57907a33106 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0388a96f235449a19d07c43443e6f3fe', 'request_id': 'req-66753b85-a579-46d7-9225-a57907a33106'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:32:48.122460 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-66753b85-a579-46d7-9225-a57907a33106 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0388a96f235449a19d07c43443e6f3fe', 'request_id': 'req-66753b85-a579-46d7-9225-a57907a33106'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:32:48.136565 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-66753b85-a579-46d7-9225-a57907a33106 admin admin] The token cache is being invalidate because project 0388a96f235449a19d07c43443e6f3fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:32:48.136959 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-66753b85-a579-46d7-9225-a57907a33106 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:32:48.138326 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-66753b85-a579-46d7-9225-a57907a33106 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:32:48.139389 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1233/2487] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:32:47 2022] DELETE /identity/v3/projects/0388a96f235449a19d07c43443e6f3fe => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:32:48.143439 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd01d4-bea9-4734-b06e-b521fc17a671 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:48.144876 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a5cd01d4-bea9-4734-b06e-b521fc17a671 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:48.158628 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd01d4-bea9-4734-b06e-b521fc17a671 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:48.240210 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf687b63-716e-4aa1-840c-c7608276e9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:48.240890 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf687b63-716e-4aa1-840c-c7608276e9fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:48.241183 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf687b63-716e-4aa1-840c-c7608276e9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:48.241454 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf687b63-716e-4aa1-840c-c7608276e9fc admin admin] PATH_INFO: `/v3/users/0a7cca06668e48b19a562d06692ecf68` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:48.242643 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf687b63-716e-4aa1-840c-c7608276e9fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a7cca06668e48b19a562d06692ecf68)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:48.244612 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf687b63-716e-4aa1-840c-c7608276e9fc admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:48.247120 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:48.305546 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-bf687b63-716e-4aa1-840c-c7608276e9fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a7cca06668e48b19a562d06692ecf68'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:32:48.319097 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-bf687b63-716e-4aa1-840c-c7608276e9fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a7cca06668e48b19a562d06692ecf68'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:32:48.343927 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-bf687b63-716e-4aa1-840c-c7608276e9fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a7cca06668e48b19a562d06692ecf68'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:32:48.345063 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-bf687b63-716e-4aa1-840c-c7608276e9fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a7cca06668e48b19a562d06692ecf68'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:32:48.363731 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-bf687b63-716e-4aa1-840c-c7608276e9fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a7cca06668e48b19a562d06692ecf68'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:32:48.386482 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1255/2488] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:32:48 2022] DELETE /identity/v3/users/0a7cca06668e48b19a562d06692ecf68 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:32:48.598870 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66753b85-a579-46d7-9225-a57907a33106 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:48.600527 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-66753b85-a579-46d7-9225-a57907a33106 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:48.621625 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66753b85-a579-46d7-9225-a57907a33106 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:48.684889 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0023f8-87f7-45fe-9ae9-d945e81f8979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:48.685541 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0023f8-87f7-45fe-9ae9-d945e81f8979 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:48.685845 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0023f8-87f7-45fe-9ae9-d945e81f8979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:48.686107 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0023f8-87f7-45fe-9ae9-d945e81f8979 admin admin] PATH_INFO: `/v3/projects/94be69ab6943494984878171d53dc39c` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:48.687297 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0023f8-87f7-45fe-9ae9-d945e81f8979 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94be69ab6943494984878171d53dc39c)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:48.689273 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0023f8-87f7-45fe-9ae9-d945e81f8979 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:48.696335 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:48.745607 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7d0023f8-87f7-45fe-9ae9-d945e81f8979 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94be69ab6943494984878171d53dc39c', 'request_id': 'req-7d0023f8-87f7-45fe-9ae9-d945e81f8979'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:32:48.754140 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7d0023f8-87f7-45fe-9ae9-d945e81f8979 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94be69ab6943494984878171d53dc39c', 'request_id': 'req-7d0023f8-87f7-45fe-9ae9-d945e81f8979'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:32:48.764047 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7d0023f8-87f7-45fe-9ae9-d945e81f8979 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94be69ab6943494984878171d53dc39c', 'request_id': 'req-7d0023f8-87f7-45fe-9ae9-d945e81f8979'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:32:48.775460 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7d0023f8-87f7-45fe-9ae9-d945e81f8979 admin admin] The token cache is being invalidate because project 94be69ab6943494984878171d53dc39c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:32:48.775750 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7d0023f8-87f7-45fe-9ae9-d945e81f8979 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:32:48.776584 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7d0023f8-87f7-45fe-9ae9-d945e81f8979 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:32:48.778095 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1234/2489] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:32:48 2022] DELETE /identity/v3/projects/94be69ab6943494984878171d53dc39c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:32:52.005133 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf687b63-716e-4aa1-840c-c7608276e9fc admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:52.007227 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-bf687b63-716e-4aa1-840c-c7608276e9fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:52.096779 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf687b63-716e-4aa1-840c-c7608276e9fc admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:52.162475 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab0e64-fdbe-44d8-ab5a-6d357261d007 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b7213b7111456a93e294ce40b95b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:52.163080 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab0e64-fdbe-44d8-ab5a-6d357261d007 service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:52.163364 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab0e64-fdbe-44d8-ab5a-6d357261d007 service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:52.163640 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab0e64-fdbe-44d8-ab5a-6d357261d007 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:52.165424 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-43ab0e64-fdbe-44d8-ab5a-6d357261d007 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:52.180069 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:52.233653 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ab0e64-fdbe-44d8-ab5a-6d357261d007 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:52.235288 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ab0e64-fdbe-44d8-ab5a-6d357261d007 service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:52.248781 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1256/2490] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:32:52 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:32:55.785978 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0023f8-87f7-45fe-9ae9-d945e81f8979 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:55.787483 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7d0023f8-87f7-45fe-9ae9-d945e81f8979 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:55.870159 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0023f8-87f7-45fe-9ae9-d945e81f8979 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:55.875123 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7241cf8d-93cd-4d54-a604-f67f96bc07a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:55.875741 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241cf8d-93cd-4d54-a604-f67f96bc07a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:55.876010 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241cf8d-93cd-4d54-a604-f67f96bc07a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:55.876280 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241cf8d-93cd-4d54-a604-f67f96bc07a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:55.878349 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7241cf8d-93cd-4d54-a604-f67f96bc07a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:55.950565 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7241cf8d-93cd-4d54-a604-f67f96bc07a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:55.952044 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7241cf8d-93cd-4d54-a604-f67f96bc07a4 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:55.962569 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1235/2491] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:32:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:32:59.189087 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab0e64-fdbe-44d8-ab5a-6d357261d007 service nova] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:59.192201 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-43ab0e64-fdbe-44d8-ab5a-6d357261d007 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:59.217841 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab0e64-fdbe-44d8-ab5a-6d357261d007 service nova] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:59.224266 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a849f564-d990-40e2-a7bd-da50e5181261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:59.224987 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a849f564-d990-40e2-a7bd-da50e5181261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:59.225428 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a849f564-d990-40e2-a7bd-da50e5181261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:59.225708 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a849f564-d990-40e2-a7bd-da50e5181261 admin admin] PATH_INFO: `/v3/users/bef91a59d5a343d886ac09ae35d7c10e` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:59.227290 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a849f564-d990-40e2-a7bd-da50e5181261 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bef91a59d5a343d886ac09ae35d7c10e)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:59.232167 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a849f564-d990-40e2-a7bd-da50e5181261 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:59.302142 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a849f564-d990-40e2-a7bd-da50e5181261 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bef91a59d5a343d886ac09ae35d7c10e'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:32:59.312351 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a849f564-d990-40e2-a7bd-da50e5181261 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bef91a59d5a343d886ac09ae35d7c10e'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:32:59.325565 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a849f564-d990-40e2-a7bd-da50e5181261 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bef91a59d5a343d886ac09ae35d7c10e'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:32:59.326369 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a849f564-d990-40e2-a7bd-da50e5181261 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bef91a59d5a343d886ac09ae35d7c10e'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:32:59.340909 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a849f564-d990-40e2-a7bd-da50e5181261 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bef91a59d5a343d886ac09ae35d7c10e'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:32:59.347253 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1257/2492] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:32:59 2022] DELETE /identity/v3/users/bef91a59d5a343d886ac09ae35d7c10e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:32:59.534245 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7241cf8d-93cd-4d54-a604-f67f96bc07a4 service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:59.545960 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7241cf8d-93cd-4d54-a604-f67f96bc07a4 service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:59.590760 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:59.607703 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92edaa8f-89f2-495d-bfa5-0db5dbaec770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:59.608348 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92edaa8f-89f2-495d-bfa5-0db5dbaec770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:59.608651 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92edaa8f-89f2-495d-bfa5-0db5dbaec770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:59.608923 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92edaa8f-89f2-495d-bfa5-0db5dbaec770 admin admin] PATH_INFO: `/v3/projects/fb7cc1d6231e45aead9dcd28583c8e12` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:59.610027 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92edaa8f-89f2-495d-bfa5-0db5dbaec770 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb7cc1d6231e45aead9dcd28583c8e12)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:59.611937 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92edaa8f-89f2-495d-bfa5-0db5dbaec770 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:59.667916 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-92edaa8f-89f2-495d-bfa5-0db5dbaec770 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb7cc1d6231e45aead9dcd28583c8e12', 'request_id': 'req-92edaa8f-89f2-495d-bfa5-0db5dbaec770'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:32:59.674300 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-92edaa8f-89f2-495d-bfa5-0db5dbaec770 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb7cc1d6231e45aead9dcd28583c8e12', 'request_id': 'req-92edaa8f-89f2-495d-bfa5-0db5dbaec770'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:32:59.683962 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-92edaa8f-89f2-495d-bfa5-0db5dbaec770 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb7cc1d6231e45aead9dcd28583c8e12', 'request_id': 'req-92edaa8f-89f2-495d-bfa5-0db5dbaec770'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:32:59.699089 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-92edaa8f-89f2-495d-bfa5-0db5dbaec770 admin admin] The token cache is being invalidate because project fb7cc1d6231e45aead9dcd28583c8e12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:32:59.699368 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-92edaa8f-89f2-495d-bfa5-0db5dbaec770 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:32:59.700217 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-92edaa8f-89f2-495d-bfa5-0db5dbaec770 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:32:59.701753 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1236/2493] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:32:59 2022] DELETE /identity/v3/projects/fb7cc1d6231e45aead9dcd28583c8e12 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:32:59.706794 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011a369-6963-43c1-82b6-8dae5abe8b19 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:59.707077 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011a369-6963-43c1-82b6-8dae5abe8b19 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:59.707348 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011a369-6963-43c1-82b6-8dae5abe8b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:59.727485 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-6011a369-6963-43c1-82b6-8dae5abe8b19 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:59.728783 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-6011a369-6963-43c1-82b6-8dae5abe8b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:59.789861 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1258/2494] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:32:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:32:59.799027 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49aa9f-be2a-4fd1-930e-282fea4f8696 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:59.799318 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49aa9f-be2a-4fd1-930e-282fea4f8696 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:59.799592 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49aa9f-be2a-4fd1-930e-282fea4f8696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:59.821406 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-fd49aa9f-be2a-4fd1-930e-282fea4f8696 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:59.822657 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-fd49aa9f-be2a-4fd1-930e-282fea4f8696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:59.835751 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1237/2495] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:32:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:32:59.840444 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011a369-6963-43c1-82b6-8dae5abe8b19 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:59.856555 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011a369-6963-43c1-82b6-8dae5abe8b19 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:59.865830 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a59bc1d-2075-435a-a215-2522e8d98612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:59.866644 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59bc1d-2075-435a-a215-2522e8d98612 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:59.866953 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59bc1d-2075-435a-a215-2522e8d98612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:59.867367 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59bc1d-2075-435a-a215-2522e8d98612 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:59.868415 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a59bc1d-2075-435a-a215-2522e8d98612 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:59.868962 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a59bc1d-2075-435a-a215-2522e8d98612 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:59.871555 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a59bc1d-2075-435a-a215-2522e8d98612 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:59.884802 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1259/2496] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:32:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:32:59.889707 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd49aa9f-be2a-4fd1-930e-282fea4f8696 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:59.899350 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd49aa9f-be2a-4fd1-930e-282fea4f8696 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:59.905859 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260c2c5-6ade-4d42-afa2-0ba7b07bf6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:59.906408 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260c2c5-6ade-4d42-afa2-0ba7b07bf6eb admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:59.906718 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260c2c5-6ade-4d42-afa2-0ba7b07bf6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:59.906983 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260c2c5-6ade-4d42-afa2-0ba7b07bf6eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:59.907616 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7260c2c5-6ade-4d42-afa2-0ba7b07bf6eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:59.909623 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7260c2c5-6ade-4d42-afa2-0ba7b07bf6eb admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:59.941657 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1238/2497] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:32:59 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:32:59.947380 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a59bc1d-2075-435a-a215-2522e8d98612 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:59.961610 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a59bc1d-2075-435a-a215-2522e8d98612 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:59.971262 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:00.033585 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc2f441-d6e4-480f-b309-e78cc1ead218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:00.034203 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2f441-d6e4-480f-b309-e78cc1ead218 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:00.034483 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2f441-d6e4-480f-b309-e78cc1ead218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:00.034755 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2f441-d6e4-480f-b309-e78cc1ead218 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:00.035387 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc2f441-d6e4-480f-b309-e78cc1ead218 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:00.037351 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc2f441-d6e4-480f-b309-e78cc1ead218 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:00.064472 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1260/2498] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:32:59 2022] POST /identity/v3/users => generated 287 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:33:00.068852 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260c2c5-6ade-4d42-afa2-0ba7b07bf6eb admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:00.079908 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260c2c5-6ade-4d42-afa2-0ba7b07bf6eb admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:00.085209 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f133fc1-b0d9-4aa3-9a68-afb4f454c2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:00.086088 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f133fc1-b0d9-4aa3-9a68-afb4f454c2df admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:00.086395 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f133fc1-b0d9-4aa3-9a68-afb4f454c2df admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:00.086738 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f133fc1-b0d9-4aa3-9a68-afb4f454c2df admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:00.087205 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f133fc1-b0d9-4aa3-9a68-afb4f454c2df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:00.088848 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f133fc1-b0d9-4aa3-9a68-afb4f454c2df admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:00.099203 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1239/2499] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:33:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:33:00.103595 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc2f441-d6e4-480f-b309-e78cc1ead218 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:00.114653 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc2f441-d6e4-480f-b309-e78cc1ead218 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:00.119958 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b48b979-a95b-4df7-bc33-7687c7fa3c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:00.120799 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48b979-a95b-4df7-bc33-7687c7fa3c26 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:00.121173 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48b979-a95b-4df7-bc33-7687c7fa3c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:00.121436 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48b979-a95b-4df7-bc33-7687c7fa3c26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:00.122085 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b48b979-a95b-4df7-bc33-7687c7fa3c26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:00.123693 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b48b979-a95b-4df7-bc33-7687c7fa3c26 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:00.134094 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1261/2500] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:33:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:33:00.140440 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f133fc1-b0d9-4aa3-9a68-afb4f454c2df admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:00.154710 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f133fc1-b0d9-4aa3-9a68-afb4f454c2df admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:00.160572 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc6a8e0-d8cd-48a8-9067-fc265ee1bb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:00.161227 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6a8e0-d8cd-48a8-9067-fc265ee1bb41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:00.161503 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6a8e0-d8cd-48a8-9067-fc265ee1bb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:00.161769 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6a8e0-d8cd-48a8-9067-fc265ee1bb41 admin admin] PATH_INFO: `/v3/projects/5cec2558ee7e48848418da7669fe8d89/users/7f7aa1946b2644fa96c7e10dea6ef49a/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:00.178604 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc6a8e0-d8cd-48a8-9067-fc265ee1bb41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cec2558ee7e48848418da7669fe8d89, user_id=7f7aa1946b2644fa96c7e10dea6ef49a, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:00.181319 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc6a8e0-d8cd-48a8-9067-fc265ee1bb41 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:00.199043 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1240/2501] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:33:00 2022] PUT /identity/v3/projects/5cec2558ee7e48848418da7669fe8d89/users/7f7aa1946b2644fa96c7e10dea6ef49a/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:33:00.215192 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1863bb8-c61e-4b4d-8a8c-712cc499358c None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:00.215713 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1863bb8-c61e-4b4d-8a8c-712cc499358c None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:00.215713 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1863bb8-c61e-4b4d-8a8c-712cc499358c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:00.248935 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-e1863bb8-c61e-4b4d-8a8c-712cc499358c None None] MFA Rules not processed for user `7f7aa1946b2644fa96c7e10dea6ef49a`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:00.250230 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e1863bb8-c61e-4b4d-8a8c-712cc499358c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:00.321475 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1262/2502] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:33:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:33:00.326647 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc6a8e0-d8cd-48a8-9067-fc265ee1bb41 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:00.394930 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc6a8e0-d8cd-48a8-9067-fc265ee1bb41 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:00.400334 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e836a8d-bc74-42c1-ad39-3d46630b9b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:00.400993 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e836a8d-bc74-42c1-ad39-3d46630b9b60 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:00.401275 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e836a8d-bc74-42c1-ad39-3d46630b9b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:00.401546 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e836a8d-bc74-42c1-ad39-3d46630b9b60 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:00.402168 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e836a8d-bc74-42c1-ad39-3d46630b9b60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:00.404062 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e836a8d-bc74-42c1-ad39-3d46630b9b60 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:00.424473 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:00.442160 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1241/2503] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:33:00 2022] POST /identity/v3/projects => generated 369 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:33:00.443424 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1863bb8-c61e-4b4d-8a8c-712cc499358c None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:00.454495 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1863bb8-c61e-4b4d-8a8c-712cc499358c None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:00.516512 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011fff3-916f-4ddf-b436-aaac69495af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:00.517142 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011fff3-916f-4ddf-b436-aaac69495af6 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:00.517406 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011fff3-916f-4ddf-b436-aaac69495af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:00.517676 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011fff3-916f-4ddf-b436-aaac69495af6 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:00.518313 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e011fff3-916f-4ddf-b436-aaac69495af6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:00.520251 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e011fff3-916f-4ddf-b436-aaac69495af6 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:00.544305 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1263/2504] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:33:00 2022] POST /identity/v3/users => generated 291 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:33:00.548638 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e836a8d-bc74-42c1-ad39-3d46630b9b60 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:00.560850 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e836a8d-bc74-42c1-ad39-3d46630b9b60 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:00.566459 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b38d98-9089-4d36-b3da-4f518b30e289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:00.567090 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b38d98-9089-4d36-b3da-4f518b30e289 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:00.567371 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b38d98-9089-4d36-b3da-4f518b30e289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:00.567638 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b38d98-9089-4d36-b3da-4f518b30e289 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:00.568293 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b38d98-9089-4d36-b3da-4f518b30e289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:00.570042 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b38d98-9089-4d36-b3da-4f518b30e289 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:00.581221 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1242/2505] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:33:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:33:00.585888 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011fff3-916f-4ddf-b436-aaac69495af6 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:00.596224 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011fff3-916f-4ddf-b436-aaac69495af6 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:00.601559 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a9f05-b3d0-4aa2-a2a6-856b0011e430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:00.602279 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a9f05-b3d0-4aa2-a2a6-856b0011e430 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:00.602516 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a9f05-b3d0-4aa2-a2a6-856b0011e430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:00.602787 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a9f05-b3d0-4aa2-a2a6-856b0011e430 admin admin] PATH_INFO: `/v3/projects/b345feff69854b399313cea05c238a19/users/78168f28190b4106b5467c5c5ca6376f/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:00.611606 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:00.619009 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37a9f05-b3d0-4aa2-a2a6-856b0011e430 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b345feff69854b399313cea05c238a19, user_id=78168f28190b4106b5467c5c5ca6376f, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:00.621976 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37a9f05-b3d0-4aa2-a2a6-856b0011e430 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:00.636747 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1264/2506] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:33:00 2022] PUT /identity/v3/projects/b345feff69854b399313cea05c238a19/users/78168f28190b4106b5467c5c5ca6376f/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:33:00.640848 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b38d98-9089-4d36-b3da-4f518b30e289 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:00.652967 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b38d98-9089-4d36-b3da-4f518b30e289 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:00.712579 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0829d2-7327-467e-957e-7de2f5855251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:00.713132 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0829d2-7327-467e-957e-7de2f5855251 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:00.713409 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0829d2-7327-467e-957e-7de2f5855251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:00.713684 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0829d2-7327-467e-957e-7de2f5855251 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:00.714414 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0829d2-7327-467e-957e-7de2f5855251 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:00.716015 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0829d2-7327-467e-957e-7de2f5855251 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:00.725814 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1243/2507] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:33:00 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:33:00.730461 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a9f05-b3d0-4aa2-a2a6-856b0011e430 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:00.741056 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a9f05-b3d0-4aa2-a2a6-856b0011e430 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:00.746106 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bac678-b4e4-493b-8935-2d109f194017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:00.746755 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bac678-b4e4-493b-8935-2d109f194017 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:00.747033 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bac678-b4e4-493b-8935-2d109f194017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:00.747301 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bac678-b4e4-493b-8935-2d109f194017 admin admin] PATH_INFO: `/v3/projects/b345feff69854b399313cea05c238a19/users/78168f28190b4106b5467c5c5ca6376f/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:00.749238 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bac678-b4e4-493b-8935-2d109f194017 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b345feff69854b399313cea05c238a19, user_id=78168f28190b4106b5467c5c5ca6376f, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:00.751858 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bac678-b4e4-493b-8935-2d109f194017 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:00.763025 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1265/2508] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:33:00 2022] PUT /identity/v3/projects/b345feff69854b399313cea05c238a19/users/78168f28190b4106b5467c5c5ca6376f/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:33:00.774529 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf73c5-e3f9-44c2-b1d3-63dc90558cab None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:00.774822 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf73c5-e3f9-44c2-b1d3-63dc90558cab None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:00.775097 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf73c5-e3f9-44c2-b1d3-63dc90558cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:00.806883 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-70bf73c5-e3f9-44c2-b1d3-63dc90558cab None None] MFA Rules not processed for user `78168f28190b4106b5467c5c5ca6376f`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:00.808522 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-70bf73c5-e3f9-44c2-b1d3-63dc90558cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:00.878848 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1244/2509] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:33:00 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:33:00.892025 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bac678-b4e4-493b-8935-2d109f194017 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:00.893921 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-d3bac678-b4e4-493b-8935-2d109f194017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:00.954379 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bac678-b4e4-493b-8935-2d109f194017 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:00.958708 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e93ad17-45a8-40f8-b351-ae1920848727 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:00.959322 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e93ad17-45a8-40f8-b351-ae1920848727 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:00.959594 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e93ad17-45a8-40f8-b351-ae1920848727 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:00.959868 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e93ad17-45a8-40f8-b351-ae1920848727 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:00.970070 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e93ad17-45a8-40f8-b351-ae1920848727 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:00.971451 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e93ad17-45a8-40f8-b351-ae1920848727 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:00.981386 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1266/2510] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:33:00 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:33:01.430106 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf73c5-e3f9-44c2-b1d3-63dc90558cab None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:01.499973 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf73c5-e3f9-44c2-b1d3-63dc90558cab None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:01.504844 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f63726-31ff-4be2-a568-ef738370cff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:01.505487 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f63726-31ff-4be2-a568-ef738370cff2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:01.505770 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f63726-31ff-4be2-a568-ef738370cff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:01.506045 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f63726-31ff-4be2-a568-ef738370cff2 admin admin] PATH_INFO: `/v3/users/7f7aa1946b2644fa96c7e10dea6ef49a` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:01.507503 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f63726-31ff-4be2-a568-ef738370cff2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f7aa1946b2644fa96c7e10dea6ef49a)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:01.509484 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f63726-31ff-4be2-a568-ef738370cff2 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:01.515105 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:01.564128 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-37f63726-31ff-4be2-a568-ef738370cff2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f7aa1946b2644fa96c7e10dea6ef49a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:01.572056 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-37f63726-31ff-4be2-a568-ef738370cff2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f7aa1946b2644fa96c7e10dea6ef49a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:01.572787 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-37f63726-31ff-4be2-a568-ef738370cff2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f7aa1946b2644fa96c7e10dea6ef49a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:01.581202 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-37f63726-31ff-4be2-a568-ef738370cff2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f7aa1946b2644fa96c7e10dea6ef49a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:01.581933 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-37f63726-31ff-4be2-a568-ef738370cff2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f7aa1946b2644fa96c7e10dea6ef49a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:01.607687 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1245/2511] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:33:01 2022] DELETE /identity/v3/users/7f7aa1946b2644fa96c7e10dea6ef49a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:33:01.610300 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b363c9-411e-4b34-8ca1-ce95d7002f0b None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:01.610790 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b363c9-411e-4b34-8ca1-ce95d7002f0b None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:01.610904 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b363c9-411e-4b34-8ca1-ce95d7002f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:01.630420 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-63b363c9-411e-4b34-8ca1-ce95d7002f0b None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:01.631922 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-63b363c9-411e-4b34-8ca1-ce95d7002f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:01.708099 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1267/2512] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:33:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:33:01.720281 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f63726-31ff-4be2-a568-ef738370cff2 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:01.722220 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-37f63726-31ff-4be2-a568-ef738370cff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:01.795047 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f63726-31ff-4be2-a568-ef738370cff2 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:01.799900 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e3ded-774b-466e-91b7-67c8d2f6489f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:01.800546 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e3ded-774b-466e-91b7-67c8d2f6489f service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:01.800857 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e3ded-774b-466e-91b7-67c8d2f6489f service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:01.801093 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e3ded-774b-466e-91b7-67c8d2f6489f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:01.812172 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e3ded-774b-466e-91b7-67c8d2f6489f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:01.813646 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e3ded-774b-466e-91b7-67c8d2f6489f service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:01.823524 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1246/2513] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:33:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:33:02.370081 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b363c9-411e-4b34-8ca1-ce95d7002f0b None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:02.371926 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-63b363c9-411e-4b34-8ca1-ce95d7002f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:02.386204 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b363c9-411e-4b34-8ca1-ce95d7002f0b None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:02.391556 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77467f2b-21ea-45c0-abce-590e91192ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:02.392240 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77467f2b-21ea-45c0-abce-590e91192ea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:02.392586 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77467f2b-21ea-45c0-abce-590e91192ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:02.392893 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77467f2b-21ea-45c0-abce-590e91192ea9 admin admin] PATH_INFO: `/v3/projects/5cec2558ee7e48848418da7669fe8d89` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:02.394091 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77467f2b-21ea-45c0-abce-590e91192ea9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cec2558ee7e48848418da7669fe8d89)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:02.396162 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77467f2b-21ea-45c0-abce-590e91192ea9 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:02.446176 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-77467f2b-21ea-45c0-abce-590e91192ea9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cec2558ee7e48848418da7669fe8d89', 'request_id': 'req-77467f2b-21ea-45c0-abce-590e91192ea9'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:02.452321 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-77467f2b-21ea-45c0-abce-590e91192ea9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cec2558ee7e48848418da7669fe8d89', 'request_id': 'req-77467f2b-21ea-45c0-abce-590e91192ea9'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:02.458073 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-77467f2b-21ea-45c0-abce-590e91192ea9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cec2558ee7e48848418da7669fe8d89', 'request_id': 'req-77467f2b-21ea-45c0-abce-590e91192ea9'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:02.470034 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:02.474139 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-77467f2b-21ea-45c0-abce-590e91192ea9 admin admin] The token cache is being invalidate because project 5cec2558ee7e48848418da7669fe8d89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:33:02.474557 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-77467f2b-21ea-45c0-abce-590e91192ea9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:02.475215 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-77467f2b-21ea-45c0-abce-590e91192ea9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:02.476758 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1268/2514] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:33:02 2022] DELETE /identity/v3/projects/5cec2558ee7e48848418da7669fe8d89 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:33:02.481660 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e3ded-774b-466e-91b7-67c8d2f6489f service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:02.491473 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e3ded-774b-466e-91b7-67c8d2f6489f service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:02.550118 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f138fd7-34ae-4264-9dfb-f67dd55f06dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:02.550762 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f138fd7-34ae-4264-9dfb-f67dd55f06dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:02.551031 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f138fd7-34ae-4264-9dfb-f67dd55f06dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:02.551315 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f138fd7-34ae-4264-9dfb-f67dd55f06dc admin admin] PATH_INFO: `/v3/users/78168f28190b4106b5467c5c5ca6376f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:02.552444 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f138fd7-34ae-4264-9dfb-f67dd55f06dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=78168f28190b4106b5467c5c5ca6376f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:02.554400 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f138fd7-34ae-4264-9dfb-f67dd55f06dc admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:02.590499 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:02.607421 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9f138fd7-34ae-4264-9dfb-f67dd55f06dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78168f28190b4106b5467c5c5ca6376f'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:02.614117 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9f138fd7-34ae-4264-9dfb-f67dd55f06dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78168f28190b4106b5467c5c5ca6376f'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:02.614785 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9f138fd7-34ae-4264-9dfb-f67dd55f06dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78168f28190b4106b5467c5c5ca6376f'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:02.623229 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9f138fd7-34ae-4264-9dfb-f67dd55f06dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78168f28190b4106b5467c5c5ca6376f'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:02.624062 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9f138fd7-34ae-4264-9dfb-f67dd55f06dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78168f28190b4106b5467c5c5ca6376f'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:02.643985 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1247/2515] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:33:02 2022] DELETE /identity/v3/users/78168f28190b4106b5467c5c5ca6376f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:33:02.944026 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77467f2b-21ea-45c0-abce-590e91192ea9 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:02.945683 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-77467f2b-21ea-45c0-abce-590e91192ea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:02.959142 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77467f2b-21ea-45c0-abce-590e91192ea9 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:03.017642 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c86228-175c-4c9e-90af-27c5ff39459a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:03.018279 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c86228-175c-4c9e-90af-27c5ff39459a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:03.018556 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c86228-175c-4c9e-90af-27c5ff39459a admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:03.018825 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c86228-175c-4c9e-90af-27c5ff39459a admin admin] PATH_INFO: `/v3/projects/b345feff69854b399313cea05c238a19` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:03.019928 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c86228-175c-4c9e-90af-27c5ff39459a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b345feff69854b399313cea05c238a19)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:03.021882 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c86228-175c-4c9e-90af-27c5ff39459a admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:03.073597 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-08c86228-175c-4c9e-90af-27c5ff39459a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b345feff69854b399313cea05c238a19', 'request_id': 'req-08c86228-175c-4c9e-90af-27c5ff39459a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:03.079691 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-08c86228-175c-4c9e-90af-27c5ff39459a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b345feff69854b399313cea05c238a19', 'request_id': 'req-08c86228-175c-4c9e-90af-27c5ff39459a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:03.085245 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-08c86228-175c-4c9e-90af-27c5ff39459a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b345feff69854b399313cea05c238a19', 'request_id': 'req-08c86228-175c-4c9e-90af-27c5ff39459a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:03.099276 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-08c86228-175c-4c9e-90af-27c5ff39459a admin admin] The token cache is being invalidate because project b345feff69854b399313cea05c238a19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:33:03.099576 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-08c86228-175c-4c9e-90af-27c5ff39459a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:03.100184 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-08c86228-175c-4c9e-90af-27c5ff39459a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:03.101687 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1269/2516] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:33:02 2022] DELETE /identity/v3/projects/b345feff69854b399313cea05c238a19 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:33:03.106857 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e27573-1f11-45a1-9dd3-cb36f2854a8d None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:03.107147 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e27573-1f11-45a1-9dd3-cb36f2854a8d None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:03.107476 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e27573-1f11-45a1-9dd3-cb36f2854a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:03.132059 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-b5e27573-1f11-45a1-9dd3-cb36f2854a8d None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:03.133341 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b5e27573-1f11-45a1-9dd3-cb36f2854a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:03.214677 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1248/2517] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:33:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:33:03.225187 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07f18d-8b84-4db1-94a6-18ba776fb9aa None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:03.225471 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07f18d-8b84-4db1-94a6-18ba776fb9aa None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:03.225745 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07f18d-8b84-4db1-94a6-18ba776fb9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:03.248410 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-ac07f18d-8b84-4db1-94a6-18ba776fb9aa None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:03.250002 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-ac07f18d-8b84-4db1-94a6-18ba776fb9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:03.259911 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1270/2518] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:33:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:33:03.264828 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e27573-1f11-45a1-9dd3-cb36f2854a8d None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:03.275024 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e27573-1f11-45a1-9dd3-cb36f2854a8d None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:03.280912 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17621ab5-65be-406f-8f36-46fbc688abb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:03.281525 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17621ab5-65be-406f-8f36-46fbc688abb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:03.281773 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17621ab5-65be-406f-8f36-46fbc688abb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:03.282054 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17621ab5-65be-406f-8f36-46fbc688abb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:03.282707 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17621ab5-65be-406f-8f36-46fbc688abb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:03.283011 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17621ab5-65be-406f-8f36-46fbc688abb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:03.284649 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17621ab5-65be-406f-8f36-46fbc688abb7 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:03.298043 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1249/2519] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:33:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:03.302178 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac07f18d-8b84-4db1-94a6-18ba776fb9aa None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:03.312523 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac07f18d-8b84-4db1-94a6-18ba776fb9aa None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:03.317814 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec7b4b-d564-4471-9bb7-693c35acc529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:03.318418 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec7b4b-d564-4471-9bb7-693c35acc529 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:03.318698 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec7b4b-d564-4471-9bb7-693c35acc529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:03.318972 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec7b4b-d564-4471-9bb7-693c35acc529 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:03.319600 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec7b4b-d564-4471-9bb7-693c35acc529 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:03.321528 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec7b4b-d564-4471-9bb7-693c35acc529 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:03.357079 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1271/2520] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:33:03 2022] POST /identity/v3/projects => generated 365 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:33:03.361252 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17621ab5-65be-406f-8f36-46fbc688abb7 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:03.371943 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17621ab5-65be-406f-8f36-46fbc688abb7 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:03.431698 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e2ded-2c20-4ac6-8049-6f8345409f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:03.432348 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e2ded-2c20-4ac6-8049-6f8345409f96 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:03.432696 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e2ded-2c20-4ac6-8049-6f8345409f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:03.433021 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e2ded-2c20-4ac6-8049-6f8345409f96 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:03.434190 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0e2ded-2c20-4ac6-8049-6f8345409f96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:03.436139 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0e2ded-2c20-4ac6-8049-6f8345409f96 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:03.458903 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1250/2521] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:33:03 2022] POST /identity/v3/users => generated 283 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:33:03.463682 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec7b4b-d564-4471-9bb7-693c35acc529 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:03.479679 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec7b4b-d564-4471-9bb7-693c35acc529 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:03.485649 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1045491-7542-4a04-ae3f-0e1dde3a6618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:03.486266 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1045491-7542-4a04-ae3f-0e1dde3a6618 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:03.486545 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1045491-7542-4a04-ae3f-0e1dde3a6618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:03.486821 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1045491-7542-4a04-ae3f-0e1dde3a6618 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:03.487470 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1045491-7542-4a04-ae3f-0e1dde3a6618 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:03.489126 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1045491-7542-4a04-ae3f-0e1dde3a6618 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:03.500022 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1272/2522] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:33:03.504247 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e2ded-2c20-4ac6-8049-6f8345409f96 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:03.515812 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e2ded-2c20-4ac6-8049-6f8345409f96 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:03.521122 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7170fcd2-652a-4224-a250-4d50695f9165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:03.521748 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170fcd2-652a-4224-a250-4d50695f9165 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:03.522013 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170fcd2-652a-4224-a250-4d50695f9165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:03.522295 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170fcd2-652a-4224-a250-4d50695f9165 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:03.522944 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7170fcd2-652a-4224-a250-4d50695f9165 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:03.524580 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7170fcd2-652a-4224-a250-4d50695f9165 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:03.536421 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1251/2523] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:33:03.541239 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1045491-7542-4a04-ae3f-0e1dde3a6618 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:03.552180 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1045491-7542-4a04-ae3f-0e1dde3a6618 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:03.557323 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b8e11-3820-488c-a2f2-f281f8fdcc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:03.558026 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b8e11-3820-488c-a2f2-f281f8fdcc10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:03.558477 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b8e11-3820-488c-a2f2-f281f8fdcc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:03.558948 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b8e11-3820-488c-a2f2-f281f8fdcc10 admin admin] PATH_INFO: `/v3/projects/5c1b6adbb87e44e4b6f6d6a0330a1e03/users/e000da3e99c348c6b53e145958aa8920/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:03.574725 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003b8e11-3820-488c-a2f2-f281f8fdcc10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c1b6adbb87e44e4b6f6d6a0330a1e03, user_id=e000da3e99c348c6b53e145958aa8920, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:03.577435 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003b8e11-3820-488c-a2f2-f281f8fdcc10 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:03.592186 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1273/2524] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:33:03 2022] PUT /identity/v3/projects/5c1b6adbb87e44e4b6f6d6a0330a1e03/users/e000da3e99c348c6b53e145958aa8920/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:33:03.602551 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7f57f-b6ae-468c-a854-6e7f230f3cc8 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:03.603115 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7f57f-b6ae-468c-a854-6e7f230f3cc8 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:03.603115 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7f57f-b6ae-468c-a854-6e7f230f3cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:03.633238 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:03.637558 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-42d7f57f-b6ae-468c-a854-6e7f230f3cc8 None None] MFA Rules not processed for user `e000da3e99c348c6b53e145958aa8920`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:03.640215 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-42d7f57f-b6ae-468c-a854-6e7f230f3cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:03.712039 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1252/2525] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:33:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:33:03.716869 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b8e11-3820-488c-a2f2-f281f8fdcc10 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:03.747735 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:03.782914 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b8e11-3820-488c-a2f2-f281f8fdcc10 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:03.787815 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed852b-43bc-4bbd-809d-8feb89cf62bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:03.788423 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed852b-43bc-4bbd-809d-8feb89cf62bb admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:03.788832 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed852b-43bc-4bbd-809d-8feb89cf62bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:03.789117 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed852b-43bc-4bbd-809d-8feb89cf62bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:03.789741 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ed852b-43bc-4bbd-809d-8feb89cf62bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:03.791637 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ed852b-43bc-4bbd-809d-8feb89cf62bb admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:03.821021 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1274/2526] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:33:03 2022] POST /identity/v3/projects => generated 365 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:33:03.825473 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7f57f-b6ae-468c-a854-6e7f230f3cc8 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:03.836741 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7f57f-b6ae-468c-a854-6e7f230f3cc8 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:03.896760 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64744bf-bfa2-40e5-9933-28369304cd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:03.897459 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64744bf-bfa2-40e5-9933-28369304cd59 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:03.897616 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64744bf-bfa2-40e5-9933-28369304cd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:03.897896 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64744bf-bfa2-40e5-9933-28369304cd59 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:03.898538 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64744bf-bfa2-40e5-9933-28369304cd59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:03.900488 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64744bf-bfa2-40e5-9933-28369304cd59 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:03.926695 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1253/2527] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:33:03 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:33:03.927895 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed852b-43bc-4bbd-809d-8feb89cf62bb admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:03.938753 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed852b-43bc-4bbd-809d-8feb89cf62bb admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:03.943235 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8175fa6-410d-47b6-b5a0-68531ab3d606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:03.943873 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8175fa6-410d-47b6-b5a0-68531ab3d606 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:03.944133 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8175fa6-410d-47b6-b5a0-68531ab3d606 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:03.944715 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8175fa6-410d-47b6-b5a0-68531ab3d606 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:03.945059 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8175fa6-410d-47b6-b5a0-68531ab3d606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:03.946692 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8175fa6-410d-47b6-b5a0-68531ab3d606 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:03.957534 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1275/2528] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:33:03.962091 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64744bf-bfa2-40e5-9933-28369304cd59 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:03.972624 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64744bf-bfa2-40e5-9933-28369304cd59 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:03.977494 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20fb0a4-d4ce-442f-9fb9-8dbe43c1d63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:03.978217 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20fb0a4-d4ce-442f-9fb9-8dbe43c1d63c admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:03.978589 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20fb0a4-d4ce-442f-9fb9-8dbe43c1d63c admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:03.978950 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20fb0a4-d4ce-442f-9fb9-8dbe43c1d63c admin admin] PATH_INFO: `/v3/projects/f5778ce6fd8a444abed6f491a5f241f0/users/e47d270b8d0a437cb6f0e119eb40f2fe/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:03.995481 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20fb0a4-d4ce-442f-9fb9-8dbe43c1d63c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5778ce6fd8a444abed6f491a5f241f0, user_id=e47d270b8d0a437cb6f0e119eb40f2fe, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:03.998141 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20fb0a4-d4ce-442f-9fb9-8dbe43c1d63c admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:04.012416 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1254/2529] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:33:03 2022] PUT /identity/v3/projects/f5778ce6fd8a444abed6f491a5f241f0/users/e47d270b8d0a437cb6f0e119eb40f2fe/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:33:04.016533 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8175fa6-410d-47b6-b5a0-68531ab3d606 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:04.026385 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8175fa6-410d-47b6-b5a0-68531ab3d606 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:04.091252 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de2f6e-5f98-44ab-b865-82ae436c42c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:04.091858 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de2f6e-5f98-44ab-b865-82ae436c42c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:04.092136 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de2f6e-5f98-44ab-b865-82ae436c42c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:04.092410 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de2f6e-5f98-44ab-b865-82ae436c42c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:04.093083 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2de2f6e-5f98-44ab-b865-82ae436c42c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:04.094686 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2de2f6e-5f98-44ab-b865-82ae436c42c4 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:04.104912 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1276/2530] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:33:04.109376 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20fb0a4-d4ce-442f-9fb9-8dbe43c1d63c admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:04.120795 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20fb0a4-d4ce-442f-9fb9-8dbe43c1d63c admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:04.127272 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e77de-ef60-48c6-a85d-7ae4405182ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:04.128319 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e77de-ef60-48c6-a85d-7ae4405182ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:04.128754 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e77de-ef60-48c6-a85d-7ae4405182ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:04.129123 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e77de-ef60-48c6-a85d-7ae4405182ff admin admin] PATH_INFO: `/v3/projects/f5778ce6fd8a444abed6f491a5f241f0/users/e47d270b8d0a437cb6f0e119eb40f2fe/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:04.132889 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8e77de-ef60-48c6-a85d-7ae4405182ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5778ce6fd8a444abed6f491a5f241f0, user_id=e47d270b8d0a437cb6f0e119eb40f2fe, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:04.136967 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8e77de-ef60-48c6-a85d-7ae4405182ff admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:04.149320 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1255/2531] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:33:04 2022] PUT /identity/v3/projects/f5778ce6fd8a444abed6f491a5f241f0/users/e47d270b8d0a437cb6f0e119eb40f2fe/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:33:04.161214 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b363ce-c415-4fe8-99f8-0deea9a4e3e6 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:04.161507 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b363ce-c415-4fe8-99f8-0deea9a4e3e6 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:04.161772 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b363ce-c415-4fe8-99f8-0deea9a4e3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:04.199228 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-75b363ce-c415-4fe8-99f8-0deea9a4e3e6 None None] MFA Rules not processed for user `e47d270b8d0a437cb6f0e119eb40f2fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:04.200440 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-75b363ce-c415-4fe8-99f8-0deea9a4e3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:04.274592 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1277/2532] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:33:04 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:33:04.286282 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e77de-ef60-48c6-a85d-7ae4405182ff admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:04.288104 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-0e8e77de-ef60-48c6-a85d-7ae4405182ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:04.348722 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e77de-ef60-48c6-a85d-7ae4405182ff admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:04.352746 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daf05a3-c508-4806-b4fb-75591b90a1aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:04.353359 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf05a3-c508-4806-b4fb-75591b90a1aa service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:04.353632 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf05a3-c508-4806-b4fb-75591b90a1aa service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:04.353920 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf05a3-c508-4806-b4fb-75591b90a1aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:04.363035 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daf05a3-c508-4806-b4fb-75591b90a1aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:04.364498 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daf05a3-c508-4806-b4fb-75591b90a1aa service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:04.368276 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:04.377134 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1256/2533] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:33:04 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:33:04.461777 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b363ce-c415-4fe8-99f8-0deea9a4e3e6 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:04.472966 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b363ce-c415-4fe8-99f8-0deea9a4e3e6 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:04.477208 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fedea51-6642-4832-82d1-9a3327b08265 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:04.477821 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fedea51-6642-4832-82d1-9a3327b08265 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:04.478100 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fedea51-6642-4832-82d1-9a3327b08265 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:04.478387 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fedea51-6642-4832-82d1-9a3327b08265 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:04.501812 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:04.553510 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fedea51-6642-4832-82d1-9a3327b08265 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:04.555217 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fedea51-6642-4832-82d1-9a3327b08265 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:04.565889 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1278/2534] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:33:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:33:07.378193 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daf05a3-c508-4806-b4fb-75591b90a1aa service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:07.446599 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daf05a3-c508-4806-b4fb-75591b90a1aa service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:07.451559 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b4fd6-e6b0-4be5-b322-217947114e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:07.452235 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b4fd6-e6b0-4be5-b322-217947114e77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:07.452552 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b4fd6-e6b0-4be5-b322-217947114e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:07.452828 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b4fd6-e6b0-4be5-b322-217947114e77 admin admin] PATH_INFO: `/v3/users/e000da3e99c348c6b53e145958aa8920` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:07.453962 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b4fd6-e6b0-4be5-b322-217947114e77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e000da3e99c348c6b53e145958aa8920)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:07.455885 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b4fd6-e6b0-4be5-b322-217947114e77 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:07.508182 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f00b4fd6-e6b0-4be5-b322-217947114e77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e000da3e99c348c6b53e145958aa8920'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:07.516509 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f00b4fd6-e6b0-4be5-b322-217947114e77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e000da3e99c348c6b53e145958aa8920'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:07.517331 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f00b4fd6-e6b0-4be5-b322-217947114e77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e000da3e99c348c6b53e145958aa8920'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:07.531335 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f00b4fd6-e6b0-4be5-b322-217947114e77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e000da3e99c348c6b53e145958aa8920'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:07.532064 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f00b4fd6-e6b0-4be5-b322-217947114e77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e000da3e99c348c6b53e145958aa8920'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:07.556785 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1257/2535] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:33:07 2022] DELETE /identity/v3/users/e000da3e99c348c6b53e145958aa8920 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:33:07.562568 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cfce5d-9f73-423b-9372-82a9312ab370 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:07.563065 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cfce5d-9f73-423b-9372-82a9312ab370 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:07.563167 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cfce5d-9f73-423b-9372-82a9312ab370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:07.587255 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-62cfce5d-9f73-423b-9372-82a9312ab370 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:07.588729 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-62cfce5d-9f73-423b-9372-82a9312ab370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:07.660220 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1279/2536] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:33:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:33:07.674325 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b4fd6-e6b0-4be5-b322-217947114e77 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:07.676013 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f00b4fd6-e6b0-4be5-b322-217947114e77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:07.740236 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b4fd6-e6b0-4be5-b322-217947114e77 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:07.744248 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db112b25-9273-4aec-8c1c-80ee58c5309e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:07.744915 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db112b25-9273-4aec-8c1c-80ee58c5309e service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:07.745196 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db112b25-9273-4aec-8c1c-80ee58c5309e service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:07.745503 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db112b25-9273-4aec-8c1c-80ee58c5309e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:07.755391 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db112b25-9273-4aec-8c1c-80ee58c5309e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:07.757310 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db112b25-9273-4aec-8c1c-80ee58c5309e service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:07.767632 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1258/2537] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:33:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:33:08.058842 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cfce5d-9f73-423b-9372-82a9312ab370 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:08.060302 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-62cfce5d-9f73-423b-9372-82a9312ab370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:08.074766 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cfce5d-9f73-423b-9372-82a9312ab370 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:08.080131 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5d65e6-1fa9-481f-9708-8386d567cacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:08.081572 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d65e6-1fa9-481f-9708-8386d567cacd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:08.081866 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d65e6-1fa9-481f-9708-8386d567cacd admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:08.082276 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d65e6-1fa9-481f-9708-8386d567cacd admin admin] PATH_INFO: `/v3/projects/5c1b6adbb87e44e4b6f6d6a0330a1e03` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:08.083331 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5d65e6-1fa9-481f-9708-8386d567cacd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c1b6adbb87e44e4b6f6d6a0330a1e03)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:08.085374 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5d65e6-1fa9-481f-9708-8386d567cacd admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:08.133897 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9d5d65e6-1fa9-481f-9708-8386d567cacd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c1b6adbb87e44e4b6f6d6a0330a1e03', 'request_id': 'req-9d5d65e6-1fa9-481f-9708-8386d567cacd'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:08.140426 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9d5d65e6-1fa9-481f-9708-8386d567cacd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c1b6adbb87e44e4b6f6d6a0330a1e03', 'request_id': 'req-9d5d65e6-1fa9-481f-9708-8386d567cacd'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:08.146473 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9d5d65e6-1fa9-481f-9708-8386d567cacd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c1b6adbb87e44e4b6f6d6a0330a1e03', 'request_id': 'req-9d5d65e6-1fa9-481f-9708-8386d567cacd'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:08.161278 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9d5d65e6-1fa9-481f-9708-8386d567cacd admin admin] The token cache is being invalidate because project 5c1b6adbb87e44e4b6f6d6a0330a1e03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:33:08.161574 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9d5d65e6-1fa9-481f-9708-8386d567cacd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:08.162250 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9d5d65e6-1fa9-481f-9708-8386d567cacd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:08.163867 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1280/2538] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:33:08 2022] DELETE /identity/v3/projects/5c1b6adbb87e44e4b6f6d6a0330a1e03 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:33:08.168204 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db112b25-9273-4aec-8c1c-80ee58c5309e service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:08.178251 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db112b25-9273-4aec-8c1c-80ee58c5309e service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:08.195461 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:08.238677 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8139028-d24e-4338-91d1-a40364bfaa82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:08.239311 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8139028-d24e-4338-91d1-a40364bfaa82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:08.239595 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8139028-d24e-4338-91d1-a40364bfaa82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:08.239870 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8139028-d24e-4338-91d1-a40364bfaa82 admin admin] PATH_INFO: `/v3/users/e47d270b8d0a437cb6f0e119eb40f2fe` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:08.241156 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8139028-d24e-4338-91d1-a40364bfaa82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e47d270b8d0a437cb6f0e119eb40f2fe)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:08.243093 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8139028-d24e-4338-91d1-a40364bfaa82 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:08.290823 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c8139028-d24e-4338-91d1-a40364bfaa82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e47d270b8d0a437cb6f0e119eb40f2fe'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:08.297835 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c8139028-d24e-4338-91d1-a40364bfaa82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e47d270b8d0a437cb6f0e119eb40f2fe'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:08.299383 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c8139028-d24e-4338-91d1-a40364bfaa82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e47d270b8d0a437cb6f0e119eb40f2fe'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:08.308554 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c8139028-d24e-4338-91d1-a40364bfaa82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e47d270b8d0a437cb6f0e119eb40f2fe'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:08.309686 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c8139028-d24e-4338-91d1-a40364bfaa82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e47d270b8d0a437cb6f0e119eb40f2fe'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:08.327957 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1259/2539] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:33:08 2022] DELETE /identity/v3/users/e47d270b8d0a437cb6f0e119eb40f2fe => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:33:08.567107 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5d65e6-1fa9-481f-9708-8386d567cacd admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:08.568799 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-9d5d65e6-1fa9-481f-9708-8386d567cacd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:08.623510 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:08.639539 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5d65e6-1fa9-481f-9708-8386d567cacd admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:08.666687 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8139028-d24e-4338-91d1-a40364bfaa82 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:08.670481 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c8139028-d24e-4338-91d1-a40364bfaa82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:08.733216 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e3ddc3-5d1f-4568-8b7f-0f37d86f7020 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:08.733848 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3ddc3-5d1f-4568-8b7f-0f37d86f7020 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:08.734130 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3ddc3-5d1f-4568-8b7f-0f37d86f7020 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:08.734400 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3ddc3-5d1f-4568-8b7f-0f37d86f7020 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:08.736192 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a6e3ddc3-5d1f-4568-8b7f-0f37d86f7020 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:08.746082 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e3ddc3-5d1f-4568-8b7f-0f37d86f7020 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:08.747528 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e3ddc3-5d1f-4568-8b7f-0f37d86f7020 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:08.756079 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1281/2540] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:33:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:33:08.758318 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8139028-d24e-4338-91d1-a40364bfaa82 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:08.763521 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52075c1-0555-4b85-8d29-e60dfd11327f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:08.764167 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52075c1-0555-4b85-8d29-e60dfd11327f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:08.764498 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52075c1-0555-4b85-8d29-e60dfd11327f admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:08.764779 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52075c1-0555-4b85-8d29-e60dfd11327f admin admin] PATH_INFO: `/v3/projects/f5778ce6fd8a444abed6f491a5f241f0` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:08.765917 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52075c1-0555-4b85-8d29-e60dfd11327f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5778ce6fd8a444abed6f491a5f241f0)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:08.767864 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52075c1-0555-4b85-8d29-e60dfd11327f admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:08.810767 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:08.818163 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e52075c1-0555-4b85-8d29-e60dfd11327f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5778ce6fd8a444abed6f491a5f241f0', 'request_id': 'req-e52075c1-0555-4b85-8d29-e60dfd11327f'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:08.826083 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e52075c1-0555-4b85-8d29-e60dfd11327f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5778ce6fd8a444abed6f491a5f241f0', 'request_id': 'req-e52075c1-0555-4b85-8d29-e60dfd11327f'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:08.834317 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e52075c1-0555-4b85-8d29-e60dfd11327f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5778ce6fd8a444abed6f491a5f241f0', 'request_id': 'req-e52075c1-0555-4b85-8d29-e60dfd11327f'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:08.845640 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e52075c1-0555-4b85-8d29-e60dfd11327f admin admin] The token cache is being invalidate because project f5778ce6fd8a444abed6f491a5f241f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:33:08.845931 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e52075c1-0555-4b85-8d29-e60dfd11327f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:08.846616 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e52075c1-0555-4b85-8d29-e60dfd11327f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:08.848483 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1260/2541] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:33:08 2022] DELETE /identity/v3/projects/f5778ce6fd8a444abed6f491a5f241f0 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:33:08.853197 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660de231-d492-4ecc-9402-2b1fb401332b None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:08.853618 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660de231-d492-4ecc-9402-2b1fb401332b None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:08.853988 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660de231-d492-4ecc-9402-2b1fb401332b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:08.875754 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-660de231-d492-4ecc-9402-2b1fb401332b None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:08.877078 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-660de231-d492-4ecc-9402-2b1fb401332b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:08.936813 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1282/2542] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:33:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:33:08.944729 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac807c92-0f43-4b56-b4d3-423691ec5c3e None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:08.945090 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac807c92-0f43-4b56-b4d3-423691ec5c3e None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:08.945449 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac807c92-0f43-4b56-b4d3-423691ec5c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:08.967494 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-ac807c92-0f43-4b56-b4d3-423691ec5c3e None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:08.968825 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ac807c92-0f43-4b56-b4d3-423691ec5c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:08.980146 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1261/2543] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:33:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:33:08.985003 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660de231-d492-4ecc-9402-2b1fb401332b None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:08.995280 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660de231-d492-4ecc-9402-2b1fb401332b None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:09.001629 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef86ee-b311-4775-aff4-db03811f9768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:09.002294 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef86ee-b311-4775-aff4-db03811f9768 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:09.002568 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef86ee-b311-4775-aff4-db03811f9768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:09.002833 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef86ee-b311-4775-aff4-db03811f9768 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:09.003507 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aef86ee-b311-4775-aff4-db03811f9768 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:09.003789 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aef86ee-b311-4775-aff4-db03811f9768 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:09.006786 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aef86ee-b311-4775-aff4-db03811f9768 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:09.022299 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1283/2544] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:33:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:09.027475 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac807c92-0f43-4b56-b4d3-423691ec5c3e None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:09.037918 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac807c92-0f43-4b56-b4d3-423691ec5c3e None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:09.044413 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913a139-33a0-4fae-bc0c-b13644558196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:09.045070 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913a139-33a0-4fae-bc0c-b13644558196 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:09.045346 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913a139-33a0-4fae-bc0c-b13644558196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:09.045734 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913a139-33a0-4fae-bc0c-b13644558196 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:09.046681 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a913a139-33a0-4fae-bc0c-b13644558196 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:09.048686 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a913a139-33a0-4fae-bc0c-b13644558196 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:09.084236 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1262/2545] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:33:09 2022] POST /identity/v3/projects => generated 363 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:33:09.085534 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef86ee-b311-4775-aff4-db03811f9768 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:09.097349 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef86ee-b311-4775-aff4-db03811f9768 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:09.165116 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed5025-38d4-4a82-8d00-95292741b46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:09.165902 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed5025-38d4-4a82-8d00-95292741b46a admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:09.166286 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed5025-38d4-4a82-8d00-95292741b46a admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:09.166698 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed5025-38d4-4a82-8d00-95292741b46a admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:09.167800 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ed5025-38d4-4a82-8d00-95292741b46a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:09.171094 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ed5025-38d4-4a82-8d00-95292741b46a admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:09.194798 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1284/2546] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:33:09 2022] POST /identity/v3/users => generated 282 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:33:09.199506 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913a139-33a0-4fae-bc0c-b13644558196 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:09.210392 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913a139-33a0-4fae-bc0c-b13644558196 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:09.215887 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07607132-c005-4d52-aa4b-2db0d238396d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:09.216553 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07607132-c005-4d52-aa4b-2db0d238396d admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:09.216838 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07607132-c005-4d52-aa4b-2db0d238396d admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:09.217114 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07607132-c005-4d52-aa4b-2db0d238396d admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:09.217771 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07607132-c005-4d52-aa4b-2db0d238396d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:09.219397 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07607132-c005-4d52-aa4b-2db0d238396d admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:09.231282 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1263/2547] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:33:09.235691 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed5025-38d4-4a82-8d00-95292741b46a admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:09.246264 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed5025-38d4-4a82-8d00-95292741b46a admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:09.251578 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6613d90-f78f-4f88-bce3-ec4615311af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:09.252340 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6613d90-f78f-4f88-bce3-ec4615311af1 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:09.252658 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6613d90-f78f-4f88-bce3-ec4615311af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:09.252929 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6613d90-f78f-4f88-bce3-ec4615311af1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:09.253574 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6613d90-f78f-4f88-bce3-ec4615311af1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:09.255171 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6613d90-f78f-4f88-bce3-ec4615311af1 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:09.267952 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1285/2548] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:33:09.272421 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07607132-c005-4d52-aa4b-2db0d238396d admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:09.282827 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07607132-c005-4d52-aa4b-2db0d238396d admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:09.287497 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a730f18-1f16-4721-8eda-482827460b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:09.288155 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a730f18-1f16-4721-8eda-482827460b6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:09.288434 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a730f18-1f16-4721-8eda-482827460b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:09.288734 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a730f18-1f16-4721-8eda-482827460b6f admin admin] PATH_INFO: `/v3/projects/d2f5a580ca284fe59fffd4669004f168/users/bd675296f0694ef7a124318cce88adee/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:09.303960 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a730f18-1f16-4721-8eda-482827460b6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2f5a580ca284fe59fffd4669004f168, user_id=bd675296f0694ef7a124318cce88adee, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:09.306651 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a730f18-1f16-4721-8eda-482827460b6f admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:09.321271 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1264/2549] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:33:09 2022] PUT /identity/v3/projects/d2f5a580ca284fe59fffd4669004f168/users/bd675296f0694ef7a124318cce88adee/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:33:09.333706 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5857a-aab7-472e-86dc-af13e1934129 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:09.333993 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5857a-aab7-472e-86dc-af13e1934129 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:09.334334 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5857a-aab7-472e-86dc-af13e1934129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:09.354581 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:09.367828 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-c5c5857a-aab7-472e-86dc-af13e1934129 None None] MFA Rules not processed for user `bd675296f0694ef7a124318cce88adee`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:09.369082 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c5c5857a-aab7-472e-86dc-af13e1934129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:09.436972 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1286/2550] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:33:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:33:09.441530 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a730f18-1f16-4721-8eda-482827460b6f admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:09.505134 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a730f18-1f16-4721-8eda-482827460b6f admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:09.510010 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bfb0fd-663b-4989-a38d-ee7f07d144fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:09.510647 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bfb0fd-663b-4989-a38d-ee7f07d144fa admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:09.510924 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bfb0fd-663b-4989-a38d-ee7f07d144fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:09.511249 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bfb0fd-663b-4989-a38d-ee7f07d144fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:09.511913 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bfb0fd-663b-4989-a38d-ee7f07d144fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:09.513830 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bfb0fd-663b-4989-a38d-ee7f07d144fa admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:09.543449 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1265/2551] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:33:09 2022] POST /identity/v3/projects => generated 367 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:33:09.548990 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c5857a-aab7-472e-86dc-af13e1934129 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:09.560724 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c5857a-aab7-472e-86dc-af13e1934129 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:09.623305 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41654a-4c01-42f3-a59b-d290fe45f417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:09.624065 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41654a-4c01-42f3-a59b-d290fe45f417 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:09.624065 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41654a-4c01-42f3-a59b-d290fe45f417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:09.624358 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41654a-4c01-42f3-a59b-d290fe45f417 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:09.625023 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f41654a-4c01-42f3-a59b-d290fe45f417 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:09.626944 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f41654a-4c01-42f3-a59b-d290fe45f417 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:09.651354 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1287/2552] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:33:09 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:33:09.655842 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bfb0fd-663b-4989-a38d-ee7f07d144fa admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:09.666193 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bfb0fd-663b-4989-a38d-ee7f07d144fa admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:09.670934 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ca4f4-6006-44a6-acbc-8bb9dd423490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:09.671548 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ca4f4-6006-44a6-acbc-8bb9dd423490 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:09.671806 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ca4f4-6006-44a6-acbc-8bb9dd423490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:09.672077 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ca4f4-6006-44a6-acbc-8bb9dd423490 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:09.672746 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243ca4f4-6006-44a6-acbc-8bb9dd423490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:09.674370 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243ca4f4-6006-44a6-acbc-8bb9dd423490 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:09.685769 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1266/2553] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:33:09.690064 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41654a-4c01-42f3-a59b-d290fe45f417 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:09.700444 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41654a-4c01-42f3-a59b-d290fe45f417 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:09.705536 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587609a0-e415-4229-bba7-4c143415f369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:09.706196 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587609a0-e415-4229-bba7-4c143415f369 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:09.706474 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587609a0-e415-4229-bba7-4c143415f369 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:09.706748 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587609a0-e415-4229-bba7-4c143415f369 admin admin] PATH_INFO: `/v3/projects/ec6b6518bbcc4b4d867b584fdd188d4c/users/7a9e9515e98c4a3e91e4306a1cbc4cbf/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:09.722850 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587609a0-e415-4229-bba7-4c143415f369 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec6b6518bbcc4b4d867b584fdd188d4c, user_id=7a9e9515e98c4a3e91e4306a1cbc4cbf, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:09.725533 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587609a0-e415-4229-bba7-4c143415f369 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:09.740309 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1288/2554] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:33:09 2022] PUT /identity/v3/projects/ec6b6518bbcc4b4d867b584fdd188d4c/users/7a9e9515e98c4a3e91e4306a1cbc4cbf/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:33:09.744296 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ca4f4-6006-44a6-acbc-8bb9dd423490 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:09.755469 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ca4f4-6006-44a6-acbc-8bb9dd423490 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:09.798360 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:09.820282 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3583dc54-4466-413b-80de-2c096ceabf81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:09.821255 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583dc54-4466-413b-80de-2c096ceabf81 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:09.821255 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583dc54-4466-413b-80de-2c096ceabf81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:09.821517 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583dc54-4466-413b-80de-2c096ceabf81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:09.822172 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3583dc54-4466-413b-80de-2c096ceabf81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:09.824015 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3583dc54-4466-413b-80de-2c096ceabf81 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:09.835598 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1267/2555] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:33:09.840110 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587609a0-e415-4229-bba7-4c143415f369 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:09.850483 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587609a0-e415-4229-bba7-4c143415f369 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:09.855350 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3cca5f-8f76-4b9c-9ecb-967107bc2c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:09.855776 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3cca5f-8f76-4b9c-9ecb-967107bc2c98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:09.856050 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3cca5f-8f76-4b9c-9ecb-967107bc2c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:09.856322 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3cca5f-8f76-4b9c-9ecb-967107bc2c98 admin admin] PATH_INFO: `/v3/projects/ec6b6518bbcc4b4d867b584fdd188d4c/users/7a9e9515e98c4a3e91e4306a1cbc4cbf/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:09.858425 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3cca5f-8f76-4b9c-9ecb-967107bc2c98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec6b6518bbcc4b4d867b584fdd188d4c, user_id=7a9e9515e98c4a3e91e4306a1cbc4cbf, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:09.861092 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3cca5f-8f76-4b9c-9ecb-967107bc2c98 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:09.882408 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1289/2556] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:33:09 2022] PUT /identity/v3/projects/ec6b6518bbcc4b4d867b584fdd188d4c/users/7a9e9515e98c4a3e91e4306a1cbc4cbf/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:33:09.884280 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf65c5-916d-44e9-bc07-ba2f72b82c51 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:09.884615 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf65c5-916d-44e9-bc07-ba2f72b82c51 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:09.884898 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf65c5-916d-44e9-bc07-ba2f72b82c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:09.915657 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-a9cf65c5-916d-44e9-bc07-ba2f72b82c51 None None] MFA Rules not processed for user `7a9e9515e98c4a3e91e4306a1cbc4cbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:09.916914 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-a9cf65c5-916d-44e9-bc07-ba2f72b82c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:09.984799 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1268/2557] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:33:09 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:33:09.998705 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3cca5f-8f76-4b9c-9ecb-967107bc2c98 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:10.000833 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3c3cca5f-8f76-4b9c-9ecb-967107bc2c98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:10.063517 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3cca5f-8f76-4b9c-9ecb-967107bc2c98 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:10.067495 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a40f68d-1675-418c-8c46-74168408bf7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:10.068128 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40f68d-1675-418c-8c46-74168408bf7a service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:10.068404 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40f68d-1675-418c-8c46-74168408bf7a service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:10.068717 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40f68d-1675-418c-8c46-74168408bf7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:10.074916 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:10.079556 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a40f68d-1675-418c-8c46-74168408bf7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:10.081355 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a40f68d-1675-418c-8c46-74168408bf7a service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:10.091001 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1290/2558] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:33:09 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:33:10.182079 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf65c5-916d-44e9-bc07-ba2f72b82c51 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:10.193928 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf65c5-916d-44e9-bc07-ba2f72b82c51 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:10.198086 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e62fd-e64e-4c5d-9433-1df599d30084 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:10.199631 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e62fd-e64e-4c5d-9433-1df599d30084 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:10.200023 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e62fd-e64e-4c5d-9433-1df599d30084 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:10.200398 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e62fd-e64e-4c5d-9433-1df599d30084 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:10.262332 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e62fd-e64e-4c5d-9433-1df599d30084 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:10.264000 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e62fd-e64e-4c5d-9433-1df599d30084 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:10.273361 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1269/2559] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:33:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:33:10.347988 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a40f68d-1675-418c-8c46-74168408bf7a service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:10.349480 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-6a40f68d-1675-418c-8c46-74168408bf7a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:10.445185 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a40f68d-1675-418c-8c46-74168408bf7a service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:10.452182 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c0824-a05f-4443-ac57-27725b28fa81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b7213b7111456a93e294ce40b95b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:10.452841 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c0824-a05f-4443-ac57-27725b28fa81 service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:10.453151 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c0824-a05f-4443-ac57-27725b28fa81 service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:10.453425 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c0824-a05f-4443-ac57-27725b28fa81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:10.455529 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-ea1c0824-a05f-4443-ac57-27725b28fa81 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:10.521269 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c0824-a05f-4443-ac57-27725b28fa81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:10.522897 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c0824-a05f-4443-ac57-27725b28fa81 service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:10.534032 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1291/2560] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:33:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:33:12.363423 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e62fd-e64e-4c5d-9433-1df599d30084 service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:12.364982 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-701e62fd-e64e-4c5d-9433-1df599d30084 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:12.435952 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e62fd-e64e-4c5d-9433-1df599d30084 service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:12.441843 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d40a33-2151-443c-b01f-0d4da7b8a80b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:12.442872 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d40a33-2151-443c-b01f-0d4da7b8a80b service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:12.443341 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d40a33-2151-443c-b01f-0d4da7b8a80b service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:12.443796 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d40a33-2151-443c-b01f-0d4da7b8a80b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:12.446607 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-00d40a33-2151-443c-b01f-0d4da7b8a80b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:12.459509 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d40a33-2151-443c-b01f-0d4da7b8a80b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:12.461616 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d40a33-2151-443c-b01f-0d4da7b8a80b service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:12.470973 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1270/2561] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:33:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:33:12.608628 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209925b5-6305-4337-8043-41dcf9752417 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:12.609229 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209925b5-6305-4337-8043-41dcf9752417 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:12.609229 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209925b5-6305-4337-8043-41dcf9752417 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:12.610487 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1292/2562] 10.222.0.36 () {54 vars in 921 bytes} [Mon Aug 29 22:33:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:33:12.616996 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a964d-b217-4a90-a761-8d270983e5d3 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:12.617346 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a964d-b217-4a90-a761-8d270983e5d3 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:12.617687 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a964d-b217-4a90-a761-8d270983e5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:12.625684 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:12.639434 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-bd0a964d-b217-4a90-a761-8d270983e5d3 None None] MFA Rules not processed for user `204c597d751c420796bd972f10a3d149`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:12.640711 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-bd0a964d-b217-4a90-a761-8d270983e5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:12.647339 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1271/2563] 10.222.0.36 () {58 vars in 1018 bytes} [Mon Aug 29 22:33:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:33:12.660148 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209925b5-6305-4337-8043-41dcf9752417 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:12.672323 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209925b5-6305-4337-8043-41dcf9752417 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:12.676091 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f1693-9998-42bb-8c7a-a5f0ca94d69b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:12.676833 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f1693-9998-42bb-8c7a-a5f0ca94d69b service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:12.677208 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f1693-9998-42bb-8c7a-a5f0ca94d69b service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:12.677492 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f1693-9998-42bb-8c7a-a5f0ca94d69b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:12.685215 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639f1693-9998-42bb-8c7a-a5f0ca94d69b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:12.686629 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639f1693-9998-42bb-8c7a-a5f0ca94d69b service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:12.695075 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1293/2564] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:33:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:33:12.779884 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b43e6e-be0f-4bb1-ac22-e94485219b25 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:12.780172 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b43e6e-be0f-4bb1-ac22-e94485219b25 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:12.780444 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b43e6e-be0f-4bb1-ac22-e94485219b25 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:12.781867 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1272/2565] 10.222.0.36 () {54 vars in 921 bytes} [Mon Aug 29 22:33:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:33:12.787278 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b55055-1aae-4ad1-b0f2-17c8258adf22 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:12.787588 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b55055-1aae-4ad1-b0f2-17c8258adf22 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:12.787846 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b55055-1aae-4ad1-b0f2-17c8258adf22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:12.809942 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-62b55055-1aae-4ad1-b0f2-17c8258adf22 None None] MFA Rules not processed for user `90b7213b7111456a93e294ce40b95b21`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:12.811093 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-62b55055-1aae-4ad1-b0f2-17c8258adf22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:12.822530 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1294/2566] 10.222.0.36 () {58 vars in 1018 bytes} [Mon Aug 29 22:33:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:33:12.836026 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b43e6e-be0f-4bb1-ac22-e94485219b25 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:12.838275 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c7b43e6e-be0f-4bb1-ac22-e94485219b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:12.854209 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b43e6e-be0f-4bb1-ac22-e94485219b25 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:12.858152 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e105f51-99b0-4c3c-869f-c65eeb3b7d23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:12.858771 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e105f51-99b0-4c3c-869f-c65eeb3b7d23 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:12.859206 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e105f51-99b0-4c3c-869f-c65eeb3b7d23 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:12.859488 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e105f51-99b0-4c3c-869f-c65eeb3b7d23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:12.871525 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e105f51-99b0-4c3c-869f-c65eeb3b7d23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:12.873014 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e105f51-99b0-4c3c-869f-c65eeb3b7d23 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:12.885218 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1273/2567] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:33:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:33:12.953479 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b55055-1aae-4ad1-b0f2-17c8258adf22 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:12.954996 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-62b55055-1aae-4ad1-b0f2-17c8258adf22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:13.027070 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b55055-1aae-4ad1-b0f2-17c8258adf22 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:13.032618 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc4cd1a-d364-45e3-a708-a985dd333308 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce3d9397cca4ae58e14c8a5ae844f8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:13.033272 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4cd1a-d364-45e3-a708-a985dd333308 service placement] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:13.033527 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4cd1a-d364-45e3-a708-a985dd333308 service placement] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:13.033825 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4cd1a-d364-45e3-a708-a985dd333308 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:13.035915 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-fcc4cd1a-d364-45e3-a708-a985dd333308 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:13.048101 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc4cd1a-d364-45e3-a708-a985dd333308 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:13.056859 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc4cd1a-d364-45e3-a708-a985dd333308 service placement] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:13.056859 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:13.064952 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1295/2568] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:33:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:33:15.494148 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e105f51-99b0-4c3c-869f-c65eeb3b7d23 service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:15.562634 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e105f51-99b0-4c3c-869f-c65eeb3b7d23 service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:15.568029 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182842bb-036b-4ee0-a6ef-fe0bd34240e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:15.568590 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182842bb-036b-4ee0-a6ef-fe0bd34240e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:15.568867 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182842bb-036b-4ee0-a6ef-fe0bd34240e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:15.569136 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182842bb-036b-4ee0-a6ef-fe0bd34240e5 admin admin] PATH_INFO: `/v3/users/bd675296f0694ef7a124318cce88adee` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:15.570357 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182842bb-036b-4ee0-a6ef-fe0bd34240e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd675296f0694ef7a124318cce88adee)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:15.572281 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182842bb-036b-4ee0-a6ef-fe0bd34240e5 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:15.624975 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-182842bb-036b-4ee0-a6ef-fe0bd34240e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd675296f0694ef7a124318cce88adee'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:15.632668 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-182842bb-036b-4ee0-a6ef-fe0bd34240e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd675296f0694ef7a124318cce88adee'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:15.633437 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-182842bb-036b-4ee0-a6ef-fe0bd34240e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd675296f0694ef7a124318cce88adee'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:15.642380 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-182842bb-036b-4ee0-a6ef-fe0bd34240e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd675296f0694ef7a124318cce88adee'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:15.643001 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-182842bb-036b-4ee0-a6ef-fe0bd34240e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd675296f0694ef7a124318cce88adee'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:15.661257 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1274/2569] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:33:15 2022] DELETE /identity/v3/users/bd675296f0694ef7a124318cce88adee => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:33:15.666024 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a6608-bb52-4e91-ae01-1a177f400439 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:15.666542 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a6608-bb52-4e91-ae01-1a177f400439 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:15.666542 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a6608-bb52-4e91-ae01-1a177f400439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:15.691084 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-b93a6608-bb52-4e91-ae01-1a177f400439 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:15.692301 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b93a6608-bb52-4e91-ae01-1a177f400439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:15.753244 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1296/2570] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:33:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:33:15.765643 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182842bb-036b-4ee0-a6ef-fe0bd34240e5 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:15.767319 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-182842bb-036b-4ee0-a6ef-fe0bd34240e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:15.829923 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182842bb-036b-4ee0-a6ef-fe0bd34240e5 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:15.834173 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263fa38-b4df-4587-b7a6-5551c5893bad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:15.834784 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263fa38-b4df-4587-b7a6-5551c5893bad service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:15.835065 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263fa38-b4df-4587-b7a6-5551c5893bad service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:15.835341 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263fa38-b4df-4587-b7a6-5551c5893bad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:15.845994 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9263fa38-b4df-4587-b7a6-5551c5893bad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:15.847428 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9263fa38-b4df-4587-b7a6-5551c5893bad service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:15.857719 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1275/2571] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:33:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:33:16.159154 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a6608-bb52-4e91-ae01-1a177f400439 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:16.160979 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b93a6608-bb52-4e91-ae01-1a177f400439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:16.173725 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a6608-bb52-4e91-ae01-1a177f400439 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:16.179012 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d5b43f-951d-430a-a40e-2ecba5d53ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:16.179840 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5b43f-951d-430a-a40e-2ecba5d53ddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:16.180167 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5b43f-951d-430a-a40e-2ecba5d53ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:16.180585 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5b43f-951d-430a-a40e-2ecba5d53ddc admin admin] PATH_INFO: `/v3/projects/d2f5a580ca284fe59fffd4669004f168` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:16.181912 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d5b43f-951d-430a-a40e-2ecba5d53ddc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2f5a580ca284fe59fffd4669004f168)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:16.184143 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d5b43f-951d-430a-a40e-2ecba5d53ddc admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:16.248150 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-16d5b43f-951d-430a-a40e-2ecba5d53ddc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2f5a580ca284fe59fffd4669004f168', 'request_id': 'req-16d5b43f-951d-430a-a40e-2ecba5d53ddc'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:16.257135 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-16d5b43f-951d-430a-a40e-2ecba5d53ddc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2f5a580ca284fe59fffd4669004f168', 'request_id': 'req-16d5b43f-951d-430a-a40e-2ecba5d53ddc'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:16.264073 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-16d5b43f-951d-430a-a40e-2ecba5d53ddc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2f5a580ca284fe59fffd4669004f168', 'request_id': 'req-16d5b43f-951d-430a-a40e-2ecba5d53ddc'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:16.278905 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-16d5b43f-951d-430a-a40e-2ecba5d53ddc admin admin] The token cache is being invalidate because project d2f5a580ca284fe59fffd4669004f168 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:33:16.279287 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-16d5b43f-951d-430a-a40e-2ecba5d53ddc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:16.279985 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-16d5b43f-951d-430a-a40e-2ecba5d53ddc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:16.282351 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1297/2572] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:33:16 2022] DELETE /identity/v3/projects/d2f5a580ca284fe59fffd4669004f168 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:33:16.287141 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263fa38-b4df-4587-b7a6-5551c5893bad service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:16.292576 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:16.297300 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263fa38-b4df-4587-b7a6-5551c5893bad service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:16.390623 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b1ead5-7637-4f5f-bc09-fb931c217650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:16.391331 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1ead5-7637-4f5f-bc09-fb931c217650 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:16.391684 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1ead5-7637-4f5f-bc09-fb931c217650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:16.392003 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1ead5-7637-4f5f-bc09-fb931c217650 admin admin] PATH_INFO: `/v3/users/7a9e9515e98c4a3e91e4306a1cbc4cbf` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:16.393237 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b1ead5-7637-4f5f-bc09-fb931c217650 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a9e9515e98c4a3e91e4306a1cbc4cbf)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:16.395222 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b1ead5-7637-4f5f-bc09-fb931c217650 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:16.461432 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c6b1ead5-7637-4f5f-bc09-fb931c217650 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a9e9515e98c4a3e91e4306a1cbc4cbf'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:16.470933 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c6b1ead5-7637-4f5f-bc09-fb931c217650 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a9e9515e98c4a3e91e4306a1cbc4cbf'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:16.471668 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c6b1ead5-7637-4f5f-bc09-fb931c217650 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a9e9515e98c4a3e91e4306a1cbc4cbf'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:16.481482 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c6b1ead5-7637-4f5f-bc09-fb931c217650 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a9e9515e98c4a3e91e4306a1cbc4cbf'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:16.482496 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c6b1ead5-7637-4f5f-bc09-fb931c217650 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a9e9515e98c4a3e91e4306a1cbc4cbf'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:16.506632 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1276/2573] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:33:16 2022] DELETE /identity/v3/users/7a9e9515e98c4a3e91e4306a1cbc4cbf => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:33:16.806149 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d5b43f-951d-430a-a40e-2ecba5d53ddc admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:16.807826 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-16d5b43f-951d-430a-a40e-2ecba5d53ddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:16.821148 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d5b43f-951d-430a-a40e-2ecba5d53ddc admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:16.883061 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b25bc9-2b3d-44f7-a44c-d90b0cd83866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:16.883665 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b25bc9-2b3d-44f7-a44c-d90b0cd83866 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:16.883943 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b25bc9-2b3d-44f7-a44c-d90b0cd83866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:16.884231 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b25bc9-2b3d-44f7-a44c-d90b0cd83866 admin admin] PATH_INFO: `/v3/projects/ec6b6518bbcc4b4d867b584fdd188d4c` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:16.885462 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b25bc9-2b3d-44f7-a44c-d90b0cd83866 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec6b6518bbcc4b4d867b584fdd188d4c)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:16.887527 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b25bc9-2b3d-44f7-a44c-d90b0cd83866 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:16.922170 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:16.944726 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-d7b25bc9-2b3d-44f7-a44c-d90b0cd83866 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec6b6518bbcc4b4d867b584fdd188d4c', 'request_id': 'req-d7b25bc9-2b3d-44f7-a44c-d90b0cd83866'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:16.952190 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-d7b25bc9-2b3d-44f7-a44c-d90b0cd83866 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec6b6518bbcc4b4d867b584fdd188d4c', 'request_id': 'req-d7b25bc9-2b3d-44f7-a44c-d90b0cd83866'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:16.958006 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-d7b25bc9-2b3d-44f7-a44c-d90b0cd83866 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec6b6518bbcc4b4d867b584fdd188d4c', 'request_id': 'req-d7b25bc9-2b3d-44f7-a44c-d90b0cd83866'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:16.972422 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-d7b25bc9-2b3d-44f7-a44c-d90b0cd83866 admin admin] The token cache is being invalidate because project ec6b6518bbcc4b4d867b584fdd188d4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:33:16.972742 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-d7b25bc9-2b3d-44f7-a44c-d90b0cd83866 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:16.973397 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-d7b25bc9-2b3d-44f7-a44c-d90b0cd83866 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:16.974886 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1298/2574] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:33:16 2022] DELETE /identity/v3/projects/ec6b6518bbcc4b4d867b584fdd188d4c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:33:16.979779 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbaeb9-a13b-4b9c-91e0-8d6c97bd0ffe None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:16.980153 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbaeb9-a13b-4b9c-91e0-8d6c97bd0ffe None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:16.980433 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbaeb9-a13b-4b9c-91e0-8d6c97bd0ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:17.000432 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-ecfbaeb9-a13b-4b9c-91e0-8d6c97bd0ffe None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:17.001688 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ecfbaeb9-a13b-4b9c-91e0-8d6c97bd0ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:17.070700 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1277/2575] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:33:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:33:17.080059 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a620c6-b97d-41d6-9572-0b46e6b03bd6 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:17.080378 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a620c6-b97d-41d6-9572-0b46e6b03bd6 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:17.080698 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a620c6-b97d-41d6-9572-0b46e6b03bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:17.101125 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-38a620c6-b97d-41d6-9572-0b46e6b03bd6 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:17.102330 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-38a620c6-b97d-41d6-9572-0b46e6b03bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:17.111175 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1299/2576] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:33:17.116177 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfbaeb9-a13b-4b9c-91e0-8d6c97bd0ffe None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:17.127836 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfbaeb9-a13b-4b9c-91e0-8d6c97bd0ffe None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:17.133544 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308dc5da-5cbd-4c5b-85ef-335e3a642206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:17.134086 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308dc5da-5cbd-4c5b-85ef-335e3a642206 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:17.134361 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308dc5da-5cbd-4c5b-85ef-335e3a642206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:17.134632 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308dc5da-5cbd-4c5b-85ef-335e3a642206 admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:17.135282 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308dc5da-5cbd-4c5b-85ef-335e3a642206 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:17.135590 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308dc5da-5cbd-4c5b-85ef-335e3a642206 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:17.137232 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308dc5da-5cbd-4c5b-85ef-335e3a642206 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:17.149007 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1278/2577] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:33:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:17.155676 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a620c6-b97d-41d6-9572-0b46e6b03bd6 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:17.168419 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a620c6-b97d-41d6-9572-0b46e6b03bd6 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:17.174858 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e77e4d9-ca52-47de-a04f-13bdfcf6ec02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:17.175461 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e77e4d9-ca52-47de-a04f-13bdfcf6ec02 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:17.175739 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e77e4d9-ca52-47de-a04f-13bdfcf6ec02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:17.176011 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e77e4d9-ca52-47de-a04f-13bdfcf6ec02 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:17.176680 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e77e4d9-ca52-47de-a04f-13bdfcf6ec02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:17.178622 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e77e4d9-ca52-47de-a04f-13bdfcf6ec02 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:17.209208 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1300/2578] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:33:17 2022] POST /identity/v3/projects => generated 387 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:33:17.215042 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308dc5da-5cbd-4c5b-85ef-335e3a642206 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:17.225118 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308dc5da-5cbd-4c5b-85ef-335e3a642206 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:17.233709 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:17.288531 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc78d7c0-c162-4c2a-b945-9b2baf18520b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:17.289151 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78d7c0-c162-4c2a-b945-9b2baf18520b admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:17.289432 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78d7c0-c162-4c2a-b945-9b2baf18520b admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:17.289705 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78d7c0-c162-4c2a-b945-9b2baf18520b admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:17.290350 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc78d7c0-c162-4c2a-b945-9b2baf18520b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:17.292287 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc78d7c0-c162-4c2a-b945-9b2baf18520b admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:17.315777 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1279/2579] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:33:17 2022] POST /identity/v3/users => generated 294 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:33:17.322288 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e77e4d9-ca52-47de-a04f-13bdfcf6ec02 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:17.337919 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e77e4d9-ca52-47de-a04f-13bdfcf6ec02 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:17.343412 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3961f487-8c36-4aeb-983f-7c97736f0967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:17.344031 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961f487-8c36-4aeb-983f-7c97736f0967 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:17.344306 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961f487-8c36-4aeb-983f-7c97736f0967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:17.344615 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961f487-8c36-4aeb-983f-7c97736f0967 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:17.345259 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3961f487-8c36-4aeb-983f-7c97736f0967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:17.346938 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3961f487-8c36-4aeb-983f-7c97736f0967 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:17.361462 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1301/2580] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:33:17.362796 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc78d7c0-c162-4c2a-b945-9b2baf18520b admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:17.374508 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc78d7c0-c162-4c2a-b945-9b2baf18520b admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:17.380400 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf3b31-5c05-4eba-8bbb-6ea0ca8e8152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:17.381057 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf3b31-5c05-4eba-8bbb-6ea0ca8e8152 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:17.381654 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf3b31-5c05-4eba-8bbb-6ea0ca8e8152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:17.381946 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf3b31-5c05-4eba-8bbb-6ea0ca8e8152 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:17.382574 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaf3b31-5c05-4eba-8bbb-6ea0ca8e8152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:17.384263 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaf3b31-5c05-4eba-8bbb-6ea0ca8e8152 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:17.399053 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1280/2581] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:33:17.400861 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3961f487-8c36-4aeb-983f-7c97736f0967 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:17.412830 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3961f487-8c36-4aeb-983f-7c97736f0967 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:17.418896 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d55c0-1c08-40b6-967a-9564afc55c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:17.419568 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d55c0-1c08-40b6-967a-9564afc55c02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:17.419846 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d55c0-1c08-40b6-967a-9564afc55c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:17.420119 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d55c0-1c08-40b6-967a-9564afc55c02 admin admin] PATH_INFO: `/v3/projects/f192f24cf14b424cbef98d7e179ce38a/users/36865a0280dc4897a1c666e584ba0012/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:17.436482 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d55c0-1c08-40b6-967a-9564afc55c02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f192f24cf14b424cbef98d7e179ce38a, user_id=36865a0280dc4897a1c666e584ba0012, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:17.439187 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d55c0-1c08-40b6-967a-9564afc55c02 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:17.454437 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1302/2582] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:33:17 2022] PUT /identity/v3/projects/f192f24cf14b424cbef98d7e179ce38a/users/36865a0280dc4897a1c666e584ba0012/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:33:17.466494 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f645d-626c-4cc2-8170-494ad025b628 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:17.466824 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f645d-626c-4cc2-8170-494ad025b628 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:17.467060 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f645d-626c-4cc2-8170-494ad025b628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:17.495611 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-e38f645d-626c-4cc2-8170-494ad025b628 None None] MFA Rules not processed for user `36865a0280dc4897a1c666e584ba0012`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:17.497039 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-e38f645d-626c-4cc2-8170-494ad025b628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:17.565538 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1281/2583] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:33:17 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:33:17.570059 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d55c0-1c08-40b6-967a-9564afc55c02 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:17.653347 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d55c0-1c08-40b6-967a-9564afc55c02 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:17.658110 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e317c21-771f-425e-98ed-2ffced518e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:17.658858 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e317c21-771f-425e-98ed-2ffced518e23 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:17.659279 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e317c21-771f-425e-98ed-2ffced518e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:17.659562 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e317c21-771f-425e-98ed-2ffced518e23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:17.660360 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e317c21-771f-425e-98ed-2ffced518e23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:17.662418 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e317c21-771f-425e-98ed-2ffced518e23 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:17.699299 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1303/2584] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:33:17 2022] POST /identity/v3/projects => generated 387 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:33:17.701545 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f645d-626c-4cc2-8170-494ad025b628 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:17.712753 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f645d-626c-4cc2-8170-494ad025b628 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:17.775364 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0de86-c105-4f2a-a0e8-86e358eef480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:17.775983 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0de86-c105-4f2a-a0e8-86e358eef480 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:17.777041 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0de86-c105-4f2a-a0e8-86e358eef480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:17.777367 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0de86-c105-4f2a-a0e8-86e358eef480 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:17.778101 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff0de86-c105-4f2a-a0e8-86e358eef480 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:17.780014 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff0de86-c105-4f2a-a0e8-86e358eef480 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:17.803425 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1282/2585] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:33:17 2022] POST /identity/v3/users => generated 300 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:33:17.807633 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e317c21-771f-425e-98ed-2ffced518e23 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:17.819870 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e317c21-771f-425e-98ed-2ffced518e23 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:17.825056 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e8ab7-42c0-4a8c-a52f-2d88cb9bf62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:17.825776 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e8ab7-42c0-4a8c-a52f-2d88cb9bf62d admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:17.826116 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e8ab7-42c0-4a8c-a52f-2d88cb9bf62d admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:17.826472 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e8ab7-42c0-4a8c-a52f-2d88cb9bf62d admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:17.827180 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e8ab7-42c0-4a8c-a52f-2d88cb9bf62d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:17.828870 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e8ab7-42c0-4a8c-a52f-2d88cb9bf62d admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:17.840073 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1304/2586] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:33:17.844440 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0de86-c105-4f2a-a0e8-86e358eef480 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:17.855103 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0de86-c105-4f2a-a0e8-86e358eef480 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:17.862169 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c12e77-f89d-4465-b6dc-258793a240f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:17.862945 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c12e77-f89d-4465-b6dc-258793a240f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:17.863299 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c12e77-f89d-4465-b6dc-258793a240f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:17.863631 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c12e77-f89d-4465-b6dc-258793a240f7 admin admin] PATH_INFO: `/v3/projects/57f3388e52bd419dafe50636a6c7a619/users/90de3ea724ca45f7901cba2810b564c9/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:17.867806 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:17.880128 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c12e77-f89d-4465-b6dc-258793a240f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57f3388e52bd419dafe50636a6c7a619, user_id=90de3ea724ca45f7901cba2810b564c9, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:17.883142 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c12e77-f89d-4465-b6dc-258793a240f7 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:17.896790 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1283/2587] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:33:17 2022] PUT /identity/v3/projects/57f3388e52bd419dafe50636a6c7a619/users/90de3ea724ca45f7901cba2810b564c9/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:33:17.900799 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e8ab7-42c0-4a8c-a52f-2d88cb9bf62d admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:17.910973 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e8ab7-42c0-4a8c-a52f-2d88cb9bf62d admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:17.935464 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:17.982418 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625357fe-710e-43f2-9b97-0d6bdf6e1660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:17.983023 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625357fe-710e-43f2-9b97-0d6bdf6e1660 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:17.983315 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625357fe-710e-43f2-9b97-0d6bdf6e1660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:17.983583 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625357fe-710e-43f2-9b97-0d6bdf6e1660 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:17.984215 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625357fe-710e-43f2-9b97-0d6bdf6e1660 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:17.985855 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625357fe-710e-43f2-9b97-0d6bdf6e1660 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:17.995884 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1305/2588] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:33:18.000347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c12e77-f89d-4465-b6dc-258793a240f7 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:18.011221 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c12e77-f89d-4465-b6dc-258793a240f7 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:18.016039 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdbfc0d-e661-4dd7-9549-d90db767e93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:18.016725 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdbfc0d-e661-4dd7-9549-d90db767e93c admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:18.017002 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdbfc0d-e661-4dd7-9549-d90db767e93c admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:18.017274 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdbfc0d-e661-4dd7-9549-d90db767e93c admin admin] PATH_INFO: `/v3/projects/57f3388e52bd419dafe50636a6c7a619/users/90de3ea724ca45f7901cba2810b564c9/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:18.019269 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdbfc0d-e661-4dd7-9549-d90db767e93c admin admin] RBAC: Authorizing `identity:create_grant(project_id=57f3388e52bd419dafe50636a6c7a619, user_id=90de3ea724ca45f7901cba2810b564c9, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:18.021912 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdbfc0d-e661-4dd7-9549-d90db767e93c admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:18.032762 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1284/2589] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:33:17 2022] PUT /identity/v3/projects/57f3388e52bd419dafe50636a6c7a619/users/90de3ea724ca45f7901cba2810b564c9/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:33:18.043408 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf41455-1d9a-44ff-abe2-fe7dc48e1b83 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:18.043704 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf41455-1d9a-44ff-abe2-fe7dc48e1b83 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:18.043973 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf41455-1d9a-44ff-abe2-fe7dc48e1b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:18.073095 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-9cf41455-1d9a-44ff-abe2-fe7dc48e1b83 None None] MFA Rules not processed for user `90de3ea724ca45f7901cba2810b564c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:18.074377 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-9cf41455-1d9a-44ff-abe2-fe7dc48e1b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:18.144900 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1306/2590] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:33:18 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:33:18.157256 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdbfc0d-e661-4dd7-9549-d90db767e93c admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:18.159183 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-9fdbfc0d-e661-4dd7-9549-d90db767e93c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:18.220168 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdbfc0d-e661-4dd7-9549-d90db767e93c admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:18.224045 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23516914-d289-41c3-b045-09943f047048 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:18.224693 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23516914-d289-41c3-b045-09943f047048 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:18.224976 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23516914-d289-41c3-b045-09943f047048 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:18.225248 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23516914-d289-41c3-b045-09943f047048 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:18.235182 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23516914-d289-41c3-b045-09943f047048 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:18.236666 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23516914-d289-41c3-b045-09943f047048 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:18.246876 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1285/2591] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:33:18 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:33:18.839398 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf41455-1d9a-44ff-abe2-fe7dc48e1b83 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:18.912899 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf41455-1d9a-44ff-abe2-fe7dc48e1b83 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:18.917504 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a44c9b-be92-4439-afe3-3adb97fc8e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:18.918836 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a44c9b-be92-4439-afe3-3adb97fc8e08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:18.918836 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a44c9b-be92-4439-afe3-3adb97fc8e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:18.919105 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a44c9b-be92-4439-afe3-3adb97fc8e08 admin admin] PATH_INFO: `/v3/users/36865a0280dc4897a1c666e584ba0012` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:18.920485 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a44c9b-be92-4439-afe3-3adb97fc8e08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36865a0280dc4897a1c666e584ba0012)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:18.922601 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a44c9b-be92-4439-afe3-3adb97fc8e08 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:18.980401 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-20a44c9b-be92-4439-afe3-3adb97fc8e08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36865a0280dc4897a1c666e584ba0012'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:18.982390 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:18.991671 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-20a44c9b-be92-4439-afe3-3adb97fc8e08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36865a0280dc4897a1c666e584ba0012'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:19.001669 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-20a44c9b-be92-4439-afe3-3adb97fc8e08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36865a0280dc4897a1c666e584ba0012'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:19.002390 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-20a44c9b-be92-4439-afe3-3adb97fc8e08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36865a0280dc4897a1c666e584ba0012'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:19.017649 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-20a44c9b-be92-4439-afe3-3adb97fc8e08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36865a0280dc4897a1c666e584ba0012'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:19.024118 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1307/2592] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:33:18 2022] DELETE /identity/v3/users/36865a0280dc4897a1c666e584ba0012 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:33:19.029395 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558cf31-f3fe-4ed7-a230-59b4c72f8db7 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:19.029905 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558cf31-f3fe-4ed7-a230-59b4c72f8db7 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:19.030045 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558cf31-f3fe-4ed7-a230-59b4c72f8db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:19.048780 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-8558cf31-f3fe-4ed7-a230-59b4c72f8db7 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:19.050005 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-8558cf31-f3fe-4ed7-a230-59b4c72f8db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:19.111300 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1286/2593] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:33:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:33:19.121856 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a44c9b-be92-4439-afe3-3adb97fc8e08 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:19.124203 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-20a44c9b-be92-4439-afe3-3adb97fc8e08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:19.201513 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a44c9b-be92-4439-afe3-3adb97fc8e08 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:19.206416 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736490e-2d2f-4b8e-b6ca-bcd866485e94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:19.207071 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736490e-2d2f-4b8e-b6ca-bcd866485e94 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:19.207330 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736490e-2d2f-4b8e-b6ca-bcd866485e94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:19.207609 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736490e-2d2f-4b8e-b6ca-bcd866485e94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:19.218667 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0736490e-2d2f-4b8e-b6ca-bcd866485e94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:19.220116 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0736490e-2d2f-4b8e-b6ca-bcd866485e94 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:19.230300 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1308/2594] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:33:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:33:19.532485 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8558cf31-f3fe-4ed7-a230-59b4c72f8db7 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:19.534065 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-8558cf31-f3fe-4ed7-a230-59b4c72f8db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:19.547170 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8558cf31-f3fe-4ed7-a230-59b4c72f8db7 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:19.552817 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc909e-9584-4613-b498-42c934667b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:19.553485 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc909e-9584-4613-b498-42c934667b0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:19.553759 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc909e-9584-4613-b498-42c934667b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:19.554034 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc909e-9584-4613-b498-42c934667b0d admin admin] PATH_INFO: `/v3/projects/f192f24cf14b424cbef98d7e179ce38a` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:19.555405 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc909e-9584-4613-b498-42c934667b0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f192f24cf14b424cbef98d7e179ce38a)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:19.557490 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc909e-9584-4613-b498-42c934667b0d admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:19.611035 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d7fc909e-9584-4613-b498-42c934667b0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f192f24cf14b424cbef98d7e179ce38a', 'request_id': 'req-d7fc909e-9584-4613-b498-42c934667b0d'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:19.617728 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d7fc909e-9584-4613-b498-42c934667b0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f192f24cf14b424cbef98d7e179ce38a', 'request_id': 'req-d7fc909e-9584-4613-b498-42c934667b0d'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:19.630049 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d7fc909e-9584-4613-b498-42c934667b0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f192f24cf14b424cbef98d7e179ce38a', 'request_id': 'req-d7fc909e-9584-4613-b498-42c934667b0d'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:19.639195 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:19.644400 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d7fc909e-9584-4613-b498-42c934667b0d admin admin] The token cache is being invalidate because project f192f24cf14b424cbef98d7e179ce38a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:33:19.645107 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d7fc909e-9584-4613-b498-42c934667b0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:19.646318 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d7fc909e-9584-4613-b498-42c934667b0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:19.648586 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1287/2595] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:33:19 2022] DELETE /identity/v3/projects/f192f24cf14b424cbef98d7e179ce38a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:33:19.652606 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736490e-2d2f-4b8e-b6ca-bcd866485e94 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:19.662809 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736490e-2d2f-4b8e-b6ca-bcd866485e94 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:19.729216 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f19c3b-e23c-49cc-8d2d-1516270a3eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:19.730836 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f19c3b-e23c-49cc-8d2d-1516270a3eb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:19.731318 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f19c3b-e23c-49cc-8d2d-1516270a3eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:19.731800 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f19c3b-e23c-49cc-8d2d-1516270a3eb8 admin admin] PATH_INFO: `/v3/users/90de3ea724ca45f7901cba2810b564c9` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:19.733073 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f19c3b-e23c-49cc-8d2d-1516270a3eb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90de3ea724ca45f7901cba2810b564c9)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:19.735068 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f19c3b-e23c-49cc-8d2d-1516270a3eb8 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:19.797820 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-57f19c3b-e23c-49cc-8d2d-1516270a3eb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90de3ea724ca45f7901cba2810b564c9'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:19.807255 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-57f19c3b-e23c-49cc-8d2d-1516270a3eb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90de3ea724ca45f7901cba2810b564c9'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:19.829060 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-57f19c3b-e23c-49cc-8d2d-1516270a3eb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90de3ea724ca45f7901cba2810b564c9'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:19.830138 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-57f19c3b-e23c-49cc-8d2d-1516270a3eb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90de3ea724ca45f7901cba2810b564c9'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:19.840610 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:INSERT=2,keystone:DELETE=12,keystone:SELECT=86 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:19.858145 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-57f19c3b-e23c-49cc-8d2d-1516270a3eb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90de3ea724ca45f7901cba2810b564c9'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:19.865716 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1309/2596] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:33:19 2022] DELETE /identity/v3/users/90de3ea724ca45f7901cba2810b564c9 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:33:20.234442 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc909e-9584-4613-b498-42c934667b0d admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:20.236177 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d7fc909e-9584-4613-b498-42c934667b0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:20.253266 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc909e-9584-4613-b498-42c934667b0d admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:20.372526 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2185a7f6-024b-4166-8ed8-822c52efde13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:20.372526 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185a7f6-024b-4166-8ed8-822c52efde13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:20.373050 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185a7f6-024b-4166-8ed8-822c52efde13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:20.373191 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185a7f6-024b-4166-8ed8-822c52efde13 admin admin] PATH_INFO: `/v3/projects/57f3388e52bd419dafe50636a6c7a619` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:20.374451 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2185a7f6-024b-4166-8ed8-822c52efde13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57f3388e52bd419dafe50636a6c7a619)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:20.376490 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2185a7f6-024b-4166-8ed8-822c52efde13 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:20.440677 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-2185a7f6-024b-4166-8ed8-822c52efde13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57f3388e52bd419dafe50636a6c7a619', 'request_id': 'req-2185a7f6-024b-4166-8ed8-822c52efde13'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:20.442016 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-2185a7f6-024b-4166-8ed8-822c52efde13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57f3388e52bd419dafe50636a6c7a619', 'request_id': 'req-2185a7f6-024b-4166-8ed8-822c52efde13'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:20.450898 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-2185a7f6-024b-4166-8ed8-822c52efde13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57f3388e52bd419dafe50636a6c7a619', 'request_id': 'req-2185a7f6-024b-4166-8ed8-822c52efde13'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:20.461710 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-2185a7f6-024b-4166-8ed8-822c52efde13 admin admin] The token cache is being invalidate because project 57f3388e52bd419dafe50636a6c7a619 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:33:20.462065 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-2185a7f6-024b-4166-8ed8-822c52efde13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:20.462615 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-2185a7f6-024b-4166-8ed8-822c52efde13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:20.464219 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1288/2597] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:33:20 2022] DELETE /identity/v3/projects/57f3388e52bd419dafe50636a6c7a619 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:33:20.469318 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538127af-8ef3-4b17-84d8-127e323ff6ff None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:20.469606 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538127af-8ef3-4b17-84d8-127e323ff6ff None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:20.469883 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538127af-8ef3-4b17-84d8-127e323ff6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:20.490048 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-538127af-8ef3-4b17-84d8-127e323ff6ff None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:20.491258 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-538127af-8ef3-4b17-84d8-127e323ff6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:20.560634 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1310/2598] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:33:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:33:20.569990 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466d501-0014-402f-8abe-5be242655800 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:20.570275 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466d501-0014-402f-8abe-5be242655800 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:20.570557 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466d501-0014-402f-8abe-5be242655800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:20.593327 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-b466d501-0014-402f-8abe-5be242655800 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:20.594646 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b466d501-0014-402f-8abe-5be242655800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:20.603941 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1289/2599] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:33:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:33:20.609208 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538127af-8ef3-4b17-84d8-127e323ff6ff None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:20.621572 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538127af-8ef3-4b17-84d8-127e323ff6ff None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:20.626586 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b922dc90-b790-46e6-a52d-031a0d9e14a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:20.627249 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b922dc90-b790-46e6-a52d-031a0d9e14a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:20.627484 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b922dc90-b790-46e6-a52d-031a0d9e14a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:20.627755 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b922dc90-b790-46e6-a52d-031a0d9e14a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:20.628574 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b922dc90-b790-46e6-a52d-031a0d9e14a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:20.628882 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b922dc90-b790-46e6-a52d-031a0d9e14a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:20.630502 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b922dc90-b790-46e6-a52d-031a0d9e14a2 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:20.643820 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1311/2600] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:33:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:20.648655 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466d501-0014-402f-8abe-5be242655800 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:20.659191 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466d501-0014-402f-8abe-5be242655800 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:20.665022 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab865ac1-52e5-4458-8b6d-41c847c0916f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:20.665636 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab865ac1-52e5-4458-8b6d-41c847c0916f admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:20.665913 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab865ac1-52e5-4458-8b6d-41c847c0916f admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:20.666183 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab865ac1-52e5-4458-8b6d-41c847c0916f admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:20.666881 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab865ac1-52e5-4458-8b6d-41c847c0916f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:20.669956 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab865ac1-52e5-4458-8b6d-41c847c0916f admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:20.700435 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1290/2601] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:33:20 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:33:20.706750 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b922dc90-b790-46e6-a52d-031a0d9e14a2 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:20.721608 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b922dc90-b790-46e6-a52d-031a0d9e14a2 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:20.786335 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc1e76a-d6e8-4eea-8e30-8f5cbd3ace34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:20.786970 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1e76a-d6e8-4eea-8e30-8f5cbd3ace34 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:20.787260 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1e76a-d6e8-4eea-8e30-8f5cbd3ace34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:20.787536 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1e76a-d6e8-4eea-8e30-8f5cbd3ace34 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:20.788179 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc1e76a-d6e8-4eea-8e30-8f5cbd3ace34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:20.790180 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc1e76a-d6e8-4eea-8e30-8f5cbd3ace34 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:20.812818 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1312/2602] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:33:20 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:33:20.816948 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab865ac1-52e5-4458-8b6d-41c847c0916f admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:20.827401 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab865ac1-52e5-4458-8b6d-41c847c0916f admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:20.832177 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c47f1-0d5f-449a-82c6-6edddc0cf678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:20.832797 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c47f1-0d5f-449a-82c6-6edddc0cf678 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:20.833072 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c47f1-0d5f-449a-82c6-6edddc0cf678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:20.833342 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c47f1-0d5f-449a-82c6-6edddc0cf678 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:20.833978 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466c47f1-0d5f-449a-82c6-6edddc0cf678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:20.835570 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466c47f1-0d5f-449a-82c6-6edddc0cf678 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:20.845958 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1291/2603] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:33:20.851897 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc1e76a-d6e8-4eea-8e30-8f5cbd3ace34 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:20.862755 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc1e76a-d6e8-4eea-8e30-8f5cbd3ace34 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:20.870522 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9fc51c-3f55-4abe-b54e-d75a9d344656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:20.871261 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9fc51c-3f55-4abe-b54e-d75a9d344656 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:20.871588 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9fc51c-3f55-4abe-b54e-d75a9d344656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:20.871991 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9fc51c-3f55-4abe-b54e-d75a9d344656 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:20.872690 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9fc51c-3f55-4abe-b54e-d75a9d344656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:20.874300 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9fc51c-3f55-4abe-b54e-d75a9d344656 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:20.885400 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1313/2604] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:33:20.893423 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c47f1-0d5f-449a-82c6-6edddc0cf678 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:20.903859 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c47f1-0d5f-449a-82c6-6edddc0cf678 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:20.908646 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f896f5-b575-4381-9ff5-d53be3df5cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:20.909294 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f896f5-b575-4381-9ff5-d53be3df5cb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:20.909577 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f896f5-b575-4381-9ff5-d53be3df5cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:20.909853 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f896f5-b575-4381-9ff5-d53be3df5cb1 admin admin] PATH_INFO: `/v3/projects/cc032bde8c3b48fba2a3e4b6038f5b2d/users/9370ecce7a2245c6a11cb3da6eb8399b/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:20.925237 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f896f5-b575-4381-9ff5-d53be3df5cb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc032bde8c3b48fba2a3e4b6038f5b2d, user_id=9370ecce7a2245c6a11cb3da6eb8399b, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:20.927869 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f896f5-b575-4381-9ff5-d53be3df5cb1 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:20.943348 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1292/2605] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:33:20 2022] PUT /identity/v3/projects/cc032bde8c3b48fba2a3e4b6038f5b2d/users/9370ecce7a2245c6a11cb3da6eb8399b/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:33:20.948947 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcfbd4-700d-4918-be38-fd40b13f2a44 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:20.949323 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcfbd4-700d-4918-be38-fd40b13f2a44 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:20.949602 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcfbd4-700d-4918-be38-fd40b13f2a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:20.970607 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-67dcfbd4-700d-4918-be38-fd40b13f2a44 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:20.971817 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-67dcfbd4-700d-4918-be38-fd40b13f2a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:21.023671 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:21.038124 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1314/2606] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:33:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:33:21.048421 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f896f5-b575-4381-9ff5-d53be3df5cb1 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:21.050206 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-92f896f5-b575-4381-9ff5-d53be3df5cb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:21.078680 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:21.114996 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f896f5-b575-4381-9ff5-d53be3df5cb1 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:21.118921 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5fd03-96b4-4662-87b8-d130355bd7e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:21.119533 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5fd03-96b4-4662-87b8-d130355bd7e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:21.119812 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5fd03-96b4-4662-87b8-d130355bd7e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:21.120091 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5fd03-96b4-4662-87b8-d130355bd7e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:21.131659 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b5fd03-96b4-4662-87b8-d130355bd7e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:21.133239 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b5fd03-96b4-4662-87b8-d130355bd7e6 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:21.143325 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1293/2607] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:33:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:33:21.827396 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f986e4a-3089-49ee-952f-15a1de8d181c None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:21.827682 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f986e4a-3089-49ee-952f-15a1de8d181c None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:21.828004 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f986e4a-3089-49ee-952f-15a1de8d181c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:21.859848 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-1f986e4a-3089-49ee-952f-15a1de8d181c None None] MFA Rules not processed for user `9370ecce7a2245c6a11cb3da6eb8399b`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:21.861318 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-1f986e4a-3089-49ee-952f-15a1de8d181c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:21.943881 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1315/2608] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:33:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:33:21.949326 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5fd03-96b4-4662-87b8-d130355bd7e6 service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:21.960475 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5fd03-96b4-4662-87b8-d130355bd7e6 service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:21.966712 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fd324d-541f-4e90-a6b6-ce1d0ca6f482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:21.967372 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd324d-541f-4e90-a6b6-ce1d0ca6f482 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:21.967654 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd324d-541f-4e90-a6b6-ce1d0ca6f482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:21.967992 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd324d-541f-4e90-a6b6-ce1d0ca6f482 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:21.969038 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fd324d-541f-4e90-a6b6-ce1d0ca6f482 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:21.971594 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fd324d-541f-4e90-a6b6-ce1d0ca6f482 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:22.006931 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1294/2609] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:33:21 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:33:22.012514 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f986e4a-3089-49ee-952f-15a1de8d181c None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:22.029623 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f986e4a-3089-49ee-952f-15a1de8d181c None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:22.092792 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad1d7f-ff8e-4eb5-a1e7-53e7d05f3ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:22.093805 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad1d7f-ff8e-4eb5-a1e7-53e7d05f3ca8 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:22.094419 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad1d7f-ff8e-4eb5-a1e7-53e7d05f3ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:22.094766 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad1d7f-ff8e-4eb5-a1e7-53e7d05f3ca8 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:22.095703 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ad1d7f-ff8e-4eb5-a1e7-53e7d05f3ca8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:22.097833 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ad1d7f-ff8e-4eb5-a1e7-53e7d05f3ca8 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:22.123438 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1316/2610] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:33:22 2022] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:33:22.127081 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fd324d-541f-4e90-a6b6-ce1d0ca6f482 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:22.144086 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fd324d-541f-4e90-a6b6-ce1d0ca6f482 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:22.150132 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d9b21-7aa0-40ad-a872-de17e16bcae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:22.150983 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d9b21-7aa0-40ad-a872-de17e16bcae3 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:22.151205 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d9b21-7aa0-40ad-a872-de17e16bcae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:22.151603 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d9b21-7aa0-40ad-a872-de17e16bcae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:22.152494 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d9b21-7aa0-40ad-a872-de17e16bcae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:22.154460 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d9b21-7aa0-40ad-a872-de17e16bcae3 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:22.165874 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1295/2611] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:33:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:33:22.170274 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad1d7f-ff8e-4eb5-a1e7-53e7d05f3ca8 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:22.181017 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad1d7f-ff8e-4eb5-a1e7-53e7d05f3ca8 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:22.186333 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41aa462-8080-417d-ac7d-960801a1680c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:22.187130 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41aa462-8080-417d-ac7d-960801a1680c admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:22.187417 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41aa462-8080-417d-ac7d-960801a1680c admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:22.187691 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41aa462-8080-417d-ac7d-960801a1680c admin admin] PATH_INFO: `/v3/projects/a86b8d678ee04f22bc03c47def02baea/users/6c442c16bddf4aa783577a081c5ab4c8/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:22.206382 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41aa462-8080-417d-ac7d-960801a1680c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a86b8d678ee04f22bc03c47def02baea, user_id=6c442c16bddf4aa783577a081c5ab4c8, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:22.209549 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41aa462-8080-417d-ac7d-960801a1680c admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:22.236419 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1317/2612] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:33:22 2022] PUT /identity/v3/projects/a86b8d678ee04f22bc03c47def02baea/users/6c442c16bddf4aa783577a081c5ab4c8/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:33:22.240416 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d9b21-7aa0-40ad-a872-de17e16bcae3 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:22.251796 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d9b21-7aa0-40ad-a872-de17e16bcae3 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:22.318511 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012c58c-04bd-4095-9a2f-48593dd645f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:22.319228 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012c58c-04bd-4095-9a2f-48593dd645f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:22.319574 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012c58c-04bd-4095-9a2f-48593dd645f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:22.319910 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012c58c-04bd-4095-9a2f-48593dd645f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:22.320912 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d012c58c-04bd-4095-9a2f-48593dd645f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:22.322344 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d012c58c-04bd-4095-9a2f-48593dd645f6 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:22.340879 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1296/2613] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:33:22 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:33:22.344702 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41aa462-8080-417d-ac7d-960801a1680c admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:22.364546 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41aa462-8080-417d-ac7d-960801a1680c admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:22.364546 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c1680-5ad9-4edf-ace4-09288931532e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:22.364546 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c1680-5ad9-4edf-ace4-09288931532e admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:22.364546 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c1680-5ad9-4edf-ace4-09288931532e admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:22.365003 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c1680-5ad9-4edf-ace4-09288931532e admin admin] PATH_INFO: `/v3/projects/a86b8d678ee04f22bc03c47def02baea/users/6c442c16bddf4aa783577a081c5ab4c8/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:22.365003 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45c1680-5ad9-4edf-ace4-09288931532e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a86b8d678ee04f22bc03c47def02baea, user_id=6c442c16bddf4aa783577a081c5ab4c8, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:22.367318 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45c1680-5ad9-4edf-ace4-09288931532e admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:22.378179 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1318/2614] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:33:22 2022] PUT /identity/v3/projects/a86b8d678ee04f22bc03c47def02baea/users/6c442c16bddf4aa783577a081c5ab4c8/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:33:23.148307 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b882d-fa49-4477-824e-5d0da633bcf7 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:23.148806 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b882d-fa49-4477-824e-5d0da633bcf7 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:23.148905 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b882d-fa49-4477-824e-5d0da633bcf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:23.179189 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-2b6b882d-fa49-4477-824e-5d0da633bcf7 None None] MFA Rules not processed for user `6c442c16bddf4aa783577a081c5ab4c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:23.180586 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-2b6b882d-fa49-4477-824e-5d0da633bcf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:23.259483 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1297/2615] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:33:23 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:33:23.335898 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb442f8-e568-4919-9bf5-d4336e9b54bb None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:23.336471 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb442f8-e568-4919-9bf5-d4336e9b54bb None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:23.336471 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb442f8-e568-4919-9bf5-d4336e9b54bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:23.360899 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-3eb442f8-e568-4919-9bf5-d4336e9b54bb None None] MFA Rules not processed for user `9370ecce7a2245c6a11cb3da6eb8399b`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:23.362144 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3eb442f8-e568-4919-9bf5-d4336e9b54bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:23.400902 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:23.436827 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1319/2616] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:33:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:33:23.447926 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b882d-fa49-4477-824e-5d0da633bcf7 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:23.449535 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-2b6b882d-fa49-4477-824e-5d0da633bcf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:23.469841 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:23.537076 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b882d-fa49-4477-824e-5d0da633bcf7 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:23.546667 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a94411-4ff0-4be2-8356-025ff9c30281 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b7213b7111456a93e294ce40b95b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:23.547276 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a94411-4ff0-4be2-8356-025ff9c30281 service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:23.547549 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a94411-4ff0-4be2-8356-025ff9c30281 service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:23.547812 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a94411-4ff0-4be2-8356-025ff9c30281 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:23.556077 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a94411-4ff0-4be2-8356-025ff9c30281 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:23.557695 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a94411-4ff0-4be2-8356-025ff9c30281 service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:23.566676 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1298/2617] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:33:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:33:25.136428 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb442f8-e568-4919-9bf5-d4336e9b54bb None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:25.153275 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb442f8-e568-4919-9bf5-d4336e9b54bb None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:25.161330 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9dd8bc-e54a-4c36-994e-80f54a0c3f37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b7213b7111456a93e294ce40b95b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:25.162185 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9dd8bc-e54a-4c36-994e-80f54a0c3f37 service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:25.162641 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9dd8bc-e54a-4c36-994e-80f54a0c3f37 service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:25.162883 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9dd8bc-e54a-4c36-994e-80f54a0c3f37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:25.165753 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-9b9dd8bc-e54a-4c36-994e-80f54a0c3f37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:25.180593 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9dd8bc-e54a-4c36-994e-80f54a0c3f37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:25.182648 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9dd8bc-e54a-4c36-994e-80f54a0c3f37 service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:25.195614 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1320/2618] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:33:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:33:31.118246 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a94411-4ff0-4be2-8356-025ff9c30281 service nova] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:31.176901 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a94411-4ff0-4be2-8356-025ff9c30281 service nova] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:31.180879 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397db06f-1862-46ad-a5df-865764720b1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:31.181503 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397db06f-1862-46ad-a5df-865764720b1e service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:31.181785 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397db06f-1862-46ad-a5df-865764720b1e service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:31.182065 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397db06f-1862-46ad-a5df-865764720b1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:31.183946 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-397db06f-1862-46ad-a5df-865764720b1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:31.264624 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397db06f-1862-46ad-a5df-865764720b1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:31.266275 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397db06f-1862-46ad-a5df-865764720b1e service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:31.278194 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1299/2619] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:33:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:33:31.852176 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9dd8bc-e54a-4c36-994e-80f54a0c3f37 service nova] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:31.867090 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9dd8bc-e54a-4c36-994e-80f54a0c3f37 service nova] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:31.873162 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0842f748-146f-4eaa-926f-17f31fc13e81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b7213b7111456a93e294ce40b95b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:31.873738 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842f748-146f-4eaa-926f-17f31fc13e81 service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:31.874196 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842f748-146f-4eaa-926f-17f31fc13e81 service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:31.874467 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842f748-146f-4eaa-926f-17f31fc13e81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:31.876242 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-0842f748-146f-4eaa-926f-17f31fc13e81 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:31.895934 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0842f748-146f-4eaa-926f-17f31fc13e81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:31.897260 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0842f748-146f-4eaa-926f-17f31fc13e81 service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:31.909508 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1321/2620] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:33:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:33:34.655098 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397db06f-1862-46ad-a5df-865764720b1e service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:34.656685 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-397db06f-1862-46ad-a5df-865764720b1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:34.717682 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:34.738302 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0842f748-146f-4eaa-926f-17f31fc13e81 service nova] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:34.741530 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-0842f748-146f-4eaa-926f-17f31fc13e81 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:34.744837 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397db06f-1862-46ad-a5df-865764720b1e service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:34.751480 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd4ae4b-88ae-4175-a646-8c708078cc9a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce3d9397cca4ae58e14c8a5ae844f8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:34.752371 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4ae4b-88ae-4175-a646-8c708078cc9a service placement] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:34.752700 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4ae4b-88ae-4175-a646-8c708078cc9a service placement] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:34.752972 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4ae4b-88ae-4175-a646-8c708078cc9a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:34.754942 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-8cd4ae4b-88ae-4175-a646-8c708078cc9a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:34.757654 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0842f748-146f-4eaa-926f-17f31fc13e81 service nova] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:34.763319 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a342d7-713e-4e5b-ba1d-fed1f52714cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:34.764885 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a342d7-713e-4e5b-ba1d-fed1f52714cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:34.766815 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a342d7-713e-4e5b-ba1d-fed1f52714cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:34.767260 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a342d7-713e-4e5b-ba1d-fed1f52714cc admin admin] PATH_INFO: `/v3/users/41eeb2403f4748b7931680835e47f113` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:34.768776 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd4ae4b-88ae-4175-a646-8c708078cc9a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:34.769184 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a342d7-713e-4e5b-ba1d-fed1f52714cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=41eeb2403f4748b7931680835e47f113)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:34.770497 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd4ae4b-88ae-4175-a646-8c708078cc9a service placement] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:34.771154 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a342d7-713e-4e5b-ba1d-fed1f52714cc admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:34.782282 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1300/2621] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:33:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:33:34.831102 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-42a342d7-713e-4e5b-ba1d-fed1f52714cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41eeb2403f4748b7931680835e47f113'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:34.847406 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-42a342d7-713e-4e5b-ba1d-fed1f52714cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41eeb2403f4748b7931680835e47f113'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:34.855624 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-42a342d7-713e-4e5b-ba1d-fed1f52714cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41eeb2403f4748b7931680835e47f113'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:34.856322 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-42a342d7-713e-4e5b-ba1d-fed1f52714cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41eeb2403f4748b7931680835e47f113'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:34.869244 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-42a342d7-713e-4e5b-ba1d-fed1f52714cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41eeb2403f4748b7931680835e47f113'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:34.875909 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1322/2622] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:33:34 2022] DELETE /identity/v3/users/41eeb2403f4748b7931680835e47f113 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:33:35.065792 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd4ae4b-88ae-4175-a646-8c708078cc9a service placement] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:35.079538 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd4ae4b-88ae-4175-a646-8c708078cc9a service placement] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:35.162676 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c420c824-e271-420e-ada6-08ad1869fe45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:35.163334 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420c824-e271-420e-ada6-08ad1869fe45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:35.163615 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420c824-e271-420e-ada6-08ad1869fe45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:35.163906 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420c824-e271-420e-ada6-08ad1869fe45 admin admin] PATH_INFO: `/v3/projects/1eb371f29ae54ad383a29fe1686040ab` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:35.165100 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c420c824-e271-420e-ada6-08ad1869fe45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eb371f29ae54ad383a29fe1686040ab)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:35.167061 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c420c824-e271-420e-ada6-08ad1869fe45 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:35.223621 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c420c824-e271-420e-ada6-08ad1869fe45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eb371f29ae54ad383a29fe1686040ab', 'request_id': 'req-c420c824-e271-420e-ada6-08ad1869fe45'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:35.230119 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c420c824-e271-420e-ada6-08ad1869fe45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eb371f29ae54ad383a29fe1686040ab', 'request_id': 'req-c420c824-e271-420e-ada6-08ad1869fe45'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:35.239918 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c420c824-e271-420e-ada6-08ad1869fe45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eb371f29ae54ad383a29fe1686040ab', 'request_id': 'req-c420c824-e271-420e-ada6-08ad1869fe45'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:35.254573 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c420c824-e271-420e-ada6-08ad1869fe45 admin admin] The token cache is being invalidate because project 1eb371f29ae54ad383a29fe1686040ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:33:35.254989 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c420c824-e271-420e-ada6-08ad1869fe45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:35.256811 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c420c824-e271-420e-ada6-08ad1869fe45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:35.258788 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1301/2623] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:33:35 2022] DELETE /identity/v3/projects/1eb371f29ae54ad383a29fe1686040ab => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:33:35.264661 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d553a0-4309-4b59-a1db-1cb53f3940f3 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:35.264661 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d553a0-4309-4b59-a1db-1cb53f3940f3 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:35.264661 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d553a0-4309-4b59-a1db-1cb53f3940f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:35.288817 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-88d553a0-4309-4b59-a1db-1cb53f3940f3 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:35.290516 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-88d553a0-4309-4b59-a1db-1cb53f3940f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:35.389889 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1323/2624] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:33:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:33:35.399214 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9dd30-6d9e-42d2-90e2-74f41bc83c14 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:35.399510 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9dd30-6d9e-42d2-90e2-74f41bc83c14 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:35.399824 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9dd30-6d9e-42d2-90e2-74f41bc83c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:35.449544 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-74e9dd30-6d9e-42d2-90e2-74f41bc83c14 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:35.450799 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-74e9dd30-6d9e-42d2-90e2-74f41bc83c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:35.465141 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1302/2625] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:33:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:33:35.470132 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d553a0-4309-4b59-a1db-1cb53f3940f3 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:35.480343 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d553a0-4309-4b59-a1db-1cb53f3940f3 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:35.486176 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2071c4-3660-426f-9c60-d0898f57b880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:35.486814 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2071c4-3660-426f-9c60-d0898f57b880 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:35.487098 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2071c4-3660-426f-9c60-d0898f57b880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:35.487373 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2071c4-3660-426f-9c60-d0898f57b880 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:35.488037 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2071c4-3660-426f-9c60-d0898f57b880 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:35.488532 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2071c4-3660-426f-9c60-d0898f57b880 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:35.490207 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2071c4-3660-426f-9c60-d0898f57b880 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:35.504493 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1324/2626] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:33:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:35.509182 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e9dd30-6d9e-42d2-90e2-74f41bc83c14 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:35.519374 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e9dd30-6d9e-42d2-90e2-74f41bc83c14 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:35.524557 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a157f-e756-4cea-baba-47e8208fc4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:35.525262 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a157f-e756-4cea-baba-47e8208fc4dc admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:35.525559 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a157f-e756-4cea-baba-47e8208fc4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:35.525833 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a157f-e756-4cea-baba-47e8208fc4dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:35.526487 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861a157f-e756-4cea-baba-47e8208fc4dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:35.528409 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861a157f-e756-4cea-baba-47e8208fc4dc admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:35.563934 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1303/2627] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:33:35 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:33:35.568684 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2071c4-3660-426f-9c60-d0898f57b880 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:35.580940 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2071c4-3660-426f-9c60-d0898f57b880 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:35.590817 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:35.642678 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39457f32-5505-4098-9b10-6bc29048aac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:35.643296 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39457f32-5505-4098-9b10-6bc29048aac9 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:35.643579 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39457f32-5505-4098-9b10-6bc29048aac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:35.643851 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39457f32-5505-4098-9b10-6bc29048aac9 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:35.644540 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39457f32-5505-4098-9b10-6bc29048aac9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:35.646528 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39457f32-5505-4098-9b10-6bc29048aac9 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:35.676372 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1325/2628] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:33:35 2022] POST /identity/v3/users => generated 290 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:33:35.678007 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a157f-e756-4cea-baba-47e8208fc4dc admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:35.691003 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a157f-e756-4cea-baba-47e8208fc4dc admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:35.696952 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d524e3b-2f8f-4af0-9d27-d592a7fdfecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:35.697594 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d524e3b-2f8f-4af0-9d27-d592a7fdfecc admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:35.697859 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d524e3b-2f8f-4af0-9d27-d592a7fdfecc admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:35.698133 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d524e3b-2f8f-4af0-9d27-d592a7fdfecc admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:35.698799 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d524e3b-2f8f-4af0-9d27-d592a7fdfecc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:35.700399 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d524e3b-2f8f-4af0-9d27-d592a7fdfecc admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:35.712163 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1304/2629] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:33:35.716968 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39457f32-5505-4098-9b10-6bc29048aac9 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:35.727904 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39457f32-5505-4098-9b10-6bc29048aac9 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:35.733033 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a013002f-9106-47c7-a00c-168768cc69f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:35.733651 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013002f-9106-47c7-a00c-168768cc69f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:35.733961 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013002f-9106-47c7-a00c-168768cc69f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:35.734209 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013002f-9106-47c7-a00c-168768cc69f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:35.734888 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a013002f-9106-47c7-a00c-168768cc69f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:35.736504 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a013002f-9106-47c7-a00c-168768cc69f7 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:35.750961 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1326/2630] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:33:35.755793 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d524e3b-2f8f-4af0-9d27-d592a7fdfecc admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:35.768483 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d524e3b-2f8f-4af0-9d27-d592a7fdfecc admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:35.773435 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8e48a-3a82-437e-81bf-8522c3938f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:35.774100 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8e48a-3a82-437e-81bf-8522c3938f32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:35.774374 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8e48a-3a82-437e-81bf-8522c3938f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:35.774644 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8e48a-3a82-437e-81bf-8522c3938f32 admin admin] PATH_INFO: `/v3/projects/25f2bb0616414f10ad88d02957308816/users/6d32c0749a9043e28bdacf929781ed1a/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:35.791722 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a8e48a-3a82-437e-81bf-8522c3938f32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25f2bb0616414f10ad88d02957308816, user_id=6d32c0749a9043e28bdacf929781ed1a, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:35.794657 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a8e48a-3a82-437e-81bf-8522c3938f32 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:35.809538 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1305/2631] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:33:35 2022] PUT /identity/v3/projects/25f2bb0616414f10ad88d02957308816/users/6d32c0749a9043e28bdacf929781ed1a/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:33:35.820723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19569d3-7745-4359-9c1f-23e43d3c412a None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:35.821021 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19569d3-7745-4359-9c1f-23e43d3c412a None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:35.821293 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19569d3-7745-4359-9c1f-23e43d3c412a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:35.852606 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-f19569d3-7745-4359-9c1f-23e43d3c412a None None] MFA Rules not processed for user `6d32c0749a9043e28bdacf929781ed1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:35.857857 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f19569d3-7745-4359-9c1f-23e43d3c412a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:35.923665 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1327/2632] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:33:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:33:35.928224 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8e48a-3a82-437e-81bf-8522c3938f32 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:35.938666 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:35.997413 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8e48a-3a82-437e-81bf-8522c3938f32 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:36.002481 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e609242-064f-4a9a-80aa-c6f806d4769c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:36.003093 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e609242-064f-4a9a-80aa-c6f806d4769c admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:36.003367 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e609242-064f-4a9a-80aa-c6f806d4769c admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:36.003634 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e609242-064f-4a9a-80aa-c6f806d4769c admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:36.004281 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e609242-064f-4a9a-80aa-c6f806d4769c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:36.006303 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e609242-064f-4a9a-80aa-c6f806d4769c admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:36.045254 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1306/2633] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:33:35 2022] POST /identity/v3/projects => generated 379 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:33:36.046955 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19569d3-7745-4359-9c1f-23e43d3c412a None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:36.058768 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19569d3-7745-4359-9c1f-23e43d3c412a None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:36.124934 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a41c28-f3c2-4aa6-bbd1-f7b6dd2bdbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:36.125590 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a41c28-f3c2-4aa6-bbd1-f7b6dd2bdbdc admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:36.125876 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a41c28-f3c2-4aa6-bbd1-f7b6dd2bdbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:36.126169 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a41c28-f3c2-4aa6-bbd1-f7b6dd2bdbdc admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:36.126814 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a41c28-f3c2-4aa6-bbd1-f7b6dd2bdbdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:36.128818 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a41c28-f3c2-4aa6-bbd1-f7b6dd2bdbdc admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:36.152119 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1328/2634] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:33:36 2022] POST /identity/v3/users => generated 296 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:33:36.156326 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e609242-064f-4a9a-80aa-c6f806d4769c admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:36.167259 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e609242-064f-4a9a-80aa-c6f806d4769c admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:36.172390 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfe596-c7af-4319-8517-d9a6347433c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:36.173040 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfe596-c7af-4319-8517-d9a6347433c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:36.173327 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfe596-c7af-4319-8517-d9a6347433c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:36.173597 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfe596-c7af-4319-8517-d9a6347433c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:36.174265 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bfe596-c7af-4319-8517-d9a6347433c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:36.175909 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bfe596-c7af-4319-8517-d9a6347433c6 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:36.187117 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1307/2635] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:33:36.191686 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a41c28-f3c2-4aa6-bbd1-f7b6dd2bdbdc admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:36.202545 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a41c28-f3c2-4aa6-bbd1-f7b6dd2bdbdc admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:36.207429 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a885b0e5-2659-4270-ae60-058344e13ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:36.208096 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885b0e5-2659-4270-ae60-058344e13ebc admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:36.208395 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885b0e5-2659-4270-ae60-058344e13ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:36.208727 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885b0e5-2659-4270-ae60-058344e13ebc admin admin] PATH_INFO: `/v3/projects/6c94899749d24ea7913d4155678e36e9/users/f5ee02f4a86e48c2b199ea9365370897/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:36.218410 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:36.227028 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a885b0e5-2659-4270-ae60-058344e13ebc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c94899749d24ea7913d4155678e36e9, user_id=f5ee02f4a86e48c2b199ea9365370897, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:36.229969 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a885b0e5-2659-4270-ae60-058344e13ebc admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:36.249126 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1329/2636] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:33:36 2022] PUT /identity/v3/projects/6c94899749d24ea7913d4155678e36e9/users/f5ee02f4a86e48c2b199ea9365370897/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:33:36.254978 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfe596-c7af-4319-8517-d9a6347433c6 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:36.266525 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfe596-c7af-4319-8517-d9a6347433c6 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:36.327115 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635e069-fa2e-44c6-af70-aae8c572b447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:36.327737 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635e069-fa2e-44c6-af70-aae8c572b447 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:36.328018 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635e069-fa2e-44c6-af70-aae8c572b447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:36.328293 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635e069-fa2e-44c6-af70-aae8c572b447 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:36.328973 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e635e069-fa2e-44c6-af70-aae8c572b447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:36.330591 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e635e069-fa2e-44c6-af70-aae8c572b447 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:36.341035 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1308/2637] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:33:36.345414 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a885b0e5-2659-4270-ae60-058344e13ebc admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:36.356982 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a885b0e5-2659-4270-ae60-058344e13ebc admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:36.362625 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eb3948-4937-4fa3-8f20-2366edcd88cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:36.363279 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eb3948-4937-4fa3-8f20-2366edcd88cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:36.363560 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eb3948-4937-4fa3-8f20-2366edcd88cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:36.363833 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eb3948-4937-4fa3-8f20-2366edcd88cf admin admin] PATH_INFO: `/v3/projects/6c94899749d24ea7913d4155678e36e9/users/f5ee02f4a86e48c2b199ea9365370897/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:36.365849 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eb3948-4937-4fa3-8f20-2366edcd88cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c94899749d24ea7913d4155678e36e9, user_id=f5ee02f4a86e48c2b199ea9365370897, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:36.368651 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eb3948-4937-4fa3-8f20-2366edcd88cf admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:36.379094 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1330/2638] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:33:36 2022] PUT /identity/v3/projects/6c94899749d24ea7913d4155678e36e9/users/f5ee02f4a86e48c2b199ea9365370897/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:33:36.393004 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861cab45-2152-41df-ba07-9cb7ea978941 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:36.393442 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861cab45-2152-41df-ba07-9cb7ea978941 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:36.393948 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861cab45-2152-41df-ba07-9cb7ea978941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:36.431722 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-861cab45-2152-41df-ba07-9cb7ea978941 None None] MFA Rules not processed for user `f5ee02f4a86e48c2b199ea9365370897`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:36.432991 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-861cab45-2152-41df-ba07-9cb7ea978941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:36.504965 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1309/2639] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:33:36 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:33:36.518474 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eb3948-4937-4fa3-8f20-2366edcd88cf admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:36.520507 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-05eb3948-4937-4fa3-8f20-2366edcd88cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:36.581205 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eb3948-4937-4fa3-8f20-2366edcd88cf admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:36.584894 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa564e9-2c2c-4752-9534-c5582058673f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:36.585509 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa564e9-2c2c-4752-9534-c5582058673f service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:36.585782 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa564e9-2c2c-4752-9534-c5582058673f service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:36.586033 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa564e9-2c2c-4752-9534-c5582058673f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:36.645317 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa564e9-2c2c-4752-9534-c5582058673f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:36.646792 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa564e9-2c2c-4752-9534-c5582058673f service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:36.655917 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1331/2640] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:33:36 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:33:36.988923 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861cab45-2152-41df-ba07-9cb7ea978941 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:36.990595 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-861cab45-2152-41df-ba07-9cb7ea978941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:36.998549 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:37.005838 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861cab45-2152-41df-ba07-9cb7ea978941 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:37.011363 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7fa458-f604-4e47-95ec-0ae3d748e021 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:37.012051 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fa458-f604-4e47-95ec-0ae3d748e021 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:37.012400 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fa458-f604-4e47-95ec-0ae3d748e021 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:37.012764 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fa458-f604-4e47-95ec-0ae3d748e021 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:37.014857 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ae7fa458-f604-4e47-95ec-0ae3d748e021 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:37.081289 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7fa458-f604-4e47-95ec-0ae3d748e021 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:37.082801 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7fa458-f604-4e47-95ec-0ae3d748e021 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:37.093657 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1310/2641] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:33:36 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:33:37.669196 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee381571-57c1-4806-b90b-c0b212c1e247 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:37.669930 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee381571-57c1-4806-b90b-c0b212c1e247 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:37.669930 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee381571-57c1-4806-b90b-c0b212c1e247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:37.690172 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-ee381571-57c1-4806-b90b-c0b212c1e247 None None] MFA Rules not processed for user `b32922d090564162810dd8b28c3a322b`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:37.691541 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-ee381571-57c1-4806-b90b-c0b212c1e247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:37.759335 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1332/2642] 10.222.0.36 () {58 vars in 1009 bytes} [Mon Aug 29 22:33:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:33:37.772544 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7fa458-f604-4e47-95ec-0ae3d748e021 service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:37.774276 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ae7fa458-f604-4e47-95ec-0ae3d748e021 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:37.884719 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7fa458-f604-4e47-95ec-0ae3d748e021 service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:37.900351 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e202a7f7-32a9-49aa-964c-e93e19b06101 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3472d8ffa748d8828c6a2d89ee7ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:37.901166 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202a7f7-32a9-49aa-964c-e93e19b06101 service swift] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:37.901520 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202a7f7-32a9-49aa-964c-e93e19b06101 service swift] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:37.901856 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202a7f7-32a9-49aa-964c-e93e19b06101 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:37.916325 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e202a7f7-32a9-49aa-964c-e93e19b06101 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:37.918114 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e202a7f7-32a9-49aa-964c-e93e19b06101 service swift] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:37.928110 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1311/2643] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Aug 29 22:33:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 22:33:38.067212 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee381571-57c1-4806-b90b-c0b212c1e247 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:38.079975 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee381571-57c1-4806-b90b-c0b212c1e247 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:38.086953 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc6c09b-4ebb-4335-9b1a-802366bf2135 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:38.088346 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6c09b-4ebb-4335-9b1a-802366bf2135 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:38.088898 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6c09b-4ebb-4335-9b1a-802366bf2135 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:38.089452 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6c09b-4ebb-4335-9b1a-802366bf2135 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:38.105895 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc6c09b-4ebb-4335-9b1a-802366bf2135 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:38.107409 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc6c09b-4ebb-4335-9b1a-802366bf2135 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:38.119271 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1333/2644] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:33:38 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:33:42.293894 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e202a7f7-32a9-49aa-964c-e93e19b06101 service swift] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:42.382218 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e202a7f7-32a9-49aa-964c-e93e19b06101 service swift] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:42.388843 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a681e-4fbe-4c09-9aea-2cb339c6f957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:42.389770 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a681e-4fbe-4c09-9aea-2cb339c6f957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:42.390159 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a681e-4fbe-4c09-9aea-2cb339c6f957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:42.390454 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a681e-4fbe-4c09-9aea-2cb339c6f957 admin admin] PATH_INFO: `/v3/users/6d32c0749a9043e28bdacf929781ed1a` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:42.391795 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276a681e-4fbe-4c09-9aea-2cb339c6f957 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d32c0749a9043e28bdacf929781ed1a)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:42.394899 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276a681e-4fbe-4c09-9aea-2cb339c6f957 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:42.458874 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:42.490493 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-276a681e-4fbe-4c09-9aea-2cb339c6f957 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d32c0749a9043e28bdacf929781ed1a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:42.499815 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-276a681e-4fbe-4c09-9aea-2cb339c6f957 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d32c0749a9043e28bdacf929781ed1a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:42.500673 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-276a681e-4fbe-4c09-9aea-2cb339c6f957 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d32c0749a9043e28bdacf929781ed1a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:42.512120 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-276a681e-4fbe-4c09-9aea-2cb339c6f957 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d32c0749a9043e28bdacf929781ed1a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:42.512944 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-276a681e-4fbe-4c09-9aea-2cb339c6f957 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d32c0749a9043e28bdacf929781ed1a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:42.538651 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1312/2645] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:33:42 2022] DELETE /identity/v3/users/6d32c0749a9043e28bdacf929781ed1a => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:33:42.540134 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2885f08-5a58-4a6e-a5ff-4293fe5514a1 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:42.540644 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2885f08-5a58-4a6e-a5ff-4293fe5514a1 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:42.540736 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2885f08-5a58-4a6e-a5ff-4293fe5514a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:42.563987 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-f2885f08-5a58-4a6e-a5ff-4293fe5514a1 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:42.565254 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f2885f08-5a58-4a6e-a5ff-4293fe5514a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:42.582859 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:42.638698 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1334/2646] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:33:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:33:42.648955 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a681e-4fbe-4c09-9aea-2cb339c6f957 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:42.650657 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-276a681e-4fbe-4c09-9aea-2cb339c6f957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:42.724514 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a681e-4fbe-4c09-9aea-2cb339c6f957 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:42.735058 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6859b85-46ab-4194-8423-9a07cb8bbb4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:42.735703 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6859b85-46ab-4194-8423-9a07cb8bbb4d service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:42.735984 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6859b85-46ab-4194-8423-9a07cb8bbb4d service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:42.736255 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6859b85-46ab-4194-8423-9a07cb8bbb4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:42.748691 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6859b85-46ab-4194-8423-9a07cb8bbb4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:42.748691 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6859b85-46ab-4194-8423-9a07cb8bbb4d service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:42.767119 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1313/2647] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:33:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:33:43.168497 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2885f08-5a58-4a6e-a5ff-4293fe5514a1 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:43.170064 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f2885f08-5a58-4a6e-a5ff-4293fe5514a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:43.186258 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2885f08-5a58-4a6e-a5ff-4293fe5514a1 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:43.191175 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7136d1-8b67-475c-8355-5d23ff74399c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:43.191974 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7136d1-8b67-475c-8355-5d23ff74399c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:43.192544 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7136d1-8b67-475c-8355-5d23ff74399c admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:43.192912 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7136d1-8b67-475c-8355-5d23ff74399c admin admin] PATH_INFO: `/v3/projects/25f2bb0616414f10ad88d02957308816` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:43.194168 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7136d1-8b67-475c-8355-5d23ff74399c admin admin] RBAC: Authorizing `identity:delete_project(project_id=25f2bb0616414f10ad88d02957308816)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:43.196233 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7136d1-8b67-475c-8355-5d23ff74399c admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:43.262984 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-3c7136d1-8b67-475c-8355-5d23ff74399c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25f2bb0616414f10ad88d02957308816', 'request_id': 'req-3c7136d1-8b67-475c-8355-5d23ff74399c'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:43.275389 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-3c7136d1-8b67-475c-8355-5d23ff74399c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25f2bb0616414f10ad88d02957308816', 'request_id': 'req-3c7136d1-8b67-475c-8355-5d23ff74399c'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:43.281587 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-3c7136d1-8b67-475c-8355-5d23ff74399c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25f2bb0616414f10ad88d02957308816', 'request_id': 'req-3c7136d1-8b67-475c-8355-5d23ff74399c'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:43.303315 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-3c7136d1-8b67-475c-8355-5d23ff74399c admin admin] The token cache is being invalidate because project 25f2bb0616414f10ad88d02957308816 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:33:43.303620 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-3c7136d1-8b67-475c-8355-5d23ff74399c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:43.304244 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-3c7136d1-8b67-475c-8355-5d23ff74399c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:43.305861 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1335/2648] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:33:43 2022] DELETE /identity/v3/projects/25f2bb0616414f10ad88d02957308816 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:33:43.310415 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6859b85-46ab-4194-8423-9a07cb8bbb4d service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:43.323710 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6859b85-46ab-4194-8423-9a07cb8bbb4d service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:43.407231 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e0726-84b6-4ec2-ba62-ec928ff86d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:43.407972 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e0726-84b6-4ec2-ba62-ec928ff86d2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:43.408255 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e0726-84b6-4ec2-ba62-ec928ff86d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:43.408709 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e0726-84b6-4ec2-ba62-ec928ff86d2a admin admin] PATH_INFO: `/v3/users/f5ee02f4a86e48c2b199ea9365370897` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:43.409902 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e0726-84b6-4ec2-ba62-ec928ff86d2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5ee02f4a86e48c2b199ea9365370897)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:43.411911 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e0726-84b6-4ec2-ba62-ec928ff86d2a admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:43.492831 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c76e0726-84b6-4ec2-ba62-ec928ff86d2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5ee02f4a86e48c2b199ea9365370897'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:43.495736 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:43.504182 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c76e0726-84b6-4ec2-ba62-ec928ff86d2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5ee02f4a86e48c2b199ea9365370897'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:43.505015 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c76e0726-84b6-4ec2-ba62-ec928ff86d2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5ee02f4a86e48c2b199ea9365370897'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:43.548601 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c76e0726-84b6-4ec2-ba62-ec928ff86d2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5ee02f4a86e48c2b199ea9365370897'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:43.549357 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c76e0726-84b6-4ec2-ba62-ec928ff86d2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5ee02f4a86e48c2b199ea9365370897'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:43.585745 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1314/2649] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:33:43 2022] DELETE /identity/v3/users/f5ee02f4a86e48c2b199ea9365370897 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:33:43.955682 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7136d1-8b67-475c-8355-5d23ff74399c admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:43.957584 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3c7136d1-8b67-475c-8355-5d23ff74399c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:43.985995 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7136d1-8b67-475c-8355-5d23ff74399c admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:44.063138 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ba8fc-2e41-4ac0-a859-7ff25d55662c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:44.063823 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ba8fc-2e41-4ac0-a859-7ff25d55662c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:44.064107 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ba8fc-2e41-4ac0-a859-7ff25d55662c admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:44.064385 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ba8fc-2e41-4ac0-a859-7ff25d55662c admin admin] PATH_INFO: `/v3/projects/6c94899749d24ea7913d4155678e36e9` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:44.065627 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739ba8fc-2e41-4ac0-a859-7ff25d55662c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c94899749d24ea7913d4155678e36e9)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:44.067550 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739ba8fc-2e41-4ac0-a859-7ff25d55662c admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:44.132808 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:44.140110 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-739ba8fc-2e41-4ac0-a859-7ff25d55662c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c94899749d24ea7913d4155678e36e9', 'request_id': 'req-739ba8fc-2e41-4ac0-a859-7ff25d55662c'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:44.151039 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-739ba8fc-2e41-4ac0-a859-7ff25d55662c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c94899749d24ea7913d4155678e36e9', 'request_id': 'req-739ba8fc-2e41-4ac0-a859-7ff25d55662c'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:44.159431 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-739ba8fc-2e41-4ac0-a859-7ff25d55662c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c94899749d24ea7913d4155678e36e9', 'request_id': 'req-739ba8fc-2e41-4ac0-a859-7ff25d55662c'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:44.191391 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-739ba8fc-2e41-4ac0-a859-7ff25d55662c admin admin] The token cache is being invalidate because project 6c94899749d24ea7913d4155678e36e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:33:44.191783 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-739ba8fc-2e41-4ac0-a859-7ff25d55662c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:44.193292 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-739ba8fc-2e41-4ac0-a859-7ff25d55662c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:44.197760 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1336/2650] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:33:43 2022] DELETE /identity/v3/projects/6c94899749d24ea7913d4155678e36e9 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:33:44.224904 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0199d9-0988-4232-9dc2-5b607425451d None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:44.224904 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0199d9-0988-4232-9dc2-5b607425451d None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:44.225207 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0199d9-0988-4232-9dc2-5b607425451d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:44.252050 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-af0199d9-0988-4232-9dc2-5b607425451d None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:44.253340 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-af0199d9-0988-4232-9dc2-5b607425451d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:44.482160 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1315/2651] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:33:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:33:44.484795 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7393888-0d48-4336-aa8b-c3cbc4afce27 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:44.485256 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7393888-0d48-4336-aa8b-c3cbc4afce27 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:44.485698 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7393888-0d48-4336-aa8b-c3cbc4afce27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:44.529360 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-c7393888-0d48-4336-aa8b-c3cbc4afce27 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:44.535711 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c7393888-0d48-4336-aa8b-c3cbc4afce27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:44.549679 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1337/2652] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:33:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:33:44.556096 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0199d9-0988-4232-9dc2-5b607425451d None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:44.569300 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0199d9-0988-4232-9dc2-5b607425451d None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:44.579975 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c433c1e-c099-459d-bd86-d4e5ab20be20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:44.580771 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c433c1e-c099-459d-bd86-d4e5ab20be20 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:44.581243 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c433c1e-c099-459d-bd86-d4e5ab20be20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:44.581655 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c433c1e-c099-459d-bd86-d4e5ab20be20 admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:44.582421 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c433c1e-c099-459d-bd86-d4e5ab20be20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:44.583154 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c433c1e-c099-459d-bd86-d4e5ab20be20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:44.585331 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c433c1e-c099-459d-bd86-d4e5ab20be20 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:44.606708 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7393888-0d48-4336-aa8b-c3cbc4afce27 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:44.608717 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1316/2653] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:33:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:44.627848 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7393888-0d48-4336-aa8b-c3cbc4afce27 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:44.633874 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67927c-cf93-4b52-b329-57b233fd3ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:44.634509 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67927c-cf93-4b52-b329-57b233fd3ecc admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:44.634878 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67927c-cf93-4b52-b329-57b233fd3ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:44.635273 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67927c-cf93-4b52-b329-57b233fd3ecc admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:44.636354 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e67927c-cf93-4b52-b329-57b233fd3ecc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:44.639177 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e67927c-cf93-4b52-b329-57b233fd3ecc admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:44.691171 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1338/2654] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:33:44 2022] POST /identity/v3/projects => generated 375 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:33:44.692462 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c433c1e-c099-459d-bd86-d4e5ab20be20 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:44.712632 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c433c1e-c099-459d-bd86-d4e5ab20be20 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:44.798667 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d754bb73-a180-445c-b6f9-f9b124909d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:44.799469 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754bb73-a180-445c-b6f9-f9b124909d31 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:44.799812 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754bb73-a180-445c-b6f9-f9b124909d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:44.800090 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754bb73-a180-445c-b6f9-f9b124909d31 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:44.800761 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d754bb73-a180-445c-b6f9-f9b124909d31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:44.802733 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d754bb73-a180-445c-b6f9-f9b124909d31 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:44.832212 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1317/2655] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:33:44 2022] POST /identity/v3/users => generated 288 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:33:44.836024 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67927c-cf93-4b52-b329-57b233fd3ecc admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:44.849192 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67927c-cf93-4b52-b329-57b233fd3ecc admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:44.865361 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b64a8-a3ed-49ff-89a8-30bddb564073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:44.866168 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b64a8-a3ed-49ff-89a8-30bddb564073 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:44.866537 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b64a8-a3ed-49ff-89a8-30bddb564073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:44.866907 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b64a8-a3ed-49ff-89a8-30bddb564073 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:44.867818 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7b64a8-a3ed-49ff-89a8-30bddb564073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:44.870101 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7b64a8-a3ed-49ff-89a8-30bddb564073 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:44.894721 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1339/2656] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:33:44 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:33:44.901725 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d754bb73-a180-445c-b6f9-f9b124909d31 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:44.918139 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d754bb73-a180-445c-b6f9-f9b124909d31 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:44.924301 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2369849f-a95f-418c-9b6e-b6fbd6b11a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:44.924954 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369849f-a95f-418c-9b6e-b6fbd6b11a58 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:44.925241 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369849f-a95f-418c-9b6e-b6fbd6b11a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:44.925510 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369849f-a95f-418c-9b6e-b6fbd6b11a58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:44.926217 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2369849f-a95f-418c-9b6e-b6fbd6b11a58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:44.927850 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2369849f-a95f-418c-9b6e-b6fbd6b11a58 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:44.941111 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1318/2657] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:33:44 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:33:44.947456 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b64a8-a3ed-49ff-89a8-30bddb564073 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:44.960025 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b64a8-a3ed-49ff-89a8-30bddb564073 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:44.966945 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1634c638-345c-40f5-9e42-b249d1ffbc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:44.967736 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634c638-345c-40f5-9e42-b249d1ffbc5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:44.968019 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634c638-345c-40f5-9e42-b249d1ffbc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:44.968290 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634c638-345c-40f5-9e42-b249d1ffbc5d admin admin] PATH_INFO: `/v3/projects/31e4c2b663784908b914dc0493a78c6e/users/1ac08033e36e446ebdd534670b0351a6/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:44.990730 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1634c638-345c-40f5-9e42-b249d1ffbc5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=31e4c2b663784908b914dc0493a78c6e, user_id=1ac08033e36e446ebdd534670b0351a6, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:44.994729 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1634c638-345c-40f5-9e42-b249d1ffbc5d admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:45.014185 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1340/2658] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:33:44 2022] PUT /identity/v3/projects/31e4c2b663784908b914dc0493a78c6e/users/1ac08033e36e446ebdd534670b0351a6/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:33:45.024999 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd468c-6d98-4463-891c-c4b9139c39eb None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:45.025577 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd468c-6d98-4463-891c-c4b9139c39eb None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:45.025861 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd468c-6d98-4463-891c-c4b9139c39eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:45.058165 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-81cd468c-6d98-4463-891c-c4b9139c39eb None None] MFA Rules not processed for user `1ac08033e36e446ebdd534670b0351a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:45.059835 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-81cd468c-6d98-4463-891c-c4b9139c39eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:45.083911 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:45.138203 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1319/2659] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:33:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:33:45.139638 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1634c638-345c-40f5-9e42-b249d1ffbc5d admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:45.220872 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1634c638-345c-40f5-9e42-b249d1ffbc5d admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:45.225967 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de7005-7e7b-4053-99ce-31275e5a4fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:45.226693 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de7005-7e7b-4053-99ce-31275e5a4fe7 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:45.227045 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de7005-7e7b-4053-99ce-31275e5a4fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:45.227490 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de7005-7e7b-4053-99ce-31275e5a4fe7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:45.228198 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1de7005-7e7b-4053-99ce-31275e5a4fe7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:45.230273 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1de7005-7e7b-4053-99ce-31275e5a4fe7 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:45.264753 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1341/2660] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:33:45 2022] POST /identity/v3/projects => generated 373 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:33:45.266043 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd468c-6d98-4463-891c-c4b9139c39eb None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:45.277903 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd468c-6d98-4463-891c-c4b9139c39eb None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:45.357322 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2accd644-a350-4867-b8a0-0032b4bb7962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:45.357897 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accd644-a350-4867-b8a0-0032b4bb7962 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:45.358170 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accd644-a350-4867-b8a0-0032b4bb7962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:45.358450 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accd644-a350-4867-b8a0-0032b4bb7962 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:45.359210 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2accd644-a350-4867-b8a0-0032b4bb7962 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:45.365040 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2accd644-a350-4867-b8a0-0032b4bb7962 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:45.398308 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1320/2661] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:33:45 2022] POST /identity/v3/users => generated 293 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:33:45.402932 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de7005-7e7b-4053-99ce-31275e5a4fe7 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:45.416872 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de7005-7e7b-4053-99ce-31275e5a4fe7 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:45.424764 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346bf1cc-0415-4a1a-9c1a-fcff2cb03f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:45.425788 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346bf1cc-0415-4a1a-9c1a-fcff2cb03f81 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:45.425993 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346bf1cc-0415-4a1a-9c1a-fcff2cb03f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:45.426260 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346bf1cc-0415-4a1a-9c1a-fcff2cb03f81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:45.426930 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346bf1cc-0415-4a1a-9c1a-fcff2cb03f81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:45.428995 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346bf1cc-0415-4a1a-9c1a-fcff2cb03f81 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:45.440837 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1342/2662] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:33:45.446420 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2accd644-a350-4867-b8a0-0032b4bb7962 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:45.457247 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2accd644-a350-4867-b8a0-0032b4bb7962 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:45.462267 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e09276-1dd0-41f4-8052-505e0b2f69e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:45.463121 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e09276-1dd0-41f4-8052-505e0b2f69e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:45.463500 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e09276-1dd0-41f4-8052-505e0b2f69e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:45.463900 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e09276-1dd0-41f4-8052-505e0b2f69e4 admin admin] PATH_INFO: `/v3/projects/9f0e1534f6034033bb5df6b7261426fc/users/80dcc7db9d964ad1ab4a976f594aea91/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:45.485835 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e09276-1dd0-41f4-8052-505e0b2f69e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f0e1534f6034033bb5df6b7261426fc, user_id=80dcc7db9d964ad1ab4a976f594aea91, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:45.489095 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e09276-1dd0-41f4-8052-505e0b2f69e4 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:45.505817 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1321/2663] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:33:45 2022] PUT /identity/v3/projects/9f0e1534f6034033bb5df6b7261426fc/users/80dcc7db9d964ad1ab4a976f594aea91/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:33:45.510524 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346bf1cc-0415-4a1a-9c1a-fcff2cb03f81 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:45.522441 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346bf1cc-0415-4a1a-9c1a-fcff2cb03f81 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:45.572249 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:45.603621 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b6949f-2486-4ae0-b5b5-dd5bc53bee8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:45.604255 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6949f-2486-4ae0-b5b5-dd5bc53bee8c admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:45.604567 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6949f-2486-4ae0-b5b5-dd5bc53bee8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:45.604841 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6949f-2486-4ae0-b5b5-dd5bc53bee8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:45.605717 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b6949f-2486-4ae0-b5b5-dd5bc53bee8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:45.607236 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b6949f-2486-4ae0-b5b5-dd5bc53bee8c admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:45.627381 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1343/2664] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:33:45.628953 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e09276-1dd0-41f4-8052-505e0b2f69e4 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:45.641834 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e09276-1dd0-41f4-8052-505e0b2f69e4 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:45.648719 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4dcfc-7c0c-460b-925c-842550a843ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:45.651063 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4dcfc-7c0c-460b-925c-842550a843ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:45.651063 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4dcfc-7c0c-460b-925c-842550a843ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:45.651291 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4dcfc-7c0c-460b-925c-842550a843ea admin admin] PATH_INFO: `/v3/projects/9f0e1534f6034033bb5df6b7261426fc/users/80dcc7db9d964ad1ab4a976f594aea91/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:45.655726 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba4dcfc-7c0c-460b-925c-842550a843ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f0e1534f6034033bb5df6b7261426fc, user_id=80dcc7db9d964ad1ab4a976f594aea91, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:45.658654 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba4dcfc-7c0c-460b-925c-842550a843ea admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:45.682169 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1322/2665] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:33:45 2022] PUT /identity/v3/projects/9f0e1534f6034033bb5df6b7261426fc/users/80dcc7db9d964ad1ab4a976f594aea91/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:33:45.684742 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec94b8-709e-48c7-a84a-579f3db2ab75 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:45.685725 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec94b8-709e-48c7-a84a-579f3db2ab75 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:45.686461 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec94b8-709e-48c7-a84a-579f3db2ab75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:45.739322 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-36ec94b8-709e-48c7-a84a-579f3db2ab75 None None] MFA Rules not processed for user `80dcc7db9d964ad1ab4a976f594aea91`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:45.740903 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-36ec94b8-709e-48c7-a84a-579f3db2ab75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:45.850498 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1344/2666] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:33:45 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:33:45.865635 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4dcfc-7c0c-460b-925c-842550a843ea admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:45.869988 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-6ba4dcfc-7c0c-460b-925c-842550a843ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:45.945219 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4dcfc-7c0c-460b-925c-842550a843ea admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:45.951051 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe38dc-5118-4c38-b234-91600bfc41e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:45.952106 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe38dc-5118-4c38-b234-91600bfc41e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:45.952413 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe38dc-5118-4c38-b234-91600bfc41e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:45.952732 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe38dc-5118-4c38-b234-91600bfc41e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:46.026475 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:46.110583 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe38dc-5118-4c38-b234-91600bfc41e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:46.112337 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe38dc-5118-4c38-b234-91600bfc41e6 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:46.126041 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1323/2667] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:33:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:33:48.805141 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec94b8-709e-48c7-a84a-579f3db2ab75 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:48.880431 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec94b8-709e-48c7-a84a-579f3db2ab75 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:48.885911 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1658a5f-2237-4f77-afcc-852bd66f578a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:48.886660 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1658a5f-2237-4f77-afcc-852bd66f578a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:48.887054 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1658a5f-2237-4f77-afcc-852bd66f578a admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:48.887483 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1658a5f-2237-4f77-afcc-852bd66f578a admin admin] PATH_INFO: `/v3/users/1ac08033e36e446ebdd534670b0351a6` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:48.888721 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1658a5f-2237-4f77-afcc-852bd66f578a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ac08033e36e446ebdd534670b0351a6)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:48.890840 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1658a5f-2237-4f77-afcc-852bd66f578a admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:48.951405 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-c1658a5f-2237-4f77-afcc-852bd66f578a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ac08033e36e446ebdd534670b0351a6'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:48.960081 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-c1658a5f-2237-4f77-afcc-852bd66f578a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ac08033e36e446ebdd534670b0351a6'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:48.967636 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-c1658a5f-2237-4f77-afcc-852bd66f578a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ac08033e36e446ebdd534670b0351a6'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:48.968644 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-c1658a5f-2237-4f77-afcc-852bd66f578a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ac08033e36e446ebdd534670b0351a6'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:48.974196 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:48.988466 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-c1658a5f-2237-4f77-afcc-852bd66f578a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ac08033e36e446ebdd534670b0351a6'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:48.998034 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1345/2668] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:33:48 2022] DELETE /identity/v3/users/1ac08033e36e446ebdd534670b0351a6 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:33:49.003958 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff823b76-a9d6-425a-b704-151d3a7b6b28 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:49.004581 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff823b76-a9d6-425a-b704-151d3a7b6b28 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:49.004781 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff823b76-a9d6-425a-b704-151d3a7b6b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:49.026205 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-ff823b76-a9d6-425a-b704-151d3a7b6b28 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:49.027437 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ff823b76-a9d6-425a-b704-151d3a7b6b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:49.100869 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1324/2669] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:33:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:33:49.112462 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1658a5f-2237-4f77-afcc-852bd66f578a admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:49.114272 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c1658a5f-2237-4f77-afcc-852bd66f578a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:49.190840 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1658a5f-2237-4f77-afcc-852bd66f578a admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:49.196892 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f59b3-b63c-4a4f-bcf6-6dc833c39384 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:49.197760 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f59b3-b63c-4a4f-bcf6-6dc833c39384 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:49.198040 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f59b3-b63c-4a4f-bcf6-6dc833c39384 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:49.198316 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f59b3-b63c-4a4f-bcf6-6dc833c39384 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:49.210979 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182f59b3-b63c-4a4f-bcf6-6dc833c39384 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:49.212403 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182f59b3-b63c-4a4f-bcf6-6dc833c39384 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:49.223150 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1346/2670] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:33:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:33:49.523703 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff823b76-a9d6-425a-b704-151d3a7b6b28 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:49.525288 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ff823b76-a9d6-425a-b704-151d3a7b6b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:49.538602 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff823b76-a9d6-425a-b704-151d3a7b6b28 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:49.543898 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc37d72b-5122-4e16-97f2-6e5da7a70b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:49.544716 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37d72b-5122-4e16-97f2-6e5da7a70b81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:49.545062 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37d72b-5122-4e16-97f2-6e5da7a70b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:49.545397 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37d72b-5122-4e16-97f2-6e5da7a70b81 admin admin] PATH_INFO: `/v3/projects/31e4c2b663784908b914dc0493a78c6e` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:49.547235 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc37d72b-5122-4e16-97f2-6e5da7a70b81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31e4c2b663784908b914dc0493a78c6e)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:49.549292 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc37d72b-5122-4e16-97f2-6e5da7a70b81 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:49.606374 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-fc37d72b-5122-4e16-97f2-6e5da7a70b81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31e4c2b663784908b914dc0493a78c6e', 'request_id': 'req-fc37d72b-5122-4e16-97f2-6e5da7a70b81'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:49.613144 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-fc37d72b-5122-4e16-97f2-6e5da7a70b81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31e4c2b663784908b914dc0493a78c6e', 'request_id': 'req-fc37d72b-5122-4e16-97f2-6e5da7a70b81'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:49.622388 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-fc37d72b-5122-4e16-97f2-6e5da7a70b81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31e4c2b663784908b914dc0493a78c6e', 'request_id': 'req-fc37d72b-5122-4e16-97f2-6e5da7a70b81'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:49.635039 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-fc37d72b-5122-4e16-97f2-6e5da7a70b81 admin admin] The token cache is being invalidate because project 31e4c2b663784908b914dc0493a78c6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:33:49.635443 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-fc37d72b-5122-4e16-97f2-6e5da7a70b81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:49.636182 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-fc37d72b-5122-4e16-97f2-6e5da7a70b81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:49.637733 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1325/2671] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:33:49 2022] DELETE /identity/v3/projects/31e4c2b663784908b914dc0493a78c6e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:33:49.642139 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f59b3-b63c-4a4f-bcf6-6dc833c39384 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:49.652178 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f59b3-b63c-4a4f-bcf6-6dc833c39384 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:49.711970 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba78567-accd-4acc-b44f-09fe95371594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:49.712643 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba78567-accd-4acc-b44f-09fe95371594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:49.712920 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba78567-accd-4acc-b44f-09fe95371594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:49.713191 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba78567-accd-4acc-b44f-09fe95371594 admin admin] PATH_INFO: `/v3/users/80dcc7db9d964ad1ab4a976f594aea91` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:49.714456 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba78567-accd-4acc-b44f-09fe95371594 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80dcc7db9d964ad1ab4a976f594aea91)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:49.716634 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba78567-accd-4acc-b44f-09fe95371594 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:49.772726 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-0ba78567-accd-4acc-b44f-09fe95371594 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80dcc7db9d964ad1ab4a976f594aea91'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:49.781562 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-0ba78567-accd-4acc-b44f-09fe95371594 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80dcc7db9d964ad1ab4a976f594aea91'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:49.789902 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-0ba78567-accd-4acc-b44f-09fe95371594 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80dcc7db9d964ad1ab4a976f594aea91'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:49.790617 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-0ba78567-accd-4acc-b44f-09fe95371594 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80dcc7db9d964ad1ab4a976f594aea91'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:49.804031 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-0ba78567-accd-4acc-b44f-09fe95371594 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80dcc7db9d964ad1ab4a976f594aea91'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:49.810700 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1347/2672] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:33:49 2022] DELETE /identity/v3/users/80dcc7db9d964ad1ab4a976f594aea91 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:33:50.117110 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc37d72b-5122-4e16-97f2-6e5da7a70b81 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:50.118649 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-fc37d72b-5122-4e16-97f2-6e5da7a70b81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:50.132398 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc37d72b-5122-4e16-97f2-6e5da7a70b81 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:50.183081 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:50.194595 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d7ba6-2dfc-4cfe-9139-cdc872a62bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:50.195533 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d7ba6-2dfc-4cfe-9139-cdc872a62bc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:50.195802 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d7ba6-2dfc-4cfe-9139-cdc872a62bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:50.196070 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d7ba6-2dfc-4cfe-9139-cdc872a62bc3 admin admin] PATH_INFO: `/v3/projects/9f0e1534f6034033bb5df6b7261426fc` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:50.197307 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4d7ba6-2dfc-4cfe-9139-cdc872a62bc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f0e1534f6034033bb5df6b7261426fc)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:50.199224 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4d7ba6-2dfc-4cfe-9139-cdc872a62bc3 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:50.249398 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9a4d7ba6-2dfc-4cfe-9139-cdc872a62bc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f0e1534f6034033bb5df6b7261426fc', 'request_id': 'req-9a4d7ba6-2dfc-4cfe-9139-cdc872a62bc3'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:50.255412 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9a4d7ba6-2dfc-4cfe-9139-cdc872a62bc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f0e1534f6034033bb5df6b7261426fc', 'request_id': 'req-9a4d7ba6-2dfc-4cfe-9139-cdc872a62bc3'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:50.265339 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9a4d7ba6-2dfc-4cfe-9139-cdc872a62bc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f0e1534f6034033bb5df6b7261426fc', 'request_id': 'req-9a4d7ba6-2dfc-4cfe-9139-cdc872a62bc3'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:50.275863 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9a4d7ba6-2dfc-4cfe-9139-cdc872a62bc3 admin admin] The token cache is being invalidate because project 9f0e1534f6034033bb5df6b7261426fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:33:50.276160 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9a4d7ba6-2dfc-4cfe-9139-cdc872a62bc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:50.276855 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9a4d7ba6-2dfc-4cfe-9139-cdc872a62bc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:50.278383 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1326/2673] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:33:50 2022] DELETE /identity/v3/projects/9f0e1534f6034033bb5df6b7261426fc => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:33:50.283642 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded96d9-6b5e-4919-86b5-3fd6e18af502 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:50.283921 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded96d9-6b5e-4919-86b5-3fd6e18af502 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:50.284191 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded96d9-6b5e-4919-86b5-3fd6e18af502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:50.305504 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:50.314859 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-7ded96d9-6b5e-4919-86b5-3fd6e18af502 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:50.316680 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-7ded96d9-6b5e-4919-86b5-3fd6e18af502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:50.385250 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1348/2674] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:33:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:33:50.393157 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943dfa9-c66a-4be2-83b3-cafec5ceafd3 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:50.393451 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943dfa9-c66a-4be2-83b3-cafec5ceafd3 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:50.393708 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943dfa9-c66a-4be2-83b3-cafec5ceafd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:50.413395 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-2943dfa9-c66a-4be2-83b3-cafec5ceafd3 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:50.414630 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-2943dfa9-c66a-4be2-83b3-cafec5ceafd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:50.422631 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1327/2675] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:33:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:33:50.427091 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ded96d9-6b5e-4919-86b5-3fd6e18af502 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:50.437246 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ded96d9-6b5e-4919-86b5-3fd6e18af502 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:50.442992 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d874c-aee3-4832-b754-366c6f6a7ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:50.443598 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d874c-aee3-4832-b754-366c6f6a7ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:50.443874 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d874c-aee3-4832-b754-366c6f6a7ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:50.444141 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d874c-aee3-4832-b754-366c6f6a7ac9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:50.444809 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d874c-aee3-4832-b754-366c6f6a7ac9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:50.445115 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d874c-aee3-4832-b754-366c6f6a7ac9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:50.446709 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d874c-aee3-4832-b754-366c6f6a7ac9 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:50.459291 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1349/2676] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:33:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:50.465191 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943dfa9-c66a-4be2-83b3-cafec5ceafd3 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:50.479470 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943dfa9-c66a-4be2-83b3-cafec5ceafd3 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:50.485594 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4d022-5839-4882-9be2-d494105416c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:50.486205 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4d022-5839-4882-9be2-d494105416c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:50.486483 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4d022-5839-4882-9be2-d494105416c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:50.486772 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4d022-5839-4882-9be2-d494105416c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:50.487429 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed4d022-5839-4882-9be2-d494105416c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:50.489348 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed4d022-5839-4882-9be2-d494105416c2 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:50.520238 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1328/2677] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:33:50 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:33:50.524731 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d874c-aee3-4832-b754-366c6f6a7ac9 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:50.535124 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d874c-aee3-4832-b754-366c6f6a7ac9 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:50.596397 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782012e-e124-4645-bd6f-3ad9f13149e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:50.597072 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782012e-e124-4645-bd6f-3ad9f13149e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:50.597365 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782012e-e124-4645-bd6f-3ad9f13149e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:50.597638 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782012e-e124-4645-bd6f-3ad9f13149e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:50.598292 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e782012e-e124-4645-bd6f-3ad9f13149e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:50.600326 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e782012e-e124-4645-bd6f-3ad9f13149e1 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:50.627591 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1350/2678] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:33:50 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:33:50.632875 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4d022-5839-4882-9be2-d494105416c2 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:50.646720 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4d022-5839-4882-9be2-d494105416c2 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:50.651504 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d072031-f93b-42c5-aa2c-592b481c6785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:50.652115 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d072031-f93b-42c5-aa2c-592b481c6785 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:50.652393 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d072031-f93b-42c5-aa2c-592b481c6785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:50.652693 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d072031-f93b-42c5-aa2c-592b481c6785 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:50.653350 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d072031-f93b-42c5-aa2c-592b481c6785 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:50.654945 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d072031-f93b-42c5-aa2c-592b481c6785 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:50.665592 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1329/2679] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:33:50.669888 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782012e-e124-4645-bd6f-3ad9f13149e1 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:50.680723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782012e-e124-4645-bd6f-3ad9f13149e1 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:50.687399 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2968efae-f19e-4e7f-a59d-d56631b8c032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:50.688137 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968efae-f19e-4e7f-a59d-d56631b8c032 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:50.688482 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968efae-f19e-4e7f-a59d-d56631b8c032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:50.688911 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968efae-f19e-4e7f-a59d-d56631b8c032 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:50.689759 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2968efae-f19e-4e7f-a59d-d56631b8c032 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:50.692026 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2968efae-f19e-4e7f-a59d-d56631b8c032 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:50.709066 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1351/2680] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:33:50.715424 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d072031-f93b-42c5-aa2c-592b481c6785 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:50.731022 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d072031-f93b-42c5-aa2c-592b481c6785 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:50.738256 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272811c2-e0c7-4a13-b054-9e78ebe1097f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:50.738903 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272811c2-e0c7-4a13-b054-9e78ebe1097f admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:50.739174 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272811c2-e0c7-4a13-b054-9e78ebe1097f admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:50.739443 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272811c2-e0c7-4a13-b054-9e78ebe1097f admin admin] PATH_INFO: `/v3/projects/aa6725f521194127839f11f2b7be4092/users/819f756c61a7450a8a68e5f153af2be6/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:50.755885 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272811c2-e0c7-4a13-b054-9e78ebe1097f admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa6725f521194127839f11f2b7be4092, user_id=819f756c61a7450a8a68e5f153af2be6, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:50.758897 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272811c2-e0c7-4a13-b054-9e78ebe1097f admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:50.774184 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1330/2681] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:33:50 2022] PUT /identity/v3/projects/aa6725f521194127839f11f2b7be4092/users/819f756c61a7450a8a68e5f153af2be6/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:33:50.785743 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56243ca-da42-403c-b661-838ca6ddbaf3 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:50.786027 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56243ca-da42-403c-b661-838ca6ddbaf3 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:50.786298 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56243ca-da42-403c-b661-838ca6ddbaf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:50.816131 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-a56243ca-da42-403c-b661-838ca6ddbaf3 None None] MFA Rules not processed for user `819f756c61a7450a8a68e5f153af2be6`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:50.817382 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a56243ca-da42-403c-b661-838ca6ddbaf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:50.888057 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1352/2682] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:33:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:33:50.895297 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272811c2-e0c7-4a13-b054-9e78ebe1097f admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:50.974719 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272811c2-e0c7-4a13-b054-9e78ebe1097f admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:50.980122 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33560878-af74-4b7c-80cc-422522118cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:50.980790 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33560878-af74-4b7c-80cc-422522118cec admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:50.981268 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33560878-af74-4b7c-80cc-422522118cec admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:50.981547 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33560878-af74-4b7c-80cc-422522118cec admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:50.982205 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33560878-af74-4b7c-80cc-422522118cec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:50.984832 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33560878-af74-4b7c-80cc-422522118cec admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:51.016426 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1331/2683] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:33:50 2022] POST /identity/v3/projects => generated 375 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:33:51.021397 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56243ca-da42-403c-b661-838ca6ddbaf3 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:51.027601 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:51.034784 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56243ca-da42-403c-b661-838ca6ddbaf3 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:51.094346 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e31946-6011-4ee5-822e-4654a4c562f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:51.094965 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e31946-6011-4ee5-822e-4654a4c562f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:51.095238 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e31946-6011-4ee5-822e-4654a4c562f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:51.095506 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e31946-6011-4ee5-822e-4654a4c562f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:51.096138 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e31946-6011-4ee5-822e-4654a4c562f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:51.098087 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e31946-6011-4ee5-822e-4654a4c562f2 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:51.129422 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1353/2684] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:33:51 2022] POST /identity/v3/users => generated 288 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:33:51.130661 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33560878-af74-4b7c-80cc-422522118cec admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:51.137956 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:51.142346 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33560878-af74-4b7c-80cc-422522118cec admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:51.149998 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be529cb5-290b-451d-814e-aed81c34c0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:51.151132 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be529cb5-290b-451d-814e-aed81c34c0c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:51.151573 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be529cb5-290b-451d-814e-aed81c34c0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:51.152092 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be529cb5-290b-451d-814e-aed81c34c0c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:51.153003 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be529cb5-290b-451d-814e-aed81c34c0c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:51.155001 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be529cb5-290b-451d-814e-aed81c34c0c1 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:51.166128 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1332/2685] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:33:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:33:51.170499 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e31946-6011-4ee5-822e-4654a4c562f2 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:51.180894 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e31946-6011-4ee5-822e-4654a4c562f2 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:51.186005 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd75c349-62a3-41cc-b231-a95ab5043dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:51.186716 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75c349-62a3-41cc-b231-a95ab5043dc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:51.187096 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75c349-62a3-41cc-b231-a95ab5043dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:51.187468 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75c349-62a3-41cc-b231-a95ab5043dc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:51.188130 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd75c349-62a3-41cc-b231-a95ab5043dc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:51.189759 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd75c349-62a3-41cc-b231-a95ab5043dc3 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:51.200348 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1354/2686] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:33:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:33:51.205605 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be529cb5-290b-451d-814e-aed81c34c0c1 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:51.216029 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be529cb5-290b-451d-814e-aed81c34c0c1 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:51.222448 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81b66d-444f-451c-9bcf-2cbfc94a2dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:51.223193 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81b66d-444f-451c-9bcf-2cbfc94a2dd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:51.223514 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81b66d-444f-451c-9bcf-2cbfc94a2dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:51.223791 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81b66d-444f-451c-9bcf-2cbfc94a2dd6 admin admin] PATH_INFO: `/v3/projects/f2114f375b7a4bceb3554f81ed78b254/users/c66b8eb4c30441dcbd5bb6f1b15a45e2/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:51.241523 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce81b66d-444f-451c-9bcf-2cbfc94a2dd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2114f375b7a4bceb3554f81ed78b254, user_id=c66b8eb4c30441dcbd5bb6f1b15a45e2, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:51.244442 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce81b66d-444f-451c-9bcf-2cbfc94a2dd6 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:51.258463 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1333/2687] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:33:51 2022] PUT /identity/v3/projects/f2114f375b7a4bceb3554f81ed78b254/users/c66b8eb4c30441dcbd5bb6f1b15a45e2/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:33:51.270427 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb993eda-0b97-4fb3-b5b1-97ef373595f9 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:51.271276 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb993eda-0b97-4fb3-b5b1-97ef373595f9 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:51.271276 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb993eda-0b97-4fb3-b5b1-97ef373595f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:51.301958 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-cb993eda-0b97-4fb3-b5b1-97ef373595f9 None None] MFA Rules not processed for user `c66b8eb4c30441dcbd5bb6f1b15a45e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:51.303288 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-cb993eda-0b97-4fb3-b5b1-97ef373595f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:51.397898 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1355/2688] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:33:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:33:51.399362 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81b66d-444f-451c-9bcf-2cbfc94a2dd6 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:51.473830 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81b66d-444f-451c-9bcf-2cbfc94a2dd6 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:51.479117 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725666f-e4c6-4577-b1f3-505a0494211e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:51.479770 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725666f-e4c6-4577-b1f3-505a0494211e admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:51.480048 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725666f-e4c6-4577-b1f3-505a0494211e admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:51.480316 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725666f-e4c6-4577-b1f3-505a0494211e admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:51.481004 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8725666f-e4c6-4577-b1f3-505a0494211e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:51.482945 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8725666f-e4c6-4577-b1f3-505a0494211e admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:51.513497 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1334/2689] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:33:51 2022] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:33:51.517923 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb993eda-0b97-4fb3-b5b1-97ef373595f9 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:51.529050 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb993eda-0b97-4fb3-b5b1-97ef373595f9 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:51.592207 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea8ad9-7303-4c0c-89bf-8f388c11e13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:51.592767 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea8ad9-7303-4c0c-89bf-8f388c11e13e admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:51.593504 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea8ad9-7303-4c0c-89bf-8f388c11e13e admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:51.593504 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea8ad9-7303-4c0c-89bf-8f388c11e13e admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:51.594006 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdea8ad9-7303-4c0c-89bf-8f388c11e13e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:51.595931 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdea8ad9-7303-4c0c-89bf-8f388c11e13e admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:51.616951 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:51.624911 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1356/2690] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:33:51 2022] POST /identity/v3/users => generated 295 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:33:51.629567 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725666f-e4c6-4577-b1f3-505a0494211e admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:51.641607 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725666f-e4c6-4577-b1f3-505a0494211e admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:51.646914 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b4110-b754-4e74-a1ca-1c1d3d8b8c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:51.647560 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b4110-b754-4e74-a1ca-1c1d3d8b8c44 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:51.647838 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b4110-b754-4e74-a1ca-1c1d3d8b8c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:51.648187 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b4110-b754-4e74-a1ca-1c1d3d8b8c44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:51.648883 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88b4110-b754-4e74-a1ca-1c1d3d8b8c44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:51.650587 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88b4110-b754-4e74-a1ca-1c1d3d8b8c44 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:51.662357 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1335/2691] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:33:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:33:51.668076 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea8ad9-7303-4c0c-89bf-8f388c11e13e admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:51.679215 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea8ad9-7303-4c0c-89bf-8f388c11e13e admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:51.684289 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39721c7e-6f9e-4f2f-b737-b2ea6ce53997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:51.685010 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39721c7e-6f9e-4f2f-b737-b2ea6ce53997 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:51.685315 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39721c7e-6f9e-4f2f-b737-b2ea6ce53997 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:51.685585 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39721c7e-6f9e-4f2f-b737-b2ea6ce53997 admin admin] PATH_INFO: `/v3/projects/c0fb44742c284d52a31128b06f0685cf/users/e57627e77613424fb9c1e1536fe09b86/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:51.701713 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39721c7e-6f9e-4f2f-b737-b2ea6ce53997 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0fb44742c284d52a31128b06f0685cf, user_id=e57627e77613424fb9c1e1536fe09b86, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:51.704408 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39721c7e-6f9e-4f2f-b737-b2ea6ce53997 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:51.719345 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1357/2692] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:33:51 2022] PUT /identity/v3/projects/c0fb44742c284d52a31128b06f0685cf/users/e57627e77613424fb9c1e1536fe09b86/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:33:51.723786 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b4110-b754-4e74-a1ca-1c1d3d8b8c44 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:51.734174 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b4110-b754-4e74-a1ca-1c1d3d8b8c44 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:51.793635 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf229f7-6f94-4536-9a1b-76439f8d0eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:51.794244 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf229f7-6f94-4536-9a1b-76439f8d0eb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:51.794522 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf229f7-6f94-4536-9a1b-76439f8d0eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:51.794798 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf229f7-6f94-4536-9a1b-76439f8d0eb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:51.795446 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf229f7-6f94-4536-9a1b-76439f8d0eb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:51.797301 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf229f7-6f94-4536-9a1b-76439f8d0eb0 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:51.807722 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1336/2693] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:33:51 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:33:51.812245 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39721c7e-6f9e-4f2f-b737-b2ea6ce53997 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:51.822697 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39721c7e-6f9e-4f2f-b737-b2ea6ce53997 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:51.827840 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5610b5-e09b-45d8-81c2-f06c64e889bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:51.828682 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5610b5-e09b-45d8-81c2-f06c64e889bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:51.828966 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5610b5-e09b-45d8-81c2-f06c64e889bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:51.829240 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5610b5-e09b-45d8-81c2-f06c64e889bb admin admin] PATH_INFO: `/v3/projects/c0fb44742c284d52a31128b06f0685cf/users/e57627e77613424fb9c1e1536fe09b86/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:51.831363 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5610b5-e09b-45d8-81c2-f06c64e889bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0fb44742c284d52a31128b06f0685cf, user_id=e57627e77613424fb9c1e1536fe09b86, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:51.834238 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5610b5-e09b-45d8-81c2-f06c64e889bb admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:51.847390 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1358/2694] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:33:51 2022] PUT /identity/v3/projects/c0fb44742c284d52a31128b06f0685cf/users/e57627e77613424fb9c1e1536fe09b86/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:33:51.856673 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da926e8-81f6-4cb2-a48b-da11ca744919 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:51.857031 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da926e8-81f6-4cb2-a48b-da11ca744919 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:51.857378 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da926e8-81f6-4cb2-a48b-da11ca744919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:51.886923 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-9da926e8-81f6-4cb2-a48b-da11ca744919 None None] MFA Rules not processed for user `e57627e77613424fb9c1e1536fe09b86`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:51.888167 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-9da926e8-81f6-4cb2-a48b-da11ca744919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:51.922895 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:51.978637 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1337/2695] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:33:51 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:33:51.991219 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5610b5-e09b-45d8-81c2-f06c64e889bb admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:51.993031 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-2e5610b5-e09b-45d8-81c2-f06c64e889bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:52.052319 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5610b5-e09b-45d8-81c2-f06c64e889bb admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:52.055929 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58159511-aa30-49a9-b10e-08dac2bfc235 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:52.056587 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58159511-aa30-49a9-b10e-08dac2bfc235 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:52.056985 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58159511-aa30-49a9-b10e-08dac2bfc235 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:52.057141 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58159511-aa30-49a9-b10e-08dac2bfc235 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:52.114507 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58159511-aa30-49a9-b10e-08dac2bfc235 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:52.115945 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58159511-aa30-49a9-b10e-08dac2bfc235 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:52.128648 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1359/2696] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:33:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:33:53.100676 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498ca9f-1e75-4492-90a4-eb919bda22cd None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:53.101203 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498ca9f-1e75-4492-90a4-eb919bda22cd None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:53.101203 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498ca9f-1e75-4492-90a4-eb919bda22cd None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:53.102848 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1338/2697] 10.222.0.36 () {54 vars in 921 bytes} [Mon Aug 29 22:33:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:33:53.107922 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e325de4-6d3c-43b8-9a46-a0851062c2ba None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:53.108526 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e325de4-6d3c-43b8-9a46-a0851062c2ba None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:53.108526 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e325de4-6d3c-43b8-9a46-a0851062c2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:53.130374 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-2e325de4-6d3c-43b8-9a46-a0851062c2ba None None] MFA Rules not processed for user `90b7213b7111456a93e294ce40b95b21`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:53.131986 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-2e325de4-6d3c-43b8-9a46-a0851062c2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:53.203049 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1360/2698] 10.222.0.36 () {58 vars in 1018 bytes} [Mon Aug 29 22:33:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:33:53.214895 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8498ca9f-1e75-4492-90a4-eb919bda22cd None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:53.217781 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-8498ca9f-1e75-4492-90a4-eb919bda22cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:53.282423 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8498ca9f-1e75-4492-90a4-eb919bda22cd None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:53.286046 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4de750-74c6-436e-85cb-5baa9bacc161 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a399ee5db44100a88a4ffb451512aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:53.286654 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4de750-74c6-436e-85cb-5baa9bacc161 service glance] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:53.286932 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4de750-74c6-436e-85cb-5baa9bacc161 service glance] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:53.287204 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4de750-74c6-436e-85cb-5baa9bacc161 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:53.298023 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4de750-74c6-436e-85cb-5baa9bacc161 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:53.299449 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4de750-74c6-436e-85cb-5baa9bacc161 service glance] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:53.312037 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1339/2699] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:33:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:33:53.652312 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e325de4-6d3c-43b8-9a46-a0851062c2ba None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:53.654398 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-2e325de4-6d3c-43b8-9a46-a0851062c2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:53.668230 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e325de4-6d3c-43b8-9a46-a0851062c2ba None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:53.672084 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b5b75-f8aa-4199-a73a-4c15bc280dbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:53.673041 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b5b75-f8aa-4199-a73a-4c15bc280dbb service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:53.673637 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b5b75-f8aa-4199-a73a-4c15bc280dbb service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:53.674225 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b5b75-f8aa-4199-a73a-4c15bc280dbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:53.683353 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:53.747446 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4b5b75-f8aa-4199-a73a-4c15bc280dbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:53.749329 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4b5b75-f8aa-4199-a73a-4c15bc280dbb service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:53.762070 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1361/2700] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:33:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:33:54.414069 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4de750-74c6-436e-85cb-5baa9bacc161 service glance] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:54.426297 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4de750-74c6-436e-85cb-5baa9bacc161 service glance] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:54.430306 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7484f39-7c81-4e63-93b1-fc6b446b502a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:54.430910 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7484f39-7c81-4e63-93b1-fc6b446b502a service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:54.431313 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7484f39-7c81-4e63-93b1-fc6b446b502a service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:54.431592 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7484f39-7c81-4e63-93b1-fc6b446b502a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:54.441261 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7484f39-7c81-4e63-93b1-fc6b446b502a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:54.442701 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7484f39-7c81-4e63-93b1-fc6b446b502a service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:54.453365 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1340/2701] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:33:54 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:33:55.484302 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569941b-939b-46f9-a54e-355a996a3ace None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:55.485011 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569941b-939b-46f9-a54e-355a996a3ace None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:55.485011 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569941b-939b-46f9-a54e-355a996a3ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:55.509557 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-f569941b-939b-46f9-a54e-355a996a3ace None None] MFA Rules not processed for user `b32922d090564162810dd8b28c3a322b`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:55.510786 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f569941b-939b-46f9-a54e-355a996a3ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:55.585401 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1362/2702] 10.222.0.36 () {58 vars in 1009 bytes} [Mon Aug 29 22:33:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:33:55.602159 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7484f39-7c81-4e63-93b1-fc6b446b502a service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:55.605019 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d7484f39-7c81-4e63-93b1-fc6b446b502a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:55.690890 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7484f39-7c81-4e63-93b1-fc6b446b502a service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:55.695985 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ae02e-c197-4a01-8c60-260c394fd843 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3472d8ffa748d8828c6a2d89ee7ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:55.696639 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ae02e-c197-4a01-8c60-260c394fd843 service swift] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:55.696940 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ae02e-c197-4a01-8c60-260c394fd843 service swift] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:55.697206 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ae02e-c197-4a01-8c60-260c394fd843 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:55.706480 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9ae02e-c197-4a01-8c60-260c394fd843 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:55.708155 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9ae02e-c197-4a01-8c60-260c394fd843 service swift] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:55.717125 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1341/2703] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Aug 29 22:33:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 22:33:56.696195 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f569941b-939b-46f9-a54e-355a996a3ace None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:56.697691 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f569941b-939b-46f9-a54e-355a996a3ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:56.715586 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f569941b-939b-46f9-a54e-355a996a3ace None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:56.721793 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd8fd00-f2e4-4701-95de-b2e778b179e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b7213b7111456a93e294ce40b95b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:56.722447 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd8fd00-f2e4-4701-95de-b2e778b179e6 service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:56.722724 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd8fd00-f2e4-4701-95de-b2e778b179e6 service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:56.722995 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd8fd00-f2e4-4701-95de-b2e778b179e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:56.724793 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-9fd8fd00-f2e4-4701-95de-b2e778b179e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:56.821962 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd8fd00-f2e4-4701-95de-b2e778b179e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:56.824034 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd8fd00-f2e4-4701-95de-b2e778b179e6 service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:56.841246 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1363/2704] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:33:56 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:33:58.556093 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ae02e-c197-4a01-8c60-260c394fd843 service swift] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:58.666170 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:58.685063 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ae02e-c197-4a01-8c60-260c394fd843 service swift] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:58.692079 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e25a130-2d8c-4c03-8a94-9a101fa56d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:58.692827 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25a130-2d8c-4c03-8a94-9a101fa56d6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:58.693045 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25a130-2d8c-4c03-8a94-9a101fa56d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:58.693508 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25a130-2d8c-4c03-8a94-9a101fa56d6b admin admin] PATH_INFO: `/v3/users/819f756c61a7450a8a68e5f153af2be6` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:58.694652 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e25a130-2d8c-4c03-8a94-9a101fa56d6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=819f756c61a7450a8a68e5f153af2be6)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:58.696653 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e25a130-2d8c-4c03-8a94-9a101fa56d6b admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:58.759149 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-3e25a130-2d8c-4c03-8a94-9a101fa56d6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '819f756c61a7450a8a68e5f153af2be6'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:58.767931 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-3e25a130-2d8c-4c03-8a94-9a101fa56d6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '819f756c61a7450a8a68e5f153af2be6'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:58.769067 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-3e25a130-2d8c-4c03-8a94-9a101fa56d6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '819f756c61a7450a8a68e5f153af2be6'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:58.782246 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-3e25a130-2d8c-4c03-8a94-9a101fa56d6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '819f756c61a7450a8a68e5f153af2be6'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:58.783065 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-3e25a130-2d8c-4c03-8a94-9a101fa56d6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '819f756c61a7450a8a68e5f153af2be6'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:58.813431 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1342/2705] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:33:58 2022] DELETE /identity/v3/users/819f756c61a7450a8a68e5f153af2be6 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:33:58.817768 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293df65-0c1b-4b85-93b4-12408a856c4e None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:58.818371 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293df65-0c1b-4b85-93b4-12408a856c4e None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:58.818371 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293df65-0c1b-4b85-93b4-12408a856c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:58.849129 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-d293df65-0c1b-4b85-93b4-12408a856c4e None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:58.850245 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-d293df65-0c1b-4b85-93b4-12408a856c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:58.919209 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:58.935875 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1364/2706] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:33:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:33:58.947544 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e25a130-2d8c-4c03-8a94-9a101fa56d6b admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:58.949048 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-3e25a130-2d8c-4c03-8a94-9a101fa56d6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:59.028759 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e25a130-2d8c-4c03-8a94-9a101fa56d6b admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:59.034174 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8122df-8a7e-47db-8415-6431513beda4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:59.035473 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8122df-8a7e-47db-8415-6431513beda4 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:59.035940 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8122df-8a7e-47db-8415-6431513beda4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:59.036225 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8122df-8a7e-47db-8415-6431513beda4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:59.054208 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8122df-8a7e-47db-8415-6431513beda4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:59.055737 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8122df-8a7e-47db-8415-6431513beda4 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:59.068380 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1343/2707] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:33:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:33:59.606443 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d293df65-0c1b-4b85-93b4-12408a856c4e None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:59.608150 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-d293df65-0c1b-4b85-93b4-12408a856c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:59.623827 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d293df65-0c1b-4b85-93b4-12408a856c4e None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:59.631296 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b819ec-8e25-4d95-a81d-b2ddb28a6914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:59.632656 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b819ec-8e25-4d95-a81d-b2ddb28a6914 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:59.633096 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b819ec-8e25-4d95-a81d-b2ddb28a6914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:59.633545 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b819ec-8e25-4d95-a81d-b2ddb28a6914 admin admin] PATH_INFO: `/v3/projects/aa6725f521194127839f11f2b7be4092` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:59.636477 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b819ec-8e25-4d95-a81d-b2ddb28a6914 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa6725f521194127839f11f2b7be4092)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:59.639126 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b819ec-8e25-4d95-a81d-b2ddb28a6914 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:59.736165 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-c8b819ec-8e25-4d95-a81d-b2ddb28a6914 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa6725f521194127839f11f2b7be4092', 'request_id': 'req-c8b819ec-8e25-4d95-a81d-b2ddb28a6914'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:59.749000 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-c8b819ec-8e25-4d95-a81d-b2ddb28a6914 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa6725f521194127839f11f2b7be4092', 'request_id': 'req-c8b819ec-8e25-4d95-a81d-b2ddb28a6914'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:59.763087 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-c8b819ec-8e25-4d95-a81d-b2ddb28a6914 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa6725f521194127839f11f2b7be4092', 'request_id': 'req-c8b819ec-8e25-4d95-a81d-b2ddb28a6914'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:59.794569 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-c8b819ec-8e25-4d95-a81d-b2ddb28a6914 admin admin] The token cache is being invalidate because project aa6725f521194127839f11f2b7be4092 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:33:59.799366 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-c8b819ec-8e25-4d95-a81d-b2ddb28a6914 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:59.801043 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-c8b819ec-8e25-4d95-a81d-b2ddb28a6914 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:33:59.807536 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1365/2708] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:33:59 2022] DELETE /identity/v3/projects/aa6725f521194127839f11f2b7be4092 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:33:59.813127 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8122df-8a7e-47db-8415-6431513beda4 service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:59.828299 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8122df-8a7e-47db-8415-6431513beda4 service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:59.868763 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b819ec-8e25-4d95-a81d-b2ddb28a6914 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:59.870345 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c8b819ec-8e25-4d95-a81d-b2ddb28a6914 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:59.923905 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd8019-1b6a-4a89-bfc9-1268c395f279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:59.924683 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd8019-1b6a-4a89-bfc9-1268c395f279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:59.924961 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd8019-1b6a-4a89-bfc9-1268c395f279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:59.925253 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd8019-1b6a-4a89-bfc9-1268c395f279 admin admin] PATH_INFO: `/v3/users/c66b8eb4c30441dcbd5bb6f1b15a45e2` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:59.937430 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd8019-1b6a-4a89-bfc9-1268c395f279 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c66b8eb4c30441dcbd5bb6f1b15a45e2)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:59.942596 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd8019-1b6a-4a89-bfc9-1268c395f279 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:59.957315 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b819ec-8e25-4d95-a81d-b2ddb28a6914 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:59.960130 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:59.964891 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935a6c5-7f81-4050-b1be-9e44f95e6887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:59.966599 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935a6c5-7f81-4050-b1be-9e44f95e6887 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:59.967680 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935a6c5-7f81-4050-b1be-9e44f95e6887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:59.967680 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935a6c5-7f81-4050-b1be-9e44f95e6887 admin admin] PATH_INFO: `/v3/users/9370ecce7a2245c6a11cb3da6eb8399b` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:59.971679 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b935a6c5-7f81-4050-b1be-9e44f95e6887 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9370ecce7a2245c6a11cb3da6eb8399b)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:59.977054 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b935a6c5-7f81-4050-b1be-9e44f95e6887 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:00.031407 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5afd8019-1b6a-4a89-bfc9-1268c395f279 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c66b8eb4c30441dcbd5bb6f1b15a45e2'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:00.040676 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5afd8019-1b6a-4a89-bfc9-1268c395f279 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c66b8eb4c30441dcbd5bb6f1b15a45e2'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:00.041562 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5afd8019-1b6a-4a89-bfc9-1268c395f279 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c66b8eb4c30441dcbd5bb6f1b15a45e2'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:00.051475 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5afd8019-1b6a-4a89-bfc9-1268c395f279 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c66b8eb4c30441dcbd5bb6f1b15a45e2'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:00.052290 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5afd8019-1b6a-4a89-bfc9-1268c395f279 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c66b8eb4c30441dcbd5bb6f1b15a45e2'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:00.065905 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b935a6c5-7f81-4050-b1be-9e44f95e6887 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9370ecce7a2245c6a11cb3da6eb8399b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:00.078430 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b935a6c5-7f81-4050-b1be-9e44f95e6887 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9370ecce7a2245c6a11cb3da6eb8399b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:00.086286 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1344/2709] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:33:59 2022] DELETE /identity/v3/users/c66b8eb4c30441dcbd5bb6f1b15a45e2 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:34:00.089104 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b935a6c5-7f81-4050-b1be-9e44f95e6887 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9370ecce7a2245c6a11cb3da6eb8399b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:00.093166 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b935a6c5-7f81-4050-b1be-9e44f95e6887 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9370ecce7a2245c6a11cb3da6eb8399b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:00.105466 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:00.110911 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b935a6c5-7f81-4050-b1be-9e44f95e6887 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9370ecce7a2245c6a11cb3da6eb8399b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:00.121863 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1366/2710] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:33:59 2022] DELETE /identity/v3/users/9370ecce7a2245c6a11cb3da6eb8399b => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:34:00.430854 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd8019-1b6a-4a89-bfc9-1268c395f279 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:00.433754 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-5afd8019-1b6a-4a89-bfc9-1268c395f279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:00.535170 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd8019-1b6a-4a89-bfc9-1268c395f279 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:00.556480 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935a6c5-7f81-4050-b1be-9e44f95e6887 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:00.558168 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b935a6c5-7f81-4050-b1be-9e44f95e6887 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:00.650568 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f0ef8b-d3da-4a22-9c8f-34c6e9f2077c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:00.651324 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0ef8b-d3da-4a22-9c8f-34c6e9f2077c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:00.651688 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0ef8b-d3da-4a22-9c8f-34c6e9f2077c admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:00.652037 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0ef8b-d3da-4a22-9c8f-34c6e9f2077c admin admin] PATH_INFO: `/v3/projects/cc032bde8c3b48fba2a3e4b6038f5b2d` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:00.653299 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f0ef8b-d3da-4a22-9c8f-34c6e9f2077c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc032bde8c3b48fba2a3e4b6038f5b2d)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:00.655729 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f0ef8b-d3da-4a22-9c8f-34c6e9f2077c admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:00.664628 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935a6c5-7f81-4050-b1be-9e44f95e6887 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:00.670885 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666ec3d-a9f5-4f8b-bb7e-43b37323b54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:00.671600 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666ec3d-a9f5-4f8b-bb7e-43b37323b54b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:00.671931 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666ec3d-a9f5-4f8b-bb7e-43b37323b54b admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:00.672267 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666ec3d-a9f5-4f8b-bb7e-43b37323b54b admin admin] PATH_INFO: `/v3/projects/f2114f375b7a4bceb3554f81ed78b254` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:00.681310 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4666ec3d-a9f5-4f8b-bb7e-43b37323b54b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2114f375b7a4bceb3554f81ed78b254)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:00.688088 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4666ec3d-a9f5-4f8b-bb7e-43b37323b54b admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:00.700588 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:00.717702 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-43f0ef8b-d3da-4a22-9c8f-34c6e9f2077c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc032bde8c3b48fba2a3e4b6038f5b2d', 'request_id': 'req-43f0ef8b-d3da-4a22-9c8f-34c6e9f2077c'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:00.734421 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-43f0ef8b-d3da-4a22-9c8f-34c6e9f2077c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc032bde8c3b48fba2a3e4b6038f5b2d', 'request_id': 'req-43f0ef8b-d3da-4a22-9c8f-34c6e9f2077c'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:00.746853 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-43f0ef8b-d3da-4a22-9c8f-34c6e9f2077c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc032bde8c3b48fba2a3e4b6038f5b2d', 'request_id': 'req-43f0ef8b-d3da-4a22-9c8f-34c6e9f2077c'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:00.762751 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-43f0ef8b-d3da-4a22-9c8f-34c6e9f2077c admin admin] The token cache is being invalidate because project cc032bde8c3b48fba2a3e4b6038f5b2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:34:00.763486 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-43f0ef8b-d3da-4a22-9c8f-34c6e9f2077c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:00.765037 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-43f0ef8b-d3da-4a22-9c8f-34c6e9f2077c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:00.765289 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-4666ec3d-a9f5-4f8b-bb7e-43b37323b54b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2114f375b7a4bceb3554f81ed78b254', 'request_id': 'req-4666ec3d-a9f5-4f8b-bb7e-43b37323b54b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:00.767569 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1345/2711] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:34:00 2022] DELETE /identity/v3/projects/cc032bde8c3b48fba2a3e4b6038f5b2d => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:34:00.771800 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f0ef8b-d3da-4a22-9c8f-34c6e9f2077c admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:00.775323 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-4666ec3d-a9f5-4f8b-bb7e-43b37323b54b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2114f375b7a4bceb3554f81ed78b254', 'request_id': 'req-4666ec3d-a9f5-4f8b-bb7e-43b37323b54b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:00.779280 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-43f0ef8b-d3da-4a22-9c8f-34c6e9f2077c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:00.782292 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-4666ec3d-a9f5-4f8b-bb7e-43b37323b54b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2114f375b7a4bceb3554f81ed78b254', 'request_id': 'req-4666ec3d-a9f5-4f8b-bb7e-43b37323b54b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:00.802431 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-4666ec3d-a9f5-4f8b-bb7e-43b37323b54b admin admin] The token cache is being invalidate because project f2114f375b7a4bceb3554f81ed78b254 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:34:00.802726 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-4666ec3d-a9f5-4f8b-bb7e-43b37323b54b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:00.803402 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-4666ec3d-a9f5-4f8b-bb7e-43b37323b54b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:00.808314 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1367/2712] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:34:00 2022] DELETE /identity/v3/projects/f2114f375b7a4bceb3554f81ed78b254 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:34:00.809417 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666ec3d-a9f5-4f8b-bb7e-43b37323b54b admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:00.810966 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-4666ec3d-a9f5-4f8b-bb7e-43b37323b54b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:00.862225 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f0ef8b-d3da-4a22-9c8f-34c6e9f2077c admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:00.919782 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666ec3d-a9f5-4f8b-bb7e-43b37323b54b admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:00.923843 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98535083-d890-40d0-b45e-e694afebc428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:00.924622 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98535083-d890-40d0-b45e-e694afebc428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:00.924903 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98535083-d890-40d0-b45e-e694afebc428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:00.925172 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98535083-d890-40d0-b45e-e694afebc428 admin admin] PATH_INFO: `/v3/users/6c442c16bddf4aa783577a081c5ab4c8` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:00.926327 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98535083-d890-40d0-b45e-e694afebc428 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c442c16bddf4aa783577a081c5ab4c8)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:00.928839 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98535083-d890-40d0-b45e-e694afebc428 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:00.936671 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d7ef4-89c3-46f9-b85c-9e0f08b8501d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:00.937224 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d7ef4-89c3-46f9-b85c-9e0f08b8501d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:00.937507 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d7ef4-89c3-46f9-b85c-9e0f08b8501d admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:00.937782 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d7ef4-89c3-46f9-b85c-9e0f08b8501d admin admin] PATH_INFO: `/v3/users/e57627e77613424fb9c1e1536fe09b86` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:00.938966 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d7ef4-89c3-46f9-b85c-9e0f08b8501d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e57627e77613424fb9c1e1536fe09b86)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:00.941117 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d7ef4-89c3-46f9-b85c-9e0f08b8501d admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:01.020335 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-98535083-d890-40d0-b45e-e694afebc428 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c442c16bddf4aa783577a081c5ab4c8'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:01.022255 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:01.037265 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-98535083-d890-40d0-b45e-e694afebc428 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c442c16bddf4aa783577a081c5ab4c8'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:01.038240 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-98535083-d890-40d0-b45e-e694afebc428 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c442c16bddf4aa783577a081c5ab4c8'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:01.054120 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-98535083-d890-40d0-b45e-e694afebc428 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c442c16bddf4aa783577a081c5ab4c8'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:01.055107 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-98535083-d890-40d0-b45e-e694afebc428 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c442c16bddf4aa783577a081c5ab4c8'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:01.064986 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-dc8d7ef4-89c3-46f9-b85c-9e0f08b8501d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e57627e77613424fb9c1e1536fe09b86'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:01.070799 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:01.082574 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-dc8d7ef4-89c3-46f9-b85c-9e0f08b8501d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e57627e77613424fb9c1e1536fe09b86'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:01.096228 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-dc8d7ef4-89c3-46f9-b85c-9e0f08b8501d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e57627e77613424fb9c1e1536fe09b86'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:01.098485 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-dc8d7ef4-89c3-46f9-b85c-9e0f08b8501d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e57627e77613424fb9c1e1536fe09b86'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:01.103425 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1346/2713] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:34:00 2022] DELETE /identity/v3/users/6c442c16bddf4aa783577a081c5ab4c8 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:34:01.158786 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-dc8d7ef4-89c3-46f9-b85c-9e0f08b8501d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e57627e77613424fb9c1e1536fe09b86'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:01.168344 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1368/2714] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:34:00 2022] DELETE /identity/v3/users/e57627e77613424fb9c1e1536fe09b86 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:34:01.467997 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98535083-d890-40d0-b45e-e694afebc428 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:01.470815 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-98535083-d890-40d0-b45e-e694afebc428 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:01.584905 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98535083-d890-40d0-b45e-e694afebc428 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:01.669092 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d8d22-96d1-4662-b00d-17c8672f09b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:01.669531 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d7ef4-89c3-46f9-b85c-9e0f08b8501d admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:01.670361 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d8d22-96d1-4662-b00d-17c8672f09b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:01.670852 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d8d22-96d1-4662-b00d-17c8672f09b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:01.671151 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-dc8d7ef4-89c3-46f9-b85c-9e0f08b8501d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:01.672442 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d8d22-96d1-4662-b00d-17c8672f09b4 admin admin] PATH_INFO: `/v3/projects/a86b8d678ee04f22bc03c47def02baea` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:01.674204 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d8d22-96d1-4662-b00d-17c8672f09b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a86b8d678ee04f22bc03c47def02baea)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:01.677164 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d8d22-96d1-4662-b00d-17c8672f09b4 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:01.696392 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d7ef4-89c3-46f9-b85c-9e0f08b8501d admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:01.733362 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ba7b4-a377-43ee-8e0b-a0418a3cdc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:01.734045 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ba7b4-a377-43ee-8e0b-a0418a3cdc96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:01.735198 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ba7b4-a377-43ee-8e0b-a0418a3cdc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:01.735486 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ba7b4-a377-43ee-8e0b-a0418a3cdc96 admin admin] PATH_INFO: `/v3/projects/c0fb44742c284d52a31128b06f0685cf` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:01.744102 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436ba7b4-a377-43ee-8e0b-a0418a3cdc96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0fb44742c284d52a31128b06f0685cf)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:01.746192 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436ba7b4-a377-43ee-8e0b-a0418a3cdc96 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:01.761031 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-310d8d22-96d1-4662-b00d-17c8672f09b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a86b8d678ee04f22bc03c47def02baea', 'request_id': 'req-310d8d22-96d1-4662-b00d-17c8672f09b4'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:01.772764 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-310d8d22-96d1-4662-b00d-17c8672f09b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a86b8d678ee04f22bc03c47def02baea', 'request_id': 'req-310d8d22-96d1-4662-b00d-17c8672f09b4'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:01.782388 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-310d8d22-96d1-4662-b00d-17c8672f09b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a86b8d678ee04f22bc03c47def02baea', 'request_id': 'req-310d8d22-96d1-4662-b00d-17c8672f09b4'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:01.811358 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-310d8d22-96d1-4662-b00d-17c8672f09b4 admin admin] The token cache is being invalidate because project a86b8d678ee04f22bc03c47def02baea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:34:01.811611 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-310d8d22-96d1-4662-b00d-17c8672f09b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:01.812476 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-310d8d22-96d1-4662-b00d-17c8672f09b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:01.818119 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1347/2715] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:34:01 2022] DELETE /identity/v3/projects/a86b8d678ee04f22bc03c47def02baea => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:34:01.820641 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e0df8-854c-40aa-8345-e3d159cd53e8 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:01.820932 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e0df8-854c-40aa-8345-e3d159cd53e8 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:01.821366 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e0df8-854c-40aa-8345-e3d159cd53e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:01.837516 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-436ba7b4-a377-43ee-8e0b-a0418a3cdc96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0fb44742c284d52a31128b06f0685cf', 'request_id': 'req-436ba7b4-a377-43ee-8e0b-a0418a3cdc96'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:01.851257 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-369e0df8-854c-40aa-8345-e3d159cd53e8 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:34:01.852571 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-369e0df8-854c-40aa-8345-e3d159cd53e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:01.856397 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-436ba7b4-a377-43ee-8e0b-a0418a3cdc96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0fb44742c284d52a31128b06f0685cf', 'request_id': 'req-436ba7b4-a377-43ee-8e0b-a0418a3cdc96'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:01.863310 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-436ba7b4-a377-43ee-8e0b-a0418a3cdc96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0fb44742c284d52a31128b06f0685cf', 'request_id': 'req-436ba7b4-a377-43ee-8e0b-a0418a3cdc96'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:01.881174 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:01.884755 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-436ba7b4-a377-43ee-8e0b-a0418a3cdc96 admin admin] The token cache is being invalidate because project c0fb44742c284d52a31128b06f0685cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:34:01.885042 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-436ba7b4-a377-43ee-8e0b-a0418a3cdc96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:01.887124 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-436ba7b4-a377-43ee-8e0b-a0418a3cdc96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:01.891320 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1369/2716] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:34:01 2022] DELETE /identity/v3/projects/c0fb44742c284d52a31128b06f0685cf => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:34:01.898237 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4c17e-0fc5-44f3-a9c6-ed1c8d83ad87 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:01.898654 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4c17e-0fc5-44f3-a9c6-ed1c8d83ad87 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:01.898984 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4c17e-0fc5-44f3-a9c6-ed1c8d83ad87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:01.941777 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1348/2717] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:34:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:34:01.949506 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-31c4c17e-0fc5-44f3-a9c6-ed1c8d83ad87 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:34:01.950521 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfe57a-f514-4a15-9ccd-2023d9e2939a None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:01.950814 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-31c4c17e-0fc5-44f3-a9c6-ed1c8d83ad87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:01.950926 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfe57a-f514-4a15-9ccd-2023d9e2939a None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:01.951085 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfe57a-f514-4a15-9ccd-2023d9e2939a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:01.961247 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1370/2718] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:34:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:34:01.970134 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8dca9-b4a4-45cf-b73b-481878398e8b None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:01.970489 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8dca9-b4a4-45cf-b73b-481878398e8b None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:01.973493 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8dca9-b4a4-45cf-b73b-481878398e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:01.974581 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-67dfe57a-f514-4a15-9ccd-2023d9e2939a None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:34:01.975818 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-67dfe57a-f514-4a15-9ccd-2023d9e2939a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:01.988228 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1349/2719] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:34:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:34:01.989213 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dfe57a-f514-4a15-9ccd-2023d9e2939a None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:02.000478 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dfe57a-f514-4a15-9ccd-2023d9e2939a None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:02.007229 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e02fb2-63f0-41f0-beaa-4eea06acba91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:02.007993 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e02fb2-63f0-41f0-beaa-4eea06acba91 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:02.008274 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e02fb2-63f0-41f0-beaa-4eea06acba91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:02.008595 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e02fb2-63f0-41f0-beaa-4eea06acba91 admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:02.009340 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e02fb2-63f0-41f0-beaa-4eea06acba91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:34:02.009704 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e02fb2-63f0-41f0-beaa-4eea06acba91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:02.010367 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-ccf8dca9-b4a4-45cf-b73b-481878398e8b None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:34:02.011391 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e02fb2-63f0-41f0-beaa-4eea06acba91 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:02.011618 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-ccf8dca9-b4a4-45cf-b73b-481878398e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:02.023800 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1371/2720] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:34:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:34:02.025008 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8dca9-b4a4-45cf-b73b-481878398e8b None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:02.036394 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8dca9-b4a4-45cf-b73b-481878398e8b None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:02.039000 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1350/2721] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:34:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:02.044029 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e02fb2-63f0-41f0-beaa-4eea06acba91 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:02.048462 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051edc84-cd31-40bb-b89c-e07201dabf6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:02.049114 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051edc84-cd31-40bb-b89c-e07201dabf6e admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:02.049397 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051edc84-cd31-40bb-b89c-e07201dabf6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:02.049684 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051edc84-cd31-40bb-b89c-e07201dabf6e admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:02.050563 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051edc84-cd31-40bb-b89c-e07201dabf6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:34:02.050887 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051edc84-cd31-40bb-b89c-e07201dabf6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:02.052846 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051edc84-cd31-40bb-b89c-e07201dabf6e admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:02.056096 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e02fb2-63f0-41f0-beaa-4eea06acba91 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:02.066595 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1372/2722] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:34:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:02.067813 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ce1c88-529c-4103-afb4-37aad727d378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:02.068772 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce1c88-529c-4103-afb4-37aad727d378 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:02.069126 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce1c88-529c-4103-afb4-37aad727d378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:02.069399 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce1c88-529c-4103-afb4-37aad727d378 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:02.070500 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ce1c88-529c-4103-afb4-37aad727d378 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:02.071699 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051edc84-cd31-40bb-b89c-e07201dabf6e admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:02.072577 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ce1c88-529c-4103-afb4-37aad727d378 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:02.096149 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051edc84-cd31-40bb-b89c-e07201dabf6e admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:02.101191 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaea006-5339-4bde-afd8-401d7b951ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:02.102065 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaea006-5339-4bde-afd8-401d7b951ce0 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:02.112315 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaea006-5339-4bde-afd8-401d7b951ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:02.113067 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaea006-5339-4bde-afd8-401d7b951ce0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:02.113989 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaea006-5339-4bde-afd8-401d7b951ce0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:02.117404 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1351/2723] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:34:02 2022] POST /identity/v3/projects => generated 371 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:34:02.118489 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaea006-5339-4bde-afd8-401d7b951ce0 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:02.121789 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ce1c88-529c-4103-afb4-37aad727d378 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:02.160048 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1373/2724] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:34:02 2022] POST /identity/v3/projects => generated 385 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:34:02.166417 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaea006-5339-4bde-afd8-401d7b951ce0 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:02.226374 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:02.252620 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ce1c88-529c-4103-afb4-37aad727d378 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:02.270849 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaea006-5339-4bde-afd8-401d7b951ce0 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:02.276834 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c2beb-17e5-4872-b7ce-433e5e8bce67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:02.277472 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c2beb-17e5-4872-b7ce-433e5e8bce67 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:02.277752 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c2beb-17e5-4872-b7ce-433e5e8bce67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:02.278095 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c2beb-17e5-4872-b7ce-433e5e8bce67 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:02.279017 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c2beb-17e5-4872-b7ce-433e5e8bce67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:02.281672 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c2beb-17e5-4872-b7ce-433e5e8bce67 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:02.318363 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1374/2725] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:34:02 2022] POST /identity/v3/users => generated 293 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:34:02.322721 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c2beb-17e5-4872-b7ce-433e5e8bce67 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:02.350644 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c2beb-17e5-4872-b7ce-433e5e8bce67 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:02.371865 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891bf1f8-0e5b-4c43-b392-180beb445324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:02.372578 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891bf1f8-0e5b-4c43-b392-180beb445324 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:02.374430 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891bf1f8-0e5b-4c43-b392-180beb445324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:02.374841 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891bf1f8-0e5b-4c43-b392-180beb445324 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:02.375567 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891bf1f8-0e5b-4c43-b392-180beb445324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:02.378614 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891bf1f8-0e5b-4c43-b392-180beb445324 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:02.382894 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c0c08-fb1d-4652-af6b-ccc0468ded4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:02.383755 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c0c08-fb1d-4652-af6b-ccc0468ded4d admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:02.384182 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c0c08-fb1d-4652-af6b-ccc0468ded4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:02.384672 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c0c08-fb1d-4652-af6b-ccc0468ded4d admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:02.385451 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c0c08-fb1d-4652-af6b-ccc0468ded4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:02.387523 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c0c08-fb1d-4652-af6b-ccc0468ded4d admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:02.395045 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1375/2726] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:34:02.396131 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891bf1f8-0e5b-4c43-b392-180beb445324 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:02.407016 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891bf1f8-0e5b-4c43-b392-180beb445324 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:02.415274 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3953ff1f-f400-42e1-a157-3c595698d7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:02.416529 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953ff1f-f400-42e1-a157-3c595698d7c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:02.416694 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1352/2727] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:34:02 2022] POST /identity/v3/users => generated 286 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:34:02.416791 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953ff1f-f400-42e1-a157-3c595698d7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:02.417244 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953ff1f-f400-42e1-a157-3c595698d7c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:02.417932 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3953ff1f-f400-42e1-a157-3c595698d7c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:02.419944 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3953ff1f-f400-42e1-a157-3c595698d7c1 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:02.433743 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c0c08-fb1d-4652-af6b-ccc0468ded4d admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:02.445656 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1376/2728] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:34:02.450413 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c0c08-fb1d-4652-af6b-ccc0468ded4d admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:02.456989 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fef19d-1336-4bd3-956a-2347093aba69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:02.458467 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fef19d-1336-4bd3-956a-2347093aba69 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:02.459005 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fef19d-1336-4bd3-956a-2347093aba69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:02.462161 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3953ff1f-f400-42e1-a157-3c595698d7c1 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:02.470388 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fef19d-1336-4bd3-956a-2347093aba69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:02.472379 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fef19d-1336-4bd3-956a-2347093aba69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:02.477743 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fef19d-1336-4bd3-956a-2347093aba69 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:02.480042 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3953ff1f-f400-42e1-a157-3c595698d7c1 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:02.494752 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1858b858-afc3-4f92-90d2-5b49ce17b4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:02.494752 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858b858-afc3-4f92-90d2-5b49ce17b4fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:02.494752 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858b858-afc3-4f92-90d2-5b49ce17b4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:02.494752 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858b858-afc3-4f92-90d2-5b49ce17b4fa admin admin] PATH_INFO: `/v3/projects/0b9413208c5844189a9529d161ed9aca/users/46fb0ca0d10145c9a2e3bd8d6c0b74f4/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:02.502433 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1353/2729] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:34:02.504634 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fef19d-1336-4bd3-956a-2347093aba69 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:02.518194 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fef19d-1336-4bd3-956a-2347093aba69 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:02.519024 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1858b858-afc3-4f92-90d2-5b49ce17b4fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b9413208c5844189a9529d161ed9aca, user_id=46fb0ca0d10145c9a2e3bd8d6c0b74f4, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:02.522952 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82349d6f-c819-45c3-a3bf-5e5081c52608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:02.523623 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82349d6f-c819-45c3-a3bf-5e5081c52608 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:02.523855 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82349d6f-c819-45c3-a3bf-5e5081c52608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:02.523970 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1858b858-afc3-4f92-90d2-5b49ce17b4fa admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:02.524125 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82349d6f-c819-45c3-a3bf-5e5081c52608 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:02.524840 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82349d6f-c819-45c3-a3bf-5e5081c52608 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:02.526470 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82349d6f-c819-45c3-a3bf-5e5081c52608 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:02.533079 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:02.540774 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1354/2730] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:34:02.543972 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82349d6f-c819-45c3-a3bf-5e5081c52608 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:02.555260 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1377/2731] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:34:02 2022] PUT /identity/v3/projects/0b9413208c5844189a9529d161ed9aca/users/46fb0ca0d10145c9a2e3bd8d6c0b74f4/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:34:02.573037 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82349d6f-c819-45c3-a3bf-5e5081c52608 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:02.576262 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb76bc3-f974-4263-b7b7-8d1598c2b44e None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:02.576756 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb76bc3-f974-4263-b7b7-8d1598c2b44e None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:02.577583 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb76bc3-f974-4263-b7b7-8d1598c2b44e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:02.630846 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-5fb76bc3-f974-4263-b7b7-8d1598c2b44e None None] MFA Rules not processed for user `46fb0ca0d10145c9a2e3bd8d6c0b74f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:34:02.633233 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-5fb76bc3-f974-4263-b7b7-8d1598c2b44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:02.640112 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34068c55-a4a0-46e3-b558-05309a7f5ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:02.651879 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34068c55-a4a0-46e3-b558-05309a7f5ae8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:02.651879 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34068c55-a4a0-46e3-b558-05309a7f5ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:02.651879 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34068c55-a4a0-46e3-b558-05309a7f5ae8 admin admin] PATH_INFO: `/v3/projects/56cc5bd2a0b34e67a49758c5bcb1fe16/users/06e025cf8a9b435c8807d9f767ef95c7/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:02.695433 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34068c55-a4a0-46e3-b558-05309a7f5ae8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56cc5bd2a0b34e67a49758c5bcb1fe16, user_id=06e025cf8a9b435c8807d9f767ef95c7, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:02.698648 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34068c55-a4a0-46e3-b558-05309a7f5ae8 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:02.719449 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1355/2732] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:34:02 2022] PUT /identity/v3/projects/56cc5bd2a0b34e67a49758c5bcb1fe16/users/06e025cf8a9b435c8807d9f767ef95c7/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:34:02.724498 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16905517-8e02-40b8-9853-f2c31bb116a4 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:02.724787 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16905517-8e02-40b8-9853-f2c31bb116a4 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:02.725055 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16905517-8e02-40b8-9853-f2c31bb116a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:02.732953 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1378/2733] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:34:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:34:02.745637 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb76bc3-f974-4263-b7b7-8d1598c2b44e None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:02.747097 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-5fb76bc3-f974-4263-b7b7-8d1598c2b44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:02.750429 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-16905517-8e02-40b8-9853-f2c31bb116a4 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:34:02.751716 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-16905517-8e02-40b8-9853-f2c31bb116a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:02.820172 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb76bc3-f974-4263-b7b7-8d1598c2b44e None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:02.851743 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1356/2734] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:34:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:34:02.862465 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16905517-8e02-40b8-9853-f2c31bb116a4 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:02.863940 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-16905517-8e02-40b8-9853-f2c31bb116a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:02.874658 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:02.913607 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdef5f5-f581-4158-a87e-6ea973735e85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:02.914270 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdef5f5-f581-4158-a87e-6ea973735e85 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:02.914551 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdef5f5-f581-4158-a87e-6ea973735e85 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:02.914831 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdef5f5-f581-4158-a87e-6ea973735e85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:02.943463 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16905517-8e02-40b8-9853-f2c31bb116a4 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:02.948587 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da6a32-c39e-449c-aade-f5af207563a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:02.949579 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da6a32-c39e-449c-aade-f5af207563a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:02.949864 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da6a32-c39e-449c-aade-f5af207563a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:02.950145 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da6a32-c39e-449c-aade-f5af207563a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:02.962303 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76da6a32-c39e-449c-aade-f5af207563a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:02.963744 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76da6a32-c39e-449c-aade-f5af207563a5 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:02.989002 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1357/2735] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:34:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:34:03.038766 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdef5f5-f581-4158-a87e-6ea973735e85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:03.041047 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdef5f5-f581-4158-a87e-6ea973735e85 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:03.053129 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1379/2736] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:34:02 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:34:03.912610 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe73e9d-592e-45d1-84da-8d03155d17ac None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:03.912901 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe73e9d-592e-45d1-84da-8d03155d17ac None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:03.913177 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe73e9d-592e-45d1-84da-8d03155d17ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:03.961450 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-bbe73e9d-592e-45d1-84da-8d03155d17ac None None] MFA Rules not processed for user `06e025cf8a9b435c8807d9f767ef95c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:34:03.963079 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-bbe73e9d-592e-45d1-84da-8d03155d17ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:03.991113 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:04.063361 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1358/2737] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:34:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:34:04.078255 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdef5f5-f581-4158-a87e-6ea973735e85 service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:04.089547 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdef5f5-f581-4158-a87e-6ea973735e85 service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:04.093511 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5d9437-7709-4eb3-ab0f-7e30e37a954d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:04.094368 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d9437-7709-4eb3-ab0f-7e30e37a954d service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:04.094646 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d9437-7709-4eb3-ab0f-7e30e37a954d service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:04.094919 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d9437-7709-4eb3-ab0f-7e30e37a954d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:04.104667 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5d9437-7709-4eb3-ab0f-7e30e37a954d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:04.106162 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5d9437-7709-4eb3-ab0f-7e30e37a954d service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:04.117392 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1380/2738] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:34:04 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:34:05.520809 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea059e-9622-4eac-bf16-32f410816d76 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:05.521422 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea059e-9622-4eac-bf16-32f410816d76 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:05.521422 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea059e-9622-4eac-bf16-32f410816d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:05.541650 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-baea059e-9622-4eac-bf16-32f410816d76 None None] MFA Rules not processed for user `06e025cf8a9b435c8807d9f767ef95c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:34:05.542891 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-baea059e-9622-4eac-bf16-32f410816d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:05.552065 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1359/2739] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:34:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:34:05.878530 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5d9437-7709-4eb3-ab0f-7e30e37a954d service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:05.896486 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5d9437-7709-4eb3-ab0f-7e30e37a954d service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:05.907190 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2adc835-3135-467a-aca4-fa0e221cd370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:05.907858 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adc835-3135-467a-aca4-fa0e221cd370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:05.908130 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adc835-3135-467a-aca4-fa0e221cd370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:05.908402 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adc835-3135-467a-aca4-fa0e221cd370 admin admin] PATH_INFO: `/v3/users/46fb0ca0d10145c9a2e3bd8d6c0b74f4` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:05.909859 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2adc835-3135-467a-aca4-fa0e221cd370 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46fb0ca0d10145c9a2e3bd8d6c0b74f4)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:05.912028 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2adc835-3135-467a-aca4-fa0e221cd370 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:05.977864 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a2adc835-3135-467a-aca4-fa0e221cd370 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46fb0ca0d10145c9a2e3bd8d6c0b74f4'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:05.987087 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a2adc835-3135-467a-aca4-fa0e221cd370 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46fb0ca0d10145c9a2e3bd8d6c0b74f4'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:05.996890 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a2adc835-3135-467a-aca4-fa0e221cd370 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46fb0ca0d10145c9a2e3bd8d6c0b74f4'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:05.997772 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a2adc835-3135-467a-aca4-fa0e221cd370 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46fb0ca0d10145c9a2e3bd8d6c0b74f4'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:06.015726 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a2adc835-3135-467a-aca4-fa0e221cd370 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46fb0ca0d10145c9a2e3bd8d6c0b74f4'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:06.023834 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1381/2740] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:34:05 2022] DELETE /identity/v3/users/46fb0ca0d10145c9a2e3bd8d6c0b74f4 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:34:06.029551 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6875a87-bcba-4393-8bc5-f76f48d3084e None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:06.029966 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6875a87-bcba-4393-8bc5-f76f48d3084e None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:06.030530 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6875a87-bcba-4393-8bc5-f76f48d3084e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:06.054682 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-b6875a87-bcba-4393-8bc5-f76f48d3084e None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:34:06.055933 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b6875a87-bcba-4393-8bc5-f76f48d3084e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:06.166349 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1360/2741] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:34:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:34:06.176702 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2adc835-3135-467a-aca4-fa0e221cd370 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:06.178168 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a2adc835-3135-467a-aca4-fa0e221cd370 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:06.252676 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:06.278586 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2adc835-3135-467a-aca4-fa0e221cd370 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:06.282995 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee9534-274e-4fe4-80bf-5dce00ec926b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:06.283622 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee9534-274e-4fe4-80bf-5dce00ec926b service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:06.283903 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee9534-274e-4fe4-80bf-5dce00ec926b service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:06.284174 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee9534-274e-4fe4-80bf-5dce00ec926b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:06.293727 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee9534-274e-4fe4-80bf-5dce00ec926b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:06.295166 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee9534-274e-4fe4-80bf-5dce00ec926b service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:06.309812 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1382/2742] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:34:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:34:06.653518 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6875a87-bcba-4393-8bc5-f76f48d3084e None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:06.655029 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b6875a87-bcba-4393-8bc5-f76f48d3084e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:06.668095 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6875a87-bcba-4393-8bc5-f76f48d3084e None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:06.673676 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3a98f-8518-4a4f-abb9-7365fe6660e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:06.674340 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3a98f-8518-4a4f-abb9-7365fe6660e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:06.674615 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3a98f-8518-4a4f-abb9-7365fe6660e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:06.674889 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3a98f-8518-4a4f-abb9-7365fe6660e5 admin admin] PATH_INFO: `/v3/projects/0b9413208c5844189a9529d161ed9aca` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:06.676070 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba3a98f-8518-4a4f-abb9-7365fe6660e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b9413208c5844189a9529d161ed9aca)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:06.678236 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba3a98f-8518-4a4f-abb9-7365fe6660e5 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:06.734502 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-dba3a98f-8518-4a4f-abb9-7365fe6660e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b9413208c5844189a9529d161ed9aca', 'request_id': 'req-dba3a98f-8518-4a4f-abb9-7365fe6660e5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:06.740772 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-dba3a98f-8518-4a4f-abb9-7365fe6660e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b9413208c5844189a9529d161ed9aca', 'request_id': 'req-dba3a98f-8518-4a4f-abb9-7365fe6660e5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:06.752343 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-dba3a98f-8518-4a4f-abb9-7365fe6660e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b9413208c5844189a9529d161ed9aca', 'request_id': 'req-dba3a98f-8518-4a4f-abb9-7365fe6660e5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:06.767363 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-dba3a98f-8518-4a4f-abb9-7365fe6660e5 admin admin] The token cache is being invalidate because project 0b9413208c5844189a9529d161ed9aca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:34:06.767630 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-dba3a98f-8518-4a4f-abb9-7365fe6660e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:06.768347 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-dba3a98f-8518-4a4f-abb9-7365fe6660e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:06.769981 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1361/2743] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:34:06 2022] DELETE /identity/v3/projects/0b9413208c5844189a9529d161ed9aca => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:34:06.775963 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f76da-f14a-42dd-b075-a3423ccb9160 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:06.776256 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f76da-f14a-42dd-b075-a3423ccb9160 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:06.776565 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f76da-f14a-42dd-b075-a3423ccb9160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:06.799271 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-e84f76da-f14a-42dd-b075-a3423ccb9160 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:34:06.800955 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e84f76da-f14a-42dd-b075-a3423ccb9160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:06.873356 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1383/2744] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:34:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:34:06.882930 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ce73a-279c-43bd-be30-59b63de5c504 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:06.883295 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ce73a-279c-43bd-be30-59b63de5c504 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:06.883644 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ce73a-279c-43bd-be30-59b63de5c504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:06.907284 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-b07ce73a-279c-43bd-be30-59b63de5c504 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:34:06.908754 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b07ce73a-279c-43bd-be30-59b63de5c504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:06.919563 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1362/2745] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:34:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:34:06.923136 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f76da-f14a-42dd-b075-a3423ccb9160 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:06.934134 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f76da-f14a-42dd-b075-a3423ccb9160 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:06.939113 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9c24b-adab-4c00-a2ca-5aaae268d5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:06.939784 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9c24b-adab-4c00-a2ca-5aaae268d5c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:06.940057 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9c24b-adab-4c00-a2ca-5aaae268d5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:06.940333 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9c24b-adab-4c00-a2ca-5aaae268d5c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:06.941142 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d9c24b-adab-4c00-a2ca-5aaae268d5c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:34:06.941446 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d9c24b-adab-4c00-a2ca-5aaae268d5c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:06.943264 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d9c24b-adab-4c00-a2ca-5aaae268d5c3 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:06.957346 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1384/2746] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:34:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:34:06.961830 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ce73a-279c-43bd-be30-59b63de5c504 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:06.972243 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ce73a-279c-43bd-be30-59b63de5c504 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:06.977364 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33fc824-8d96-4add-92b4-ea28d2fee04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:06.977972 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33fc824-8d96-4add-92b4-ea28d2fee04c admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:06.978253 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33fc824-8d96-4add-92b4-ea28d2fee04c admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:06.978503 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33fc824-8d96-4add-92b4-ea28d2fee04c admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:06.979203 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33fc824-8d96-4add-92b4-ea28d2fee04c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:06.981138 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33fc824-8d96-4add-92b4-ea28d2fee04c admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:07.015761 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1363/2747] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:34:06 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:34:07.021515 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9c24b-adab-4c00-a2ca-5aaae268d5c3 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:07.032272 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9c24b-adab-4c00-a2ca-5aaae268d5c3 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:07.096263 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20af15-9607-4e40-a951-d5328bb037ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:07.096938 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20af15-9607-4e40-a951-d5328bb037ae admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:07.097221 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20af15-9607-4e40-a951-d5328bb037ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:07.097497 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20af15-9607-4e40-a951-d5328bb037ae admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:07.098146 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d20af15-9607-4e40-a951-d5328bb037ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:07.100081 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d20af15-9607-4e40-a951-d5328bb037ae admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:07.125687 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1385/2748] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:34:07 2022] POST /identity/v3/users => generated 288 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:34:07.130063 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33fc824-8d96-4add-92b4-ea28d2fee04c admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:07.137324 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:07.141935 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33fc824-8d96-4add-92b4-ea28d2fee04c admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:07.147683 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a191bf1-d12b-47c8-986c-f719fd7b2f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:07.148341 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a191bf1-d12b-47c8-986c-f719fd7b2f75 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:07.148667 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a191bf1-d12b-47c8-986c-f719fd7b2f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:07.149034 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a191bf1-d12b-47c8-986c-f719fd7b2f75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:07.149688 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a191bf1-d12b-47c8-986c-f719fd7b2f75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:07.151983 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a191bf1-d12b-47c8-986c-f719fd7b2f75 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:07.162784 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1364/2749] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:34:07.168439 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20af15-9607-4e40-a951-d5328bb037ae admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:07.179305 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20af15-9607-4e40-a951-d5328bb037ae admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:07.185456 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f0fb1-ff06-4b07-816b-1a9eece43824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:07.186065 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f0fb1-ff06-4b07-816b-1a9eece43824 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:07.186345 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f0fb1-ff06-4b07-816b-1a9eece43824 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:07.186613 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f0fb1-ff06-4b07-816b-1a9eece43824 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:07.187409 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4f0fb1-ff06-4b07-816b-1a9eece43824 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:07.189071 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4f0fb1-ff06-4b07-816b-1a9eece43824 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:07.200342 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1386/2750] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:34:07.205055 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a191bf1-d12b-47c8-986c-f719fd7b2f75 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:07.215909 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a191bf1-d12b-47c8-986c-f719fd7b2f75 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:07.223456 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031bb2db-7f9d-4279-929b-dfa197a8f003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:07.224389 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031bb2db-7f9d-4279-929b-dfa197a8f003 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:07.224789 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031bb2db-7f9d-4279-929b-dfa197a8f003 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:07.225096 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031bb2db-7f9d-4279-929b-dfa197a8f003 admin admin] PATH_INFO: `/v3/projects/db93b02982974b29926f3f17127adec8/users/81a1816f972d48a7bcfcfa4d5326e752/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:07.245244 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031bb2db-7f9d-4279-929b-dfa197a8f003 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db93b02982974b29926f3f17127adec8, user_id=81a1816f972d48a7bcfcfa4d5326e752, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:07.247985 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031bb2db-7f9d-4279-929b-dfa197a8f003 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:07.266427 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1365/2751] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:34:07 2022] PUT /identity/v3/projects/db93b02982974b29926f3f17127adec8/users/81a1816f972d48a7bcfcfa4d5326e752/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:34:07.277155 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f251afd-7330-497c-87b2-c5f49b14fbca None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:07.277443 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f251afd-7330-497c-87b2-c5f49b14fbca None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:07.277717 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f251afd-7330-497c-87b2-c5f49b14fbca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:07.309041 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-2f251afd-7330-497c-87b2-c5f49b14fbca None None] MFA Rules not processed for user `81a1816f972d48a7bcfcfa4d5326e752`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:34:07.310274 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-2f251afd-7330-497c-87b2-c5f49b14fbca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:07.355107 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:07.390877 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1387/2752] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:34:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:34:07.401925 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031bb2db-7f9d-4279-929b-dfa197a8f003 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:07.403860 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-031bb2db-7f9d-4279-929b-dfa197a8f003 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:07.474224 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031bb2db-7f9d-4279-929b-dfa197a8f003 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:07.478579 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd844b2e-233b-44e3-951e-4f7e9d396a83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:07.479343 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd844b2e-233b-44e3-951e-4f7e9d396a83 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:07.479783 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd844b2e-233b-44e3-951e-4f7e9d396a83 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:07.480188 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd844b2e-233b-44e3-951e-4f7e9d396a83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:07.491752 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd844b2e-233b-44e3-951e-4f7e9d396a83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:07.493571 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd844b2e-233b-44e3-951e-4f7e9d396a83 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:07.505279 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1366/2753] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:34:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:34:08.926972 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933d994-e610-484a-a1fb-6c56f8d10d1b None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:08.927478 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933d994-e610-484a-a1fb-6c56f8d10d1b None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:08.927478 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933d994-e610-484a-a1fb-6c56f8d10d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:08.947784 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-5933d994-e610-484a-a1fb-6c56f8d10d1b None None] MFA Rules not processed for user `81a1816f972d48a7bcfcfa4d5326e752`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:34:08.949048 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-5933d994-e610-484a-a1fb-6c56f8d10d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:08.957121 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1388/2754] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:34:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:34:10.294831 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c994f-4411-4cd3-8477-e972b8a227b5 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:10.295341 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c994f-4411-4cd3-8477-e972b8a227b5 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:10.295440 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c994f-4411-4cd3-8477-e972b8a227b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:10.317469 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-df0c994f-4411-4cd3-8477-e972b8a227b5 None None] MFA Rules not processed for user `b32922d090564162810dd8b28c3a322b`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:34:10.318751 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-df0c994f-4411-4cd3-8477-e972b8a227b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:10.385724 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1367/2755] 10.222.0.36 () {58 vars in 967 bytes} [Mon Aug 29 22:34:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:34:10.398930 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933d994-e610-484a-a1fb-6c56f8d10d1b None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:10.400376 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-5933d994-e610-484a-a1fb-6c56f8d10d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:10.498396 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933d994-e610-484a-a1fb-6c56f8d10d1b None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:10.511231 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a956523e-7803-4664-bce1-1032957f6641 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3472d8ffa748d8828c6a2d89ee7ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:10.511914 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956523e-7803-4664-bce1-1032957f6641 service swift] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:10.512196 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956523e-7803-4664-bce1-1032957f6641 service swift] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:10.512568 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956523e-7803-4664-bce1-1032957f6641 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:10.524434 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a956523e-7803-4664-bce1-1032957f6641 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:10.527335 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a956523e-7803-4664-bce1-1032957f6641 service swift] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:10.538819 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1389/2756] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Aug 29 22:34:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 22:34:20.377313 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=64,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:20.535053 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=45 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:23.862846 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0bfb8-f1b4-4436-8ef7-04c1a3292c14 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:23.863398 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0bfb8-f1b4-4436-8ef7-04c1a3292c14 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:23.863398 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0bfb8-f1b4-4436-8ef7-04c1a3292c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:23.885256 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-9ec0bfb8-f1b4-4436-8ef7-04c1a3292c14 None None] MFA Rules not processed for user `06e025cf8a9b435c8807d9f767ef95c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:34:23.886577 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-9ec0bfb8-f1b4-4436-8ef7-04c1a3292c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:23.956708 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1368/2757] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:34:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:34:24.314610 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a956523e-7803-4664-bce1-1032957f6641 service swift] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:24.322548 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a956523e-7803-4664-bce1-1032957f6641 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:24.424308 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a956523e-7803-4664-bce1-1032957f6641 service swift] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:24.435211 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd3867-2738-4782-a1e9-41daf6b8ada2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:24.437009 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd3867-2738-4782-a1e9-41daf6b8ada2 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:24.437009 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd3867-2738-4782-a1e9-41daf6b8ada2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:24.437009 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd3867-2738-4782-a1e9-41daf6b8ada2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:24.441578 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-15cd3867-2738-4782-a1e9-41daf6b8ada2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:24.454284 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cd3867-2738-4782-a1e9-41daf6b8ada2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:24.456033 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cd3867-2738-4782-a1e9-41daf6b8ada2 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:24.469189 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1390/2758] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:34:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:34:25.384933 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc79a4-2e35-4797-b6ff-6bae04fd15a3 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:25.385658 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc79a4-2e35-4797-b6ff-6bae04fd15a3 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:25.385658 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc79a4-2e35-4797-b6ff-6bae04fd15a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:25.407268 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-b9dc79a4-2e35-4797-b6ff-6bae04fd15a3 None None] MFA Rules not processed for user `b32922d090564162810dd8b28c3a322b`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:34:25.408701 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b9dc79a4-2e35-4797-b6ff-6bae04fd15a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:25.416767 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1369/2759] 10.222.0.36 () {58 vars in 1009 bytes} [Mon Aug 29 22:34:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:34:25.430627 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd3867-2738-4782-a1e9-41daf6b8ada2 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:25.445622 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd3867-2738-4782-a1e9-41daf6b8ada2 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:25.452054 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00507c3-5d4a-4051-82fc-efc914fccaa5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3472d8ffa748d8828c6a2d89ee7ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:25.452701 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00507c3-5d4a-4051-82fc-efc914fccaa5 service swift] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:25.453135 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00507c3-5d4a-4051-82fc-efc914fccaa5 service swift] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:25.453426 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00507c3-5d4a-4051-82fc-efc914fccaa5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:25.463527 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00507c3-5d4a-4051-82fc-efc914fccaa5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:25.465160 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00507c3-5d4a-4051-82fc-efc914fccaa5 service swift] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:25.474636 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1391/2760] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Aug 29 22:34:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 22:34:26.070645 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987d151-c5c1-4890-b9fb-aea0007c1868 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:26.071297 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987d151-c5c1-4890-b9fb-aea0007c1868 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:26.071776 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987d151-c5c1-4890-b9fb-aea0007c1868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:26.093846 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-3987d151-c5c1-4890-b9fb-aea0007c1868 None None] MFA Rules not processed for user `b32922d090564162810dd8b28c3a322b`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:34:26.095157 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-3987d151-c5c1-4890-b9fb-aea0007c1868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:26.102809 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1370/2761] 10.222.0.36 () {58 vars in 967 bytes} [Mon Aug 29 22:34:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:34:26.118269 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00507c3-5d4a-4051-82fc-efc914fccaa5 service swift] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:26.131175 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00507c3-5d4a-4051-82fc-efc914fccaa5 service swift] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:26.136731 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1283cf26-b0ad-439d-9686-a14d7acb9eb2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3472d8ffa748d8828c6a2d89ee7ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:26.137466 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283cf26-b0ad-439d-9686-a14d7acb9eb2 service swift] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:26.137797 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283cf26-b0ad-439d-9686-a14d7acb9eb2 service swift] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:26.138267 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283cf26-b0ad-439d-9686-a14d7acb9eb2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:26.147390 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1283cf26-b0ad-439d-9686-a14d7acb9eb2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:26.149255 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1283cf26-b0ad-439d-9686-a14d7acb9eb2 service swift] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:26.158537 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1392/2762] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Aug 29 22:34:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 22:34:26.437025 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9652e-62b0-4852-8242-2e52f6155889 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:26.437512 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9652e-62b0-4852-8242-2e52f6155889 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:26.437710 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9652e-62b0-4852-8242-2e52f6155889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:26.457281 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-46c9652e-62b0-4852-8242-2e52f6155889 None None] MFA Rules not processed for user `b32922d090564162810dd8b28c3a322b`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:34:26.459272 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-46c9652e-62b0-4852-8242-2e52f6155889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:26.466593 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1371/2763] 10.222.0.36 () {58 vars in 1009 bytes} [Mon Aug 29 22:34:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:34:26.479918 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1283cf26-b0ad-439d-9686-a14d7acb9eb2 service swift] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:26.490948 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1283cf26-b0ad-439d-9686-a14d7acb9eb2 service swift] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:26.496654 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d49548-f227-4fa8-918b-8197741ec190 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3472d8ffa748d8828c6a2d89ee7ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:26.497268 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d49548-f227-4fa8-918b-8197741ec190 service swift] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:26.497558 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d49548-f227-4fa8-918b-8197741ec190 service swift] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:26.497833 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d49548-f227-4fa8-918b-8197741ec190 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:26.506359 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d49548-f227-4fa8-918b-8197741ec190 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:26.508321 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d49548-f227-4fa8-918b-8197741ec190 service swift] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:26.517512 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1393/2764] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Aug 29 22:34:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 22:34:26.877511 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dadd0b-facc-4fb2-99aa-a75fe9cb3542 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:26.877881 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dadd0b-facc-4fb2-99aa-a75fe9cb3542 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:26.878162 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dadd0b-facc-4fb2-99aa-a75fe9cb3542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:26.906239 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-e1dadd0b-facc-4fb2-99aa-a75fe9cb3542 None None] MFA Rules not processed for user `b32922d090564162810dd8b28c3a322b`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:34:26.907537 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-e1dadd0b-facc-4fb2-99aa-a75fe9cb3542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:26.915716 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1372/2765] 10.222.0.36 () {58 vars in 967 bytes} [Mon Aug 29 22:34:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:34:26.930662 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d49548-f227-4fa8-918b-8197741ec190 service swift] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:26.944124 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d49548-f227-4fa8-918b-8197741ec190 service swift] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:26.949368 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc599e5-00dd-4f54-b990-ad4191461896 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3472d8ffa748d8828c6a2d89ee7ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:26.949922 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc599e5-00dd-4f54-b990-ad4191461896 service swift] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:26.950201 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc599e5-00dd-4f54-b990-ad4191461896 service swift] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:26.950475 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc599e5-00dd-4f54-b990-ad4191461896 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:26.959501 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc599e5-00dd-4f54-b990-ad4191461896 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:26.961242 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc599e5-00dd-4f54-b990-ad4191461896 service swift] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:26.971253 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1394/2766] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Aug 29 22:34:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 22:34:29.171128 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dadd0b-facc-4fb2-99aa-a75fe9cb3542 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:29.245338 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dadd0b-facc-4fb2-99aa-a75fe9cb3542 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:29.251680 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da5cbb-e59c-43af-a6c2-692d54c9fad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:29.252331 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da5cbb-e59c-43af-a6c2-692d54c9fad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:29.252639 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da5cbb-e59c-43af-a6c2-692d54c9fad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:29.252910 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da5cbb-e59c-43af-a6c2-692d54c9fad7 admin admin] PATH_INFO: `/v3/users/81a1816f972d48a7bcfcfa4d5326e752` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:29.254059 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86da5cbb-e59c-43af-a6c2-692d54c9fad7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81a1816f972d48a7bcfcfa4d5326e752)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:29.256285 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86da5cbb-e59c-43af-a6c2-692d54c9fad7 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:29.320891 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-86da5cbb-e59c-43af-a6c2-692d54c9fad7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81a1816f972d48a7bcfcfa4d5326e752'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:29.327725 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-86da5cbb-e59c-43af-a6c2-692d54c9fad7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81a1816f972d48a7bcfcfa4d5326e752'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:29.328417 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-86da5cbb-e59c-43af-a6c2-692d54c9fad7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81a1816f972d48a7bcfcfa4d5326e752'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:29.336545 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-86da5cbb-e59c-43af-a6c2-692d54c9fad7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81a1816f972d48a7bcfcfa4d5326e752'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:29.337336 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-86da5cbb-e59c-43af-a6c2-692d54c9fad7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81a1816f972d48a7bcfcfa4d5326e752'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:29.350677 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:29.360687 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1373/2767] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:34:29 2022] DELETE /identity/v3/users/81a1816f972d48a7bcfcfa4d5326e752 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:34:29.364833 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17882d77-41fa-45fd-849d-6ca8e1ca9b5a None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:29.365417 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17882d77-41fa-45fd-849d-6ca8e1ca9b5a None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:29.365515 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17882d77-41fa-45fd-849d-6ca8e1ca9b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:29.386915 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-17882d77-41fa-45fd-849d-6ca8e1ca9b5a None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:34:29.388235 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-17882d77-41fa-45fd-849d-6ca8e1ca9b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:29.450082 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1395/2768] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:34:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:34:29.459944 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da5cbb-e59c-43af-a6c2-692d54c9fad7 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:29.461517 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-86da5cbb-e59c-43af-a6c2-692d54c9fad7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:29.525297 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da5cbb-e59c-43af-a6c2-692d54c9fad7 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:29.528953 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee0b8b-aa92-4c37-a978-51d4160244af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:29.529585 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee0b8b-aa92-4c37-a978-51d4160244af service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:29.529893 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee0b8b-aa92-4c37-a978-51d4160244af service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:29.530178 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee0b8b-aa92-4c37-a978-51d4160244af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:29.540833 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ee0b8b-aa92-4c37-a978-51d4160244af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:29.542291 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ee0b8b-aa92-4c37-a978-51d4160244af service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:29.557455 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1374/2769] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:34:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:34:29.782181 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17882d77-41fa-45fd-849d-6ca8e1ca9b5a None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:29.783683 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-17882d77-41fa-45fd-849d-6ca8e1ca9b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:29.796624 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17882d77-41fa-45fd-849d-6ca8e1ca9b5a None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:29.801978 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f7af2-81a4-45d9-bf84-7432d384ab30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:29.802962 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f7af2-81a4-45d9-bf84-7432d384ab30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:29.803249 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f7af2-81a4-45d9-bf84-7432d384ab30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:29.803526 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f7af2-81a4-45d9-bf84-7432d384ab30 admin admin] PATH_INFO: `/v3/projects/db93b02982974b29926f3f17127adec8` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:29.805027 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f7af2-81a4-45d9-bf84-7432d384ab30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db93b02982974b29926f3f17127adec8)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:29.808133 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f7af2-81a4-45d9-bf84-7432d384ab30 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:29.859718 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:29.862805 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-333f7af2-81a4-45d9-bf84-7432d384ab30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db93b02982974b29926f3f17127adec8', 'request_id': 'req-333f7af2-81a4-45d9-bf84-7432d384ab30'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:29.872767 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-333f7af2-81a4-45d9-bf84-7432d384ab30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db93b02982974b29926f3f17127adec8', 'request_id': 'req-333f7af2-81a4-45d9-bf84-7432d384ab30'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:29.883127 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-333f7af2-81a4-45d9-bf84-7432d384ab30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db93b02982974b29926f3f17127adec8', 'request_id': 'req-333f7af2-81a4-45d9-bf84-7432d384ab30'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:29.898275 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-333f7af2-81a4-45d9-bf84-7432d384ab30 admin admin] The token cache is being invalidate because project db93b02982974b29926f3f17127adec8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:34:29.898541 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-333f7af2-81a4-45d9-bf84-7432d384ab30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:29.899252 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-333f7af2-81a4-45d9-bf84-7432d384ab30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:29.900855 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1396/2770] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:34:29 2022] DELETE /identity/v3/projects/db93b02982974b29926f3f17127adec8 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:34:29.905975 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba03dd9-b701-4f9a-9547-565e1ca51269 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:29.906258 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba03dd9-b701-4f9a-9547-565e1ca51269 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:29.906515 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba03dd9-b701-4f9a-9547-565e1ca51269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:29.927566 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-3ba03dd9-b701-4f9a-9547-565e1ca51269 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:34:29.928895 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-3ba03dd9-b701-4f9a-9547-565e1ca51269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:29.991685 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1375/2771] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:34:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:34:30.000285 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102bada-524a-4fda-9463-da8fa07f40c1 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:30.000610 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102bada-524a-4fda-9463-da8fa07f40c1 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:30.000894 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102bada-524a-4fda-9463-da8fa07f40c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:30.023301 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-a102bada-524a-4fda-9463-da8fa07f40c1 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:34:30.024702 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a102bada-524a-4fda-9463-da8fa07f40c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:30.033138 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1397/2772] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:34:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:34:30.037556 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba03dd9-b701-4f9a-9547-565e1ca51269 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:30.047440 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba03dd9-b701-4f9a-9547-565e1ca51269 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:30.054029 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4807626c-def5-4ecb-a242-0bf91bd9eb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:30.054903 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807626c-def5-4ecb-a242-0bf91bd9eb6b admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:30.055022 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807626c-def5-4ecb-a242-0bf91bd9eb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:30.055298 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807626c-def5-4ecb-a242-0bf91bd9eb6b admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:30.056043 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4807626c-def5-4ecb-a242-0bf91bd9eb6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:34:30.056399 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4807626c-def5-4ecb-a242-0bf91bd9eb6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:30.058129 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4807626c-def5-4ecb-a242-0bf91bd9eb6b admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:30.071735 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1376/2773] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:34:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:30.077195 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a102bada-524a-4fda-9463-da8fa07f40c1 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:30.086726 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a102bada-524a-4fda-9463-da8fa07f40c1 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:30.091476 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29920f6f-2181-4c88-9aef-b506e1e31a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:30.092086 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29920f6f-2181-4c88-9aef-b506e1e31a71 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:30.092360 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29920f6f-2181-4c88-9aef-b506e1e31a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:30.092639 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29920f6f-2181-4c88-9aef-b506e1e31a71 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:30.093294 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29920f6f-2181-4c88-9aef-b506e1e31a71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:30.095208 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29920f6f-2181-4c88-9aef-b506e1e31a71 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:30.124424 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1398/2774] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:34:30 2022] POST /identity/v3/projects => generated 391 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:34:30.128715 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4807626c-def5-4ecb-a242-0bf91bd9eb6b admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:30.139174 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4807626c-def5-4ecb-a242-0bf91bd9eb6b admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:30.195794 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4129a3-49c7-4320-ad36-f3bc9443399c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:30.196898 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4129a3-49c7-4320-ad36-f3bc9443399c admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:30.196898 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4129a3-49c7-4320-ad36-f3bc9443399c admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:30.197238 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4129a3-49c7-4320-ad36-f3bc9443399c admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:30.197566 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4129a3-49c7-4320-ad36-f3bc9443399c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:30.199542 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4129a3-49c7-4320-ad36-f3bc9443399c admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:30.222942 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1377/2775] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:34:30 2022] POST /identity/v3/users => generated 296 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:34:30.227203 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29920f6f-2181-4c88-9aef-b506e1e31a71 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:30.238082 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29920f6f-2181-4c88-9aef-b506e1e31a71 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:30.244701 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89506c3a-7268-4992-afa3-389bd2d905aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:30.245306 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89506c3a-7268-4992-afa3-389bd2d905aa admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:30.245586 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89506c3a-7268-4992-afa3-389bd2d905aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:30.245878 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89506c3a-7268-4992-afa3-389bd2d905aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:30.246529 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89506c3a-7268-4992-afa3-389bd2d905aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:30.248133 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89506c3a-7268-4992-afa3-389bd2d905aa admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:30.260640 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1399/2776] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:34:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:34:30.264810 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4129a3-49c7-4320-ad36-f3bc9443399c admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:30.275718 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4129a3-49c7-4320-ad36-f3bc9443399c admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:30.281627 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a25215-a8ee-41cb-942d-5a9487ff436d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:30.282236 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a25215-a8ee-41cb-942d-5a9487ff436d admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:30.282517 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a25215-a8ee-41cb-942d-5a9487ff436d admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:30.282789 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a25215-a8ee-41cb-942d-5a9487ff436d admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:30.283437 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a25215-a8ee-41cb-942d-5a9487ff436d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:30.285093 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a25215-a8ee-41cb-942d-5a9487ff436d admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:30.296246 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1378/2777] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:34:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:34:30.301180 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89506c3a-7268-4992-afa3-389bd2d905aa admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:30.313208 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89506c3a-7268-4992-afa3-389bd2d905aa admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:30.319605 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c986fc0d-788d-4b0b-95c2-8fbc7229fcfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:30.320319 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986fc0d-788d-4b0b-95c2-8fbc7229fcfb admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:30.320597 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986fc0d-788d-4b0b-95c2-8fbc7229fcfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:30.320894 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986fc0d-788d-4b0b-95c2-8fbc7229fcfb admin admin] PATH_INFO: `/v3/projects/c10180e4c57f4847b8e68db428f025d9/users/084c4191860e41ae9823dd992a0b70a1/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:30.337256 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c986fc0d-788d-4b0b-95c2-8fbc7229fcfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c10180e4c57f4847b8e68db428f025d9, user_id=084c4191860e41ae9823dd992a0b70a1, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:30.339929 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c986fc0d-788d-4b0b-95c2-8fbc7229fcfb admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:30.355505 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1400/2778] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:34:30 2022] PUT /identity/v3/projects/c10180e4c57f4847b8e68db428f025d9/users/084c4191860e41ae9823dd992a0b70a1/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:34:30.366366 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958c3be-8d24-4f42-a6f1-a3575a6a044d None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:30.366651 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958c3be-8d24-4f42-a6f1-a3575a6a044d None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:30.366919 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958c3be-8d24-4f42-a6f1-a3575a6a044d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:30.385127 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:30.401493 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-7958c3be-8d24-4f42-a6f1-a3575a6a044d None None] MFA Rules not processed for user `084c4191860e41ae9823dd992a0b70a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:34:30.402740 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7958c3be-8d24-4f42-a6f1-a3575a6a044d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:30.475223 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1379/2779] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:34:30 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:34:30.486577 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c986fc0d-788d-4b0b-95c2-8fbc7229fcfb admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:30.489151 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c986fc0d-788d-4b0b-95c2-8fbc7229fcfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:30.550241 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c986fc0d-788d-4b0b-95c2-8fbc7229fcfb admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:30.554244 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed77ae9c-c249-4ca0-b9ee-39c33bb05729 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:30.554859 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed77ae9c-c249-4ca0-b9ee-39c33bb05729 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:30.555265 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed77ae9c-c249-4ca0-b9ee-39c33bb05729 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:30.555547 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed77ae9c-c249-4ca0-b9ee-39c33bb05729 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:30.565230 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed77ae9c-c249-4ca0-b9ee-39c33bb05729 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:30.566669 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed77ae9c-c249-4ca0-b9ee-39c33bb05729 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:30.576051 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1401/2780] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:34:30 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:34:40.285630 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b58540-dda8-4369-a07d-09fddebffb0a None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:40.286165 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b58540-dda8-4369-a07d-09fddebffb0a None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:40.286273 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b58540-dda8-4369-a07d-09fddebffb0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:40.307392 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-d6b58540-dda8-4369-a07d-09fddebffb0a None None] MFA Rules not processed for user `b32922d090564162810dd8b28c3a322b`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:34:40.308633 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d6b58540-dda8-4369-a07d-09fddebffb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:40.367678 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1380/2781] 10.222.0.36 () {58 vars in 1009 bytes} [Mon Aug 29 22:34:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:34:40.382650 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed77ae9c-c249-4ca0-b9ee-39c33bb05729 service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:40.384814 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-ed77ae9c-c249-4ca0-b9ee-39c33bb05729 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:40.474839 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed77ae9c-c249-4ca0-b9ee-39c33bb05729 service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:40.482583 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3f446-93f6-4880-8c5d-1ecc62c2db2b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3472d8ffa748d8828c6a2d89ee7ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:40.483230 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3f446-93f6-4880-8c5d-1ecc62c2db2b service swift] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:40.483518 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3f446-93f6-4880-8c5d-1ecc62c2db2b service swift] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:40.483798 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3f446-93f6-4880-8c5d-1ecc62c2db2b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:40.494477 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f3f446-93f6-4880-8c5d-1ecc62c2db2b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:40.497292 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f3f446-93f6-4880-8c5d-1ecc62c2db2b service swift] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:40.506509 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1402/2782] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Aug 29 22:34:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 22:34:40.935788 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b58540-dda8-4369-a07d-09fddebffb0a None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:41.015227 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b58540-dda8-4369-a07d-09fddebffb0a None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:41.020649 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3b0703-46a4-44c3-947a-82bbf346dc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:41.021589 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b0703-46a4-44c3-947a-82bbf346dc68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:41.022024 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b0703-46a4-44c3-947a-82bbf346dc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:41.022468 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b0703-46a4-44c3-947a-82bbf346dc68 admin admin] PATH_INFO: `/v3/users/084c4191860e41ae9823dd992a0b70a1` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:41.024600 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3b0703-46a4-44c3-947a-82bbf346dc68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=084c4191860e41ae9823dd992a0b70a1)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:41.027262 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3b0703-46a4-44c3-947a-82bbf346dc68 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:41.080713 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:41.086313 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-6e3b0703-46a4-44c3-947a-82bbf346dc68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '084c4191860e41ae9823dd992a0b70a1'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:41.097180 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-6e3b0703-46a4-44c3-947a-82bbf346dc68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '084c4191860e41ae9823dd992a0b70a1'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:41.098105 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-6e3b0703-46a4-44c3-947a-82bbf346dc68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '084c4191860e41ae9823dd992a0b70a1'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:41.110753 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-6e3b0703-46a4-44c3-947a-82bbf346dc68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '084c4191860e41ae9823dd992a0b70a1'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:41.111492 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-6e3b0703-46a4-44c3-947a-82bbf346dc68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '084c4191860e41ae9823dd992a0b70a1'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:41.133436 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1381/2783] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:34:40 2022] DELETE /identity/v3/users/084c4191860e41ae9823dd992a0b70a1 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:34:41.138559 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592368b-0579-4dcd-a97c-c7c1b88043af None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:41.138929 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592368b-0579-4dcd-a97c-c7c1b88043af None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:41.139331 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592368b-0579-4dcd-a97c-c7c1b88043af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:41.146979 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:41.163208 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-c592368b-0579-4dcd-a97c-c7c1b88043af None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:34:41.164604 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c592368b-0579-4dcd-a97c-c7c1b88043af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:41.236960 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1403/2784] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:34:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:34:41.246749 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3b0703-46a4-44c3-947a-82bbf346dc68 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:41.248913 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-6e3b0703-46a4-44c3-947a-82bbf346dc68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:41.313095 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3b0703-46a4-44c3-947a-82bbf346dc68 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:41.319051 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb01f1-299a-4fdf-ae59-ddc32b5db575 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:41.319875 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb01f1-299a-4fdf-ae59-ddc32b5db575 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:41.320271 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb01f1-299a-4fdf-ae59-ddc32b5db575 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:41.320679 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb01f1-299a-4fdf-ae59-ddc32b5db575 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:41.331968 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb01f1-299a-4fdf-ae59-ddc32b5db575 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:41.333448 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb01f1-299a-4fdf-ae59-ddc32b5db575 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:41.345906 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1382/2785] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:34:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:34:41.652014 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c592368b-0579-4dcd-a97c-c7c1b88043af None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:41.654482 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c592368b-0579-4dcd-a97c-c7c1b88043af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:41.671368 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c592368b-0579-4dcd-a97c-c7c1b88043af None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:41.677865 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e175ac-d8b2-40ae-a43e-1cdf51b9964f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:41.678859 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e175ac-d8b2-40ae-a43e-1cdf51b9964f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:41.679320 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e175ac-d8b2-40ae-a43e-1cdf51b9964f admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:41.680155 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e175ac-d8b2-40ae-a43e-1cdf51b9964f admin admin] PATH_INFO: `/v3/projects/c10180e4c57f4847b8e68db428f025d9` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:41.681618 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e175ac-d8b2-40ae-a43e-1cdf51b9964f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c10180e4c57f4847b8e68db428f025d9)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:41.683873 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e175ac-d8b2-40ae-a43e-1cdf51b9964f admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:41.763947 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-70e175ac-d8b2-40ae-a43e-1cdf51b9964f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c10180e4c57f4847b8e68db428f025d9', 'request_id': 'req-70e175ac-d8b2-40ae-a43e-1cdf51b9964f'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:41.777429 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-70e175ac-d8b2-40ae-a43e-1cdf51b9964f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c10180e4c57f4847b8e68db428f025d9', 'request_id': 'req-70e175ac-d8b2-40ae-a43e-1cdf51b9964f'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:41.790505 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-70e175ac-d8b2-40ae-a43e-1cdf51b9964f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c10180e4c57f4847b8e68db428f025d9', 'request_id': 'req-70e175ac-d8b2-40ae-a43e-1cdf51b9964f'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:41.811401 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-70e175ac-d8b2-40ae-a43e-1cdf51b9964f admin admin] The token cache is being invalidate because project c10180e4c57f4847b8e68db428f025d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:34:41.811784 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-70e175ac-d8b2-40ae-a43e-1cdf51b9964f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:41.813245 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-70e175ac-d8b2-40ae-a43e-1cdf51b9964f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:41.818603 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1404/2786] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:34:41 2022] DELETE /identity/v3/projects/c10180e4c57f4847b8e68db428f025d9 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:34:51.339504 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:DELETE=4,keystone:SELECT=39,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:51.809636 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=53,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:54.985247 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59f0a2-6665-4827-99c2-a17c3c4bdf24 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:54.985769 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59f0a2-6665-4827-99c2-a17c3c4bdf24 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:54.985769 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59f0a2-6665-4827-99c2-a17c3c4bdf24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:55.005842 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-8f59f0a2-6665-4827-99c2-a17c3c4bdf24 None None] MFA Rules not processed for user `b32922d090564162810dd8b28c3a322b`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:34:55.007524 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-8f59f0a2-6665-4827-99c2-a17c3c4bdf24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:55.073828 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1383/2787] 10.222.0.36 () {58 vars in 967 bytes} [Mon Aug 29 22:34:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:34:55.087345 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e175ac-d8b2-40ae-a43e-1cdf51b9964f admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:55.088750 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-70e175ac-d8b2-40ae-a43e-1cdf51b9964f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:55.169445 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e175ac-d8b2-40ae-a43e-1cdf51b9964f admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:55.174592 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f048aa-41cb-4b59-8e70-2324e0e6bd2d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3472d8ffa748d8828c6a2d89ee7ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:55.175234 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f048aa-41cb-4b59-8e70-2324e0e6bd2d service swift] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:55.175508 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f048aa-41cb-4b59-8e70-2324e0e6bd2d service swift] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:55.175772 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f048aa-41cb-4b59-8e70-2324e0e6bd2d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:55.185575 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f048aa-41cb-4b59-8e70-2324e0e6bd2d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:55.187195 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f048aa-41cb-4b59-8e70-2324e0e6bd2d service swift] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:55.195851 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1405/2788] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Aug 29 22:34:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 22:34:57.162209 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f59f0a2-6665-4827-99c2-a17c3c4bdf24 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:57.163840 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-8f59f0a2-6665-4827-99c2-a17c3c4bdf24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:57.226918 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f048aa-41cb-4b59-8e70-2324e0e6bd2d service swift] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:57.228489 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-12f048aa-41cb-4b59-8e70-2324e0e6bd2d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:57.244917 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f59f0a2-6665-4827-99c2-a17c3c4bdf24 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:57.250940 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e27bc-75df-41c4-8244-d4a05ec026df service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce3d9397cca4ae58e14c8a5ae844f8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:57.251429 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e27bc-75df-41c4-8244-d4a05ec026df service placement] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:57.251709 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e27bc-75df-41c4-8244-d4a05ec026df service placement] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:57.251992 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e27bc-75df-41c4-8244-d4a05ec026df service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:57.254379 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-062e27bc-75df-41c4-8244-d4a05ec026df service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:57.269351 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e27bc-75df-41c4-8244-d4a05ec026df service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:57.271171 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e27bc-75df-41c4-8244-d4a05ec026df service placement] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:57.284696 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1384/2789] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:34:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:34:57.326367 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f048aa-41cb-4b59-8e70-2324e0e6bd2d service swift] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:57.331236 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ef512-6a2b-4124-baee-819a82a6ad47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:57.331973 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ef512-6a2b-4124-baee-819a82a6ad47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:57.332147 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ef512-6a2b-4124-baee-819a82a6ad47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:57.332420 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ef512-6a2b-4124-baee-819a82a6ad47 admin admin] PATH_INFO: `/v3/users/06e025cf8a9b435c8807d9f767ef95c7` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:57.336025 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863ef512-6a2b-4124-baee-819a82a6ad47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06e025cf8a9b435c8807d9f767ef95c7)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:57.336025 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863ef512-6a2b-4124-baee-819a82a6ad47 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:57.389877 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-863ef512-6a2b-4124-baee-819a82a6ad47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06e025cf8a9b435c8807d9f767ef95c7'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:57.401454 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-863ef512-6a2b-4124-baee-819a82a6ad47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06e025cf8a9b435c8807d9f767ef95c7'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:57.409417 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-863ef512-6a2b-4124-baee-819a82a6ad47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06e025cf8a9b435c8807d9f767ef95c7'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:57.410082 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-863ef512-6a2b-4124-baee-819a82a6ad47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06e025cf8a9b435c8807d9f767ef95c7'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:57.425687 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-863ef512-6a2b-4124-baee-819a82a6ad47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06e025cf8a9b435c8807d9f767ef95c7'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:57.434463 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1406/2790] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:34:57 2022] DELETE /identity/v3/users/06e025cf8a9b435c8807d9f767ef95c7 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:34:57.626615 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e27bc-75df-41c4-8244-d4a05ec026df service placement] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:57.638653 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e27bc-75df-41c4-8244-d4a05ec026df service placement] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:57.699758 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451155ff-9a5c-42ee-b4fd-13cc38cb2221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:57.700652 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451155ff-9a5c-42ee-b4fd-13cc38cb2221 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:57.701074 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451155ff-9a5c-42ee-b4fd-13cc38cb2221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:57.701367 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451155ff-9a5c-42ee-b4fd-13cc38cb2221 admin admin] PATH_INFO: `/v3/projects/56cc5bd2a0b34e67a49758c5bcb1fe16` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:57.702557 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451155ff-9a5c-42ee-b4fd-13cc38cb2221 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56cc5bd2a0b34e67a49758c5bcb1fe16)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:57.704553 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451155ff-9a5c-42ee-b4fd-13cc38cb2221 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:57.749080 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:57.760032 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-451155ff-9a5c-42ee-b4fd-13cc38cb2221 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56cc5bd2a0b34e67a49758c5bcb1fe16', 'request_id': 'req-451155ff-9a5c-42ee-b4fd-13cc38cb2221'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:57.766556 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-451155ff-9a5c-42ee-b4fd-13cc38cb2221 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56cc5bd2a0b34e67a49758c5bcb1fe16', 'request_id': 'req-451155ff-9a5c-42ee-b4fd-13cc38cb2221'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:57.775523 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-451155ff-9a5c-42ee-b4fd-13cc38cb2221 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56cc5bd2a0b34e67a49758c5bcb1fe16', 'request_id': 'req-451155ff-9a5c-42ee-b4fd-13cc38cb2221'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:57.787940 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-451155ff-9a5c-42ee-b4fd-13cc38cb2221 admin admin] The token cache is being invalidate because project 56cc5bd2a0b34e67a49758c5bcb1fe16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:34:57.788233 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-451155ff-9a5c-42ee-b4fd-13cc38cb2221 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:57.788914 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-451155ff-9a5c-42ee-b4fd-13cc38cb2221 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:57.790485 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1385/2791] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:34:57 2022] DELETE /identity/v3/projects/56cc5bd2a0b34e67a49758c5bcb1fe16 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:34:57.796080 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315b326-e9c2-426f-ae2f-4462b77555d3 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:57.796366 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315b326-e9c2-426f-ae2f-4462b77555d3 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:57.796690 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315b326-e9c2-426f-ae2f-4462b77555d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:57.818603 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-5315b326-e9c2-426f-ae2f-4462b77555d3 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:34:57.819870 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-5315b326-e9c2-426f-ae2f-4462b77555d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:57.824993 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:57.888825 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1407/2792] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:34:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:34:57.896851 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab35932-1d28-4793-99d8-a350ec14b1bf None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:57.897152 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab35932-1d28-4793-99d8-a350ec14b1bf None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:57.897430 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab35932-1d28-4793-99d8-a350ec14b1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:57.918750 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-fab35932-1d28-4793-99d8-a350ec14b1bf None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:34:57.920196 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-fab35932-1d28-4793-99d8-a350ec14b1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:57.933294 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1386/2793] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:34:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:34:57.937865 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5315b326-e9c2-426f-ae2f-4462b77555d3 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:57.948685 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5315b326-e9c2-426f-ae2f-4462b77555d3 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:57.954573 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6814cb2d-814f-4d7d-971e-1935f189b78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:57.955125 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814cb2d-814f-4d7d-971e-1935f189b78d admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:57.955402 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814cb2d-814f-4d7d-971e-1935f189b78d admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:57.955662 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814cb2d-814f-4d7d-971e-1935f189b78d admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:57.956331 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6814cb2d-814f-4d7d-971e-1935f189b78d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:34:57.956666 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6814cb2d-814f-4d7d-971e-1935f189b78d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:57.958308 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6814cb2d-814f-4d7d-971e-1935f189b78d admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:57.972813 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1408/2794] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:34:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:57.977818 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab35932-1d28-4793-99d8-a350ec14b1bf None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:57.989640 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab35932-1d28-4793-99d8-a350ec14b1bf None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:57.995065 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c880b0-d55d-4029-9dab-e068423bb7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:57.995767 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c880b0-d55d-4029-9dab-e068423bb7e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:57.996118 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c880b0-d55d-4029-9dab-e068423bb7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:57.996433 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c880b0-d55d-4029-9dab-e068423bb7e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:57.997477 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c880b0-d55d-4029-9dab-e068423bb7e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:57.999257 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c880b0-d55d-4029-9dab-e068423bb7e1 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:58.035358 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1387/2795] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:34:57 2022] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:34:58.041438 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6814cb2d-814f-4d7d-971e-1935f189b78d admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:58.052895 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6814cb2d-814f-4d7d-971e-1935f189b78d admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:58.112130 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d7b4e3-ccbc-4eb1-a8a7-976497471d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:58.112774 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d7b4e3-ccbc-4eb1-a8a7-976497471d7e admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:58.113051 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d7b4e3-ccbc-4eb1-a8a7-976497471d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:58.113319 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d7b4e3-ccbc-4eb1-a8a7-976497471d7e admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:58.113929 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d7b4e3-ccbc-4eb1-a8a7-976497471d7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:58.115837 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d7b4e3-ccbc-4eb1-a8a7-976497471d7e admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:58.139979 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1409/2796] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:34:58 2022] POST /identity/v3/users => generated 286 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:34:58.144290 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c880b0-d55d-4029-9dab-e068423bb7e1 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:58.155158 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c880b0-d55d-4029-9dab-e068423bb7e1 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:58.161936 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e420d827-4a92-4235-9f9f-bf6d07a52411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:58.162856 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420d827-4a92-4235-9f9f-bf6d07a52411 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:58.163505 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420d827-4a92-4235-9f9f-bf6d07a52411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:58.163505 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420d827-4a92-4235-9f9f-bf6d07a52411 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:58.164348 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e420d827-4a92-4235-9f9f-bf6d07a52411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:58.166576 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e420d827-4a92-4235-9f9f-bf6d07a52411 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:58.178567 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1388/2797] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:34:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:34:58.182692 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d7b4e3-ccbc-4eb1-a8a7-976497471d7e admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:58.194054 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d7b4e3-ccbc-4eb1-a8a7-976497471d7e admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:58.201529 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3836053-92c6-4460-bb0d-73361c69133d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:58.202140 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3836053-92c6-4460-bb0d-73361c69133d admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:58.202425 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3836053-92c6-4460-bb0d-73361c69133d admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:58.202696 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3836053-92c6-4460-bb0d-73361c69133d admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:58.203340 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3836053-92c6-4460-bb0d-73361c69133d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:58.205091 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3836053-92c6-4460-bb0d-73361c69133d admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:58.216947 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1410/2798] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:34:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:34:58.221941 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e420d827-4a92-4235-9f9f-bf6d07a52411 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:58.236228 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e420d827-4a92-4235-9f9f-bf6d07a52411 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:58.242350 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4a615e-2fd7-45d7-9102-9619470c79fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:58.243036 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a615e-2fd7-45d7-9102-9619470c79fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:58.243354 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a615e-2fd7-45d7-9102-9619470c79fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:58.243622 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a615e-2fd7-45d7-9102-9619470c79fc admin admin] PATH_INFO: `/v3/projects/5709565b1cc04e56b9b23fae8d549614/users/825b16e1c9764d849ff3d3ca4f05ae3b/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:58.261224 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4a615e-2fd7-45d7-9102-9619470c79fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5709565b1cc04e56b9b23fae8d549614, user_id=825b16e1c9764d849ff3d3ca4f05ae3b, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:58.264300 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4a615e-2fd7-45d7-9102-9619470c79fc admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:58.281285 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1389/2799] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:34:58 2022] PUT /identity/v3/projects/5709565b1cc04e56b9b23fae8d549614/users/825b16e1c9764d849ff3d3ca4f05ae3b/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:34:58.295047 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3836053-92c6-4460-bb0d-73361c69133d admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:58.297062 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c3836053-92c6-4460-bb0d-73361c69133d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:58.297301 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c2964-50b0-46f5-8bad-da3ff99ab0e8 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:58.297718 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c2964-50b0-46f5-8bad-da3ff99ab0e8 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:58.297997 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c2964-50b0-46f5-8bad-da3ff99ab0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:58.328793 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-d77c2964-50b0-46f5-8bad-da3ff99ab0e8 None None] MFA Rules not processed for user `825b16e1c9764d849ff3d3ca4f05ae3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:34:58.330026 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d77c2964-50b0-46f5-8bad-da3ff99ab0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:58.358701 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3836053-92c6-4460-bb0d-73361c69133d admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:58.392763 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:58.408377 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1390/2800] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:34:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:34:58.416276 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48802698-ea8f-4758-a31b-9fd95c66da0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:58.417290 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48802698-ea8f-4758-a31b-9fd95c66da0f service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:58.417290 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48802698-ea8f-4758-a31b-9fd95c66da0f service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:58.419391 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48802698-ea8f-4758-a31b-9fd95c66da0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:58.419485 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-48802698-ea8f-4758-a31b-9fd95c66da0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:58.421330 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c2964-50b0-46f5-8bad-da3ff99ab0e8 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:58.425533 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d77c2964-50b0-46f5-8bad-da3ff99ab0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:58.495671 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48802698-ea8f-4758-a31b-9fd95c66da0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:58.497157 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48802698-ea8f-4758-a31b-9fd95c66da0f service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:58.501573 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c2964-50b0-46f5-8bad-da3ff99ab0e8 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:58.505459 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ace4d-1fb1-4bd2-a18d-1b00d79c832a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:58.506109 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ace4d-1fb1-4bd2-a18d-1b00d79c832a service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:58.506376 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ace4d-1fb1-4bd2-a18d-1b00d79c832a service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:58.506649 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ace4d-1fb1-4bd2-a18d-1b00d79c832a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:58.508600 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1411/2801] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:34:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:34:58.520066 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:58.526534 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903ace4d-1fb1-4bd2-a18d-1b00d79c832a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:58.528357 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903ace4d-1fb1-4bd2-a18d-1b00d79c832a service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:58.546898 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1391/2802] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:34:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:34:58.576310 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48802698-ea8f-4758-a31b-9fd95c66da0f service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:58.595765 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ace4d-1fb1-4bd2-a18d-1b00d79c832a service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:58.597250 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-903ace4d-1fb1-4bd2-a18d-1b00d79c832a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:58.611012 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ace4d-1fb1-4bd2-a18d-1b00d79c832a service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:58.617703 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc217d8-5165-4fc4-a3fc-f32ac3edd9b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:58.619246 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc217d8-5165-4fc4-a3fc-f32ac3edd9b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:58.619739 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc217d8-5165-4fc4-a3fc-f32ac3edd9b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:58.620011 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc217d8-5165-4fc4-a3fc-f32ac3edd9b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:58.624003 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-2bc217d8-5165-4fc4-a3fc-f32ac3edd9b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:58.679739 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48802698-ea8f-4758-a31b-9fd95c66da0f service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:58.684923 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6b976-6b10-4909-a456-2f175cac18fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:58.685580 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6b976-6b10-4909-a456-2f175cac18fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:58.686346 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6b976-6b10-4909-a456-2f175cac18fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:58.686346 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6b976-6b10-4909-a456-2f175cac18fd admin admin] PATH_INFO: `/v3/users/825b16e1c9764d849ff3d3ca4f05ae3b` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:58.687970 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e6b976-6b10-4909-a456-2f175cac18fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=825b16e1c9764d849ff3d3ca4f05ae3b)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:58.691555 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e6b976-6b10-4909-a456-2f175cac18fd admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:58.716974 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc217d8-5165-4fc4-a3fc-f32ac3edd9b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:58.718484 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc217d8-5165-4fc4-a3fc-f32ac3edd9b7 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:58.729182 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1392/2803] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:34:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:34:58.750706 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-53e6b976-6b10-4909-a456-2f175cac18fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '825b16e1c9764d849ff3d3ca4f05ae3b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:58.761087 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-53e6b976-6b10-4909-a456-2f175cac18fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '825b16e1c9764d849ff3d3ca4f05ae3b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:58.770380 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-53e6b976-6b10-4909-a456-2f175cac18fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '825b16e1c9764d849ff3d3ca4f05ae3b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:58.771436 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-53e6b976-6b10-4909-a456-2f175cac18fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '825b16e1c9764d849ff3d3ca4f05ae3b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:58.787700 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-53e6b976-6b10-4909-a456-2f175cac18fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '825b16e1c9764d849ff3d3ca4f05ae3b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:34:58.796950 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1412/2804] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:34:58 2022] DELETE /identity/v3/users/825b16e1c9764d849ff3d3ca4f05ae3b => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:34:58.801324 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b74398-eeda-4ba1-8992-5978d2575d48 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:58.802043 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b74398-eeda-4ba1-8992-5978d2575d48 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:58.802386 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b74398-eeda-4ba1-8992-5978d2575d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:58.824894 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-c2b74398-eeda-4ba1-8992-5978d2575d48 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:34:58.826631 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c2b74398-eeda-4ba1-8992-5978d2575d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:58.926147 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1393/2805] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:34:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:34:58.936753 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6b976-6b10-4909-a456-2f175cac18fd admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:58.938307 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-53e6b976-6b10-4909-a456-2f175cac18fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:58.946489 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:59.038092 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6b976-6b10-4909-a456-2f175cac18fd admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:59.043739 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa7c3d-a36f-4cf7-a216-43b9c1fb5d71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:59.044559 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa7c3d-a36f-4cf7-a216-43b9c1fb5d71 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:59.044955 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa7c3d-a36f-4cf7-a216-43b9c1fb5d71 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:59.045601 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa7c3d-a36f-4cf7-a216-43b9c1fb5d71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:59.056577 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fa7c3d-a36f-4cf7-a216-43b9c1fb5d71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:59.059455 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fa7c3d-a36f-4cf7-a216-43b9c1fb5d71 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:59.073023 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1413/2806] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:34:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:34:59.901077 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b74398-eeda-4ba1-8992-5978d2575d48 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:59.902280 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c2b74398-eeda-4ba1-8992-5978d2575d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:59.992157 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa7c3d-a36f-4cf7-a216-43b9c1fb5d71 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:59.995020 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-27fa7c3d-a36f-4cf7-a216-43b9c1fb5d71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:35:00.014780 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa7c3d-a36f-4cf7-a216-43b9c1fb5d71 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:00.021763 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37ca787-8840-4159-baae-b529cdab1f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:00.023279 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ca787-8840-4159-baae-b529cdab1f2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:00.023730 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ca787-8840-4159-baae-b529cdab1f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:00.024396 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ca787-8840-4159-baae-b529cdab1f2e admin admin] PATH_INFO: `/v3/projects/5709565b1cc04e56b9b23fae8d549614` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:00.026376 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37ca787-8840-4159-baae-b529cdab1f2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5709565b1cc04e56b9b23fae8d549614)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:00.030554 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37ca787-8840-4159-baae-b529cdab1f2e admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:00.047888 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b74398-eeda-4ba1-8992-5978d2575d48 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:00.075299 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f9700-b6a7-4609-bb83-22308c00fbba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b7213b7111456a93e294ce40b95b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:00.075986 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f9700-b6a7-4609-bb83-22308c00fbba service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:00.076270 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f9700-b6a7-4609-bb83-22308c00fbba service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:00.076750 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f9700-b6a7-4609-bb83-22308c00fbba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:00.080636 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ec5f9700-b6a7-4609-bb83-22308c00fbba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:35:00.136569 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5f9700-b6a7-4609-bb83-22308c00fbba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:00.136839 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5f9700-b6a7-4609-bb83-22308c00fbba service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:00.170832 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1394/2807] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:34:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:35:00.246823 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a37ca787-8840-4159-baae-b529cdab1f2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5709565b1cc04e56b9b23fae8d549614', 'request_id': 'req-a37ca787-8840-4159-baae-b529cdab1f2e'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:35:00.269393 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a37ca787-8840-4159-baae-b529cdab1f2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5709565b1cc04e56b9b23fae8d549614', 'request_id': 'req-a37ca787-8840-4159-baae-b529cdab1f2e'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:35:00.299962 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a37ca787-8840-4159-baae-b529cdab1f2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5709565b1cc04e56b9b23fae8d549614', 'request_id': 'req-a37ca787-8840-4159-baae-b529cdab1f2e'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:35:00.325548 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a37ca787-8840-4159-baae-b529cdab1f2e admin admin] The token cache is being invalidate because project 5709565b1cc04e56b9b23fae8d549614 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:35:00.325967 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a37ca787-8840-4159-baae-b529cdab1f2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:35:00.326908 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a37ca787-8840-4159-baae-b529cdab1f2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:35:00.341295 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1414/2808] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:34:59 2022] DELETE /identity/v3/projects/5709565b1cc04e56b9b23fae8d549614 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:35:02.538427 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f9700-b6a7-4609-bb83-22308c00fbba service nova] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:02.540323 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ec5f9700-b6a7-4609-bb83-22308c00fbba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:35:02.565512 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f9700-b6a7-4609-bb83-22308c00fbba service nova] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:02.578595 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:02.643751 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d5ae0f-e692-4f3d-8831-825a2e52d7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:02.644545 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5ae0f-e692-4f3d-8831-825a2e52d7f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:02.644742 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5ae0f-e692-4f3d-8831-825a2e52d7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:02.645038 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5ae0f-e692-4f3d-8831-825a2e52d7f8 admin admin] PATH_INFO: `/v3/users/91fc37814c4f421687ab653f9062da27` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:02.646412 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d5ae0f-e692-4f3d-8831-825a2e52d7f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91fc37814c4f421687ab653f9062da27)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:02.648613 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d5ae0f-e692-4f3d-8831-825a2e52d7f8 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:02.707967 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-85d5ae0f-e692-4f3d-8831-825a2e52d7f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91fc37814c4f421687ab653f9062da27'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:35:02.716890 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-85d5ae0f-e692-4f3d-8831-825a2e52d7f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91fc37814c4f421687ab653f9062da27'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:35:02.718967 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-85d5ae0f-e692-4f3d-8831-825a2e52d7f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91fc37814c4f421687ab653f9062da27'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:35:02.728111 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-85d5ae0f-e692-4f3d-8831-825a2e52d7f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91fc37814c4f421687ab653f9062da27'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:35:02.729116 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-85d5ae0f-e692-4f3d-8831-825a2e52d7f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91fc37814c4f421687ab653f9062da27'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:35:02.759279 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1395/2809] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:35:02 2022] DELETE /identity/v3/users/91fc37814c4f421687ab653f9062da27 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:35:02.967274 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37ca787-8840-4159-baae-b529cdab1f2e admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:02.969313 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a37ca787-8840-4159-baae-b529cdab1f2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:35:02.985223 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37ca787-8840-4159-baae-b529cdab1f2e admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:03.051292 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaaa12b-0e49-4730-b3d2-13a4e7bf0618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:03.052002 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaaa12b-0e49-4730-b3d2-13a4e7bf0618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:03.052282 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaaa12b-0e49-4730-b3d2-13a4e7bf0618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:03.052612 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaaa12b-0e49-4730-b3d2-13a4e7bf0618 admin admin] PATH_INFO: `/v3/projects/01bb002d5b6a4a208f8f380833169c4e` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:03.053796 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaaa12b-0e49-4730-b3d2-13a4e7bf0618 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01bb002d5b6a4a208f8f380833169c4e)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:03.056528 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaaa12b-0e49-4730-b3d2-13a4e7bf0618 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:03.096151 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:03.111448 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9aaaa12b-0e49-4730-b3d2-13a4e7bf0618 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01bb002d5b6a4a208f8f380833169c4e', 'request_id': 'req-9aaaa12b-0e49-4730-b3d2-13a4e7bf0618'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:35:03.119216 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9aaaa12b-0e49-4730-b3d2-13a4e7bf0618 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01bb002d5b6a4a208f8f380833169c4e', 'request_id': 'req-9aaaa12b-0e49-4730-b3d2-13a4e7bf0618'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:35:03.126731 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9aaaa12b-0e49-4730-b3d2-13a4e7bf0618 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01bb002d5b6a4a208f8f380833169c4e', 'request_id': 'req-9aaaa12b-0e49-4730-b3d2-13a4e7bf0618'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:35:03.141358 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9aaaa12b-0e49-4730-b3d2-13a4e7bf0618 admin admin] The token cache is being invalidate because project 01bb002d5b6a4a208f8f380833169c4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:35:03.141649 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9aaaa12b-0e49-4730-b3d2-13a4e7bf0618 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:35:03.142938 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9aaaa12b-0e49-4730-b3d2-13a4e7bf0618 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:35:03.144668 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1415/2810] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:35:02 2022] DELETE /identity/v3/projects/01bb002d5b6a4a208f8f380833169c4e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:35:03.149811 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc056733-79dc-452c-9ae6-ccb1001c1f59 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:03.150082 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc056733-79dc-452c-9ae6-ccb1001c1f59 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:03.150367 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc056733-79dc-452c-9ae6-ccb1001c1f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:03.172141 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-bc056733-79dc-452c-9ae6-ccb1001c1f59 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:35:03.173377 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-bc056733-79dc-452c-9ae6-ccb1001c1f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:35:03.236516 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1396/2811] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:35:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:35:03.245941 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370dbcb-4322-41a2-90b4-7718e3b671c2 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:03.246228 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370dbcb-4322-41a2-90b4-7718e3b671c2 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:03.246499 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370dbcb-4322-41a2-90b4-7718e3b671c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:03.267218 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-2370dbcb-4322-41a2-90b4-7718e3b671c2 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:35:03.268415 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-2370dbcb-4322-41a2-90b4-7718e3b671c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:35:03.277190 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1416/2812] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:35:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:35:03.281890 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc056733-79dc-452c-9ae6-ccb1001c1f59 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:03.291942 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc056733-79dc-452c-9ae6-ccb1001c1f59 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:03.298277 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308616ba-1a45-4f67-9734-0d74828f0ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:03.298878 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308616ba-1a45-4f67-9734-0d74828f0ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:03.299157 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308616ba-1a45-4f67-9734-0d74828f0ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:03.299421 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308616ba-1a45-4f67-9734-0d74828f0ee4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:03.300064 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308616ba-1a45-4f67-9734-0d74828f0ee4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:35:03.300364 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308616ba-1a45-4f67-9734-0d74828f0ee4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:03.302040 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308616ba-1a45-4f67-9734-0d74828f0ee4 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:03.314583 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1397/2813] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:35:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:35:03.319410 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2370dbcb-4322-41a2-90b4-7718e3b671c2 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:03.329150 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2370dbcb-4322-41a2-90b4-7718e3b671c2 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:03.334189 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04366e-33c0-482c-95f1-1a631a202f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:03.334805 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04366e-33c0-482c-95f1-1a631a202f5a admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:03.335081 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04366e-33c0-482c-95f1-1a631a202f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:03.335490 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04366e-33c0-482c-95f1-1a631a202f5a admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:03.335998 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d04366e-33c0-482c-95f1-1a631a202f5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:03.337945 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d04366e-33c0-482c-95f1-1a631a202f5a admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:03.369168 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1417/2814] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:35:03 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:35:03.373282 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308616ba-1a45-4f67-9734-0d74828f0ee4 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:03.384034 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308616ba-1a45-4f67-9734-0d74828f0ee4 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:03.402276 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:03.446134 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f525268-c3c4-4395-9048-cb48872d7e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:03.446763 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f525268-c3c4-4395-9048-cb48872d7e8e admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:03.447044 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f525268-c3c4-4395-9048-cb48872d7e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:03.447319 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f525268-c3c4-4395-9048-cb48872d7e8e admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:03.447983 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f525268-c3c4-4395-9048-cb48872d7e8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:03.450009 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f525268-c3c4-4395-9048-cb48872d7e8e admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:03.475005 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1398/2815] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:35:03 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:35:03.480611 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04366e-33c0-482c-95f1-1a631a202f5a admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:03.491808 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04366e-33c0-482c-95f1-1a631a202f5a admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:03.497270 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e294c-6c8f-4503-920b-babe95839e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:03.497910 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e294c-6c8f-4503-920b-babe95839e6a admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:03.498192 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e294c-6c8f-4503-920b-babe95839e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:03.498653 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e294c-6c8f-4503-920b-babe95839e6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:03.499371 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66e294c-6c8f-4503-920b-babe95839e6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:03.501136 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66e294c-6c8f-4503-920b-babe95839e6a admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:03.512939 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1418/2816] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:35:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:35:03.517868 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f525268-c3c4-4395-9048-cb48872d7e8e admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:03.528284 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f525268-c3c4-4395-9048-cb48872d7e8e admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:03.533938 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd54cda-78b2-4cd6-9320-ac2692261a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:03.534540 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd54cda-78b2-4cd6-9320-ac2692261a92 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:03.534854 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd54cda-78b2-4cd6-9320-ac2692261a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:03.535127 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd54cda-78b2-4cd6-9320-ac2692261a92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:03.535780 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd54cda-78b2-4cd6-9320-ac2692261a92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:03.537463 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd54cda-78b2-4cd6-9320-ac2692261a92 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:03.549000 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1399/2817] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:35:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:35:03.553274 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e294c-6c8f-4503-920b-babe95839e6a admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:03.564032 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e294c-6c8f-4503-920b-babe95839e6a admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:03.569575 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abdce0d-5f69-469f-af35-b02238c8ba63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:03.570240 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abdce0d-5f69-469f-af35-b02238c8ba63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:03.570523 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abdce0d-5f69-469f-af35-b02238c8ba63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:03.570797 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abdce0d-5f69-469f-af35-b02238c8ba63 admin admin] PATH_INFO: `/v3/projects/6848f7bf36994bcf99cbb061bfbdbd23/users/808097b77fed4f08b443cc11fe73570f/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:03.586677 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abdce0d-5f69-469f-af35-b02238c8ba63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6848f7bf36994bcf99cbb061bfbdbd23, user_id=808097b77fed4f08b443cc11fe73570f, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:03.589400 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abdce0d-5f69-469f-af35-b02238c8ba63 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:03.604852 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1419/2818] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:35:03 2022] PUT /identity/v3/projects/6848f7bf36994bcf99cbb061bfbdbd23/users/808097b77fed4f08b443cc11fe73570f/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:35:03.610731 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196681c1-6af3-4b97-923e-6067a8a4cef7 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:03.611016 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196681c1-6af3-4b97-923e-6067a8a4cef7 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:03.611292 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196681c1-6af3-4b97-923e-6067a8a4cef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:03.632728 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-196681c1-6af3-4b97-923e-6067a8a4cef7 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:35:03.633919 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-196681c1-6af3-4b97-923e-6067a8a4cef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:35:03.704859 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1400/2819] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:35:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:35:03.715053 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abdce0d-5f69-469f-af35-b02238c8ba63 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:03.718325 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3abdce0d-5f69-469f-af35-b02238c8ba63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:35:03.792684 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abdce0d-5f69-469f-af35-b02238c8ba63 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:03.799515 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56896168-482d-4aa5-a7b6-be4218111cf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:03.800398 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56896168-482d-4aa5-a7b6-be4218111cf2 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:03.800796 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56896168-482d-4aa5-a7b6-be4218111cf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:03.801153 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56896168-482d-4aa5-a7b6-be4218111cf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:03.815149 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56896168-482d-4aa5-a7b6-be4218111cf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:03.816660 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56896168-482d-4aa5-a7b6-be4218111cf2 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:03.827816 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1420/2820] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:35:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:35:04.206867 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196681c1-6af3-4b97-923e-6067a8a4cef7 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:04.222831 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196681c1-6af3-4b97-923e-6067a8a4cef7 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:04.227475 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceb052c-dfc4-4226-a7c0-ccc476d3a5d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:04.228157 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb052c-dfc4-4226-a7c0-ccc476d3a5d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:04.228607 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb052c-dfc4-4226-a7c0-ccc476d3a5d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:04.228877 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb052c-dfc4-4226-a7c0-ccc476d3a5d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:04.230926 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-bceb052c-dfc4-4226-a7c0-ccc476d3a5d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:35:04.247772 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceb052c-dfc4-4226-a7c0-ccc476d3a5d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:04.250575 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceb052c-dfc4-4226-a7c0-ccc476d3a5d7 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:04.276819 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1401/2821] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:35:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:35:09.248945 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb4ce8a-a365-437c-8afe-de5530bf83b2 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:09.249584 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb4ce8a-a365-437c-8afe-de5530bf83b2 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:09.249584 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb4ce8a-a365-437c-8afe-de5530bf83b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:09.281740 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-abb4ce8a-a365-437c-8afe-de5530bf83b2 None None] MFA Rules not processed for user `808097b77fed4f08b443cc11fe73570f`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:35:09.282974 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-abb4ce8a-a365-437c-8afe-de5530bf83b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:35:09.337279 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:09.366090 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1421/2822] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:35:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:35:09.385309 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceb052c-dfc4-4226-a7c0-ccc476d3a5d7 service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:09.386866 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-bceb052c-dfc4-4226-a7c0-ccc476d3a5d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:35:09.473808 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceb052c-dfc4-4226-a7c0-ccc476d3a5d7 service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:09.480392 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35866849-5661-4f50-841b-2f70efe03e1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b7213b7111456a93e294ce40b95b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:09.481054 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35866849-5661-4f50-841b-2f70efe03e1a service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:09.481397 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35866849-5661-4f50-841b-2f70efe03e1a service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:09.481674 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35866849-5661-4f50-841b-2f70efe03e1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:09.492412 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35866849-5661-4f50-841b-2f70efe03e1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:09.494065 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35866849-5661-4f50-841b-2f70efe03e1a service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:09.506101 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1402/2823] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:35:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:35:11.135174 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82dfd2-ac6f-4c5d-94a7-3e134d7beafc None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:11.138506 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82dfd2-ac6f-4c5d-94a7-3e134d7beafc None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:11.138804 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82dfd2-ac6f-4c5d-94a7-3e134d7beafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:11.159424 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-ae82dfd2-ac6f-4c5d-94a7-3e134d7beafc None None] MFA Rules not processed for user `808097b77fed4f08b443cc11fe73570f`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:35:11.160659 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-ae82dfd2-ac6f-4c5d-94a7-3e134d7beafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:35:11.174858 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1422/2824] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:35:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:35:12.778168 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35866849-5661-4f50-841b-2f70efe03e1a service nova] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:12.780103 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-35866849-5661-4f50-841b-2f70efe03e1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:35:12.802489 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35866849-5661-4f50-841b-2f70efe03e1a service nova] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:12.808302 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56a793-e8b3-4479-8e08-2304351cac63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:12.809020 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56a793-e8b3-4479-8e08-2304351cac63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:12.809304 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56a793-e8b3-4479-8e08-2304351cac63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:12.809734 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56a793-e8b3-4479-8e08-2304351cac63 admin admin] PATH_INFO: `/v3/users/a54596c94fd04ea2b4ec217166292973` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:12.811003 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d56a793-e8b3-4479-8e08-2304351cac63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a54596c94fd04ea2b4ec217166292973)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:12.813158 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d56a793-e8b3-4479-8e08-2304351cac63 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:12.818593 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:12.883097 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-1d56a793-e8b3-4479-8e08-2304351cac63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a54596c94fd04ea2b4ec217166292973'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:35:12.896443 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-1d56a793-e8b3-4479-8e08-2304351cac63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a54596c94fd04ea2b4ec217166292973'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:35:12.897411 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-1d56a793-e8b3-4479-8e08-2304351cac63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a54596c94fd04ea2b4ec217166292973'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:35:12.908329 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-1d56a793-e8b3-4479-8e08-2304351cac63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a54596c94fd04ea2b4ec217166292973'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:35:12.909056 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-1d56a793-e8b3-4479-8e08-2304351cac63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a54596c94fd04ea2b4ec217166292973'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:35:12.930539 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1403/2825] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:35:12 2022] DELETE /identity/v3/users/a54596c94fd04ea2b4ec217166292973 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:35:13.138155 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82dfd2-ac6f-4c5d-94a7-3e134d7beafc None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:13.152150 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82dfd2-ac6f-4c5d-94a7-3e134d7beafc None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:13.218114 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c62ac1f-bb7c-4cf4-8967-7b3c83a2f35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:13.218904 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c62ac1f-bb7c-4cf4-8967-7b3c83a2f35e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:13.219208 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c62ac1f-bb7c-4cf4-8967-7b3c83a2f35e admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:13.219618 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c62ac1f-bb7c-4cf4-8967-7b3c83a2f35e admin admin] PATH_INFO: `/v3/projects/3632f9f9c83940ee861ef8a245c73872` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:13.220803 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c62ac1f-bb7c-4cf4-8967-7b3c83a2f35e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3632f9f9c83940ee861ef8a245c73872)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:13.222750 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c62ac1f-bb7c-4cf4-8967-7b3c83a2f35e admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:13.287316 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-0c62ac1f-bb7c-4cf4-8967-7b3c83a2f35e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3632f9f9c83940ee861ef8a245c73872', 'request_id': 'req-0c62ac1f-bb7c-4cf4-8967-7b3c83a2f35e'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:35:13.294129 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-0c62ac1f-bb7c-4cf4-8967-7b3c83a2f35e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3632f9f9c83940ee861ef8a245c73872', 'request_id': 'req-0c62ac1f-bb7c-4cf4-8967-7b3c83a2f35e'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:35:13.302410 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-0c62ac1f-bb7c-4cf4-8967-7b3c83a2f35e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3632f9f9c83940ee861ef8a245c73872', 'request_id': 'req-0c62ac1f-bb7c-4cf4-8967-7b3c83a2f35e'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:35:13.316863 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-0c62ac1f-bb7c-4cf4-8967-7b3c83a2f35e admin admin] The token cache is being invalidate because project 3632f9f9c83940ee861ef8a245c73872 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:35:13.320593 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-0c62ac1f-bb7c-4cf4-8967-7b3c83a2f35e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:35:13.321544 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-0c62ac1f-bb7c-4cf4-8967-7b3c83a2f35e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:35:13.326662 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1423/2826] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:35:13 2022] DELETE /identity/v3/projects/3632f9f9c83940ee861ef8a245c73872 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:35:13.330689 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56a793-e8b3-4479-8e08-2304351cac63 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:13.332461 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-1d56a793-e8b3-4479-8e08-2304351cac63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:35:13.360873 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56a793-e8b3-4479-8e08-2304351cac63 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:13.444640 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a620d-6fa4-4a10-ace6-e2d79ec9b09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:13.445334 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a620d-6fa4-4a10-ace6-e2d79ec9b09e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:13.445634 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a620d-6fa4-4a10-ace6-e2d79ec9b09e admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:13.445912 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a620d-6fa4-4a10-ace6-e2d79ec9b09e admin admin] PATH_INFO: `/v3/users/2264e8d00e884206aa214b88dadbe759` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:13.447272 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a620d-6fa4-4a10-ace6-e2d79ec9b09e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2264e8d00e884206aa214b88dadbe759)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:13.449267 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a620d-6fa4-4a10-ace6-e2d79ec9b09e admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:13.530642 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9f7a620d-6fa4-4a10-ace6-e2d79ec9b09e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2264e8d00e884206aa214b88dadbe759'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:35:13.544341 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9f7a620d-6fa4-4a10-ace6-e2d79ec9b09e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2264e8d00e884206aa214b88dadbe759'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:35:13.545596 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9f7a620d-6fa4-4a10-ace6-e2d79ec9b09e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2264e8d00e884206aa214b88dadbe759'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:35:13.557912 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9f7a620d-6fa4-4a10-ace6-e2d79ec9b09e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2264e8d00e884206aa214b88dadbe759'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:35:13.558711 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9f7a620d-6fa4-4a10-ace6-e2d79ec9b09e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2264e8d00e884206aa214b88dadbe759'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:35:13.585256 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1404/2827] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:35:13 2022] DELETE /identity/v3/users/2264e8d00e884206aa214b88dadbe759 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:35:13.812035 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c62ac1f-bb7c-4cf4-8967-7b3c83a2f35e admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:13.813553 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-0c62ac1f-bb7c-4cf4-8967-7b3c83a2f35e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:35:13.828546 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c62ac1f-bb7c-4cf4-8967-7b3c83a2f35e admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:13.910111 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac98666f-8fb1-4150-9c7b-2f416daa8b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:13.910703 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac98666f-8fb1-4150-9c7b-2f416daa8b39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:13.910987 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac98666f-8fb1-4150-9c7b-2f416daa8b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:13.911265 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac98666f-8fb1-4150-9c7b-2f416daa8b39 admin admin] PATH_INFO: `/v3/projects/59093efeac7644e39bb7f040c72c3f16` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:13.912864 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac98666f-8fb1-4150-9c7b-2f416daa8b39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59093efeac7644e39bb7f040c72c3f16)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:13.915153 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac98666f-8fb1-4150-9c7b-2f416daa8b39 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:13.932656 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:13.966344 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ac98666f-8fb1-4150-9c7b-2f416daa8b39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59093efeac7644e39bb7f040c72c3f16', 'request_id': 'req-ac98666f-8fb1-4150-9c7b-2f416daa8b39'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:35:13.974039 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ac98666f-8fb1-4150-9c7b-2f416daa8b39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59093efeac7644e39bb7f040c72c3f16', 'request_id': 'req-ac98666f-8fb1-4150-9c7b-2f416daa8b39'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:35:13.981449 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ac98666f-8fb1-4150-9c7b-2f416daa8b39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59093efeac7644e39bb7f040c72c3f16', 'request_id': 'req-ac98666f-8fb1-4150-9c7b-2f416daa8b39'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:35:13.996306 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ac98666f-8fb1-4150-9c7b-2f416daa8b39 admin admin] The token cache is being invalidate because project 59093efeac7644e39bb7f040c72c3f16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:35:13.996654 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ac98666f-8fb1-4150-9c7b-2f416daa8b39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:35:13.997455 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ac98666f-8fb1-4150-9c7b-2f416daa8b39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:35:13.998992 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1424/2828] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:35:13 2022] DELETE /identity/v3/projects/59093efeac7644e39bb7f040c72c3f16 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:35:23.577638 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=77,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:23.993220 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=18,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:36:02.648178 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb38908b-db12-4fc4-9627-288d1a431166 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:02.648796 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb38908b-db12-4fc4-9627-288d1a431166 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:02.648796 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb38908b-db12-4fc4-9627-288d1a431166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:02.677849 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-cb38908b-db12-4fc4-9627-288d1a431166 None None] MFA Rules not processed for user `808097b77fed4f08b443cc11fe73570f`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:36:02.679068 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-cb38908b-db12-4fc4-9627-288d1a431166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:36:02.761948 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1405/2829] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:36:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:36:03.967067 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac98666f-8fb1-4150-9c7b-2f416daa8b39 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:36:03.968642 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-ac98666f-8fb1-4150-9c7b-2f416daa8b39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:36:04.112607 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac98666f-8fb1-4150-9c7b-2f416daa8b39 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:36:04.118451 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159378b-6daa-44fa-b0cb-5f3f2ac3439a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce3d9397cca4ae58e14c8a5ae844f8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:36:04.119100 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159378b-6daa-44fa-b0cb-5f3f2ac3439a service placement] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:04.119379 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159378b-6daa-44fa-b0cb-5f3f2ac3439a service placement] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:04.119633 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159378b-6daa-44fa-b0cb-5f3f2ac3439a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:04.121540 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f159378b-6daa-44fa-b0cb-5f3f2ac3439a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:36:04.134499 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f159378b-6daa-44fa-b0cb-5f3f2ac3439a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:36:04.136138 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f159378b-6daa-44fa-b0cb-5f3f2ac3439a service placement] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:36:04.146426 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1425/2830] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:36:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:36:12.760655 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=37 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:36:14.141951 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=59 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:03.364630 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58689f3-c030-43cc-911c-22f0164576a5 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:03.365202 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58689f3-c030-43cc-911c-22f0164576a5 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:03.365202 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58689f3-c030-43cc-911c-22f0164576a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:03.391205 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-b58689f3-c030-43cc-911c-22f0164576a5 None None] MFA Rules not processed for user `808097b77fed4f08b443cc11fe73570f`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:03.392587 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b58689f3-c030-43cc-911c-22f0164576a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:03.402808 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1406/2831] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:37:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:37:13.385374 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:52.321358 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159378b-6daa-44fa-b0cb-5f3f2ac3439a service placement] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:52.322909 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f159378b-6daa-44fa-b0cb-5f3f2ac3439a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:52.423532 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159378b-6daa-44fa-b0cb-5f3f2ac3439a service placement] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:52.427696 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25afdaf4-9cf1-44fd-9816-4754cef815db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:52.428308 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afdaf4-9cf1-44fd-9816-4754cef815db service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:52.428624 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afdaf4-9cf1-44fd-9816-4754cef815db service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:52.428897 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afdaf4-9cf1-44fd-9816-4754cef815db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:52.430837 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-25afdaf4-9cf1-44fd-9816-4754cef815db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:52.547655 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25afdaf4-9cf1-44fd-9816-4754cef815db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:52.549158 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25afdaf4-9cf1-44fd-9816-4754cef815db service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:52.571286 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1426/2832] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:37:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:37:54.090017 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58689f3-c030-43cc-911c-22f0164576a5 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:54.092314 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b58689f3-c030-43cc-911c-22f0164576a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:54.107666 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58689f3-c030-43cc-911c-22f0164576a5 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:54.112709 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0319e8f-ad8c-4628-9e05-aa99470c41e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:54.113338 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0319e8f-ad8c-4628-9e05-aa99470c41e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:54.113613 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0319e8f-ad8c-4628-9e05-aa99470c41e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:54.113998 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0319e8f-ad8c-4628-9e05-aa99470c41e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:54.116239 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c0319e8f-ad8c-4628-9e05-aa99470c41e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:54.131045 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0319e8f-ad8c-4628-9e05-aa99470c41e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:54.132481 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0319e8f-ad8c-4628-9e05-aa99470c41e6 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:54.145049 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1407/2833] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:37:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:38:01.418908 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30029b41-6489-4ced-918a-f044ca1d5993 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:01.419530 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30029b41-6489-4ced-918a-f044ca1d5993 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:01.419530 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30029b41-6489-4ced-918a-f044ca1d5993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:01.439832 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-30029b41-6489-4ced-918a-f044ca1d5993 None None] MFA Rules not processed for user `808097b77fed4f08b443cc11fe73570f`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:01.441081 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-30029b41-6489-4ced-918a-f044ca1d5993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:01.448575 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1427/2834] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:38:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:38:04.139106 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=6 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:11.375933 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0319e8f-ad8c-4628-9e05-aa99470c41e6 service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:11.377632 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c0319e8f-ad8c-4628-9e05-aa99470c41e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:11.434142 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=78 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:11.467944 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0319e8f-ad8c-4628-9e05-aa99470c41e6 service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:11.471801 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59308395-a309-4f37-b815-e6456c1d543f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:11.472418 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59308395-a309-4f37-b815-e6456c1d543f service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:11.472734 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59308395-a309-4f37-b815-e6456c1d543f service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:11.473031 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59308395-a309-4f37-b815-e6456c1d543f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:11.474967 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-59308395-a309-4f37-b815-e6456c1d543f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:11.484711 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59308395-a309-4f37-b815-e6456c1d543f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:11.486145 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59308395-a309-4f37-b815-e6456c1d543f service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:11.494818 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1408/2835] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:38:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:38:21.491088 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=35 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:56.138805 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30029b41-6489-4ced-918a-f044ca1d5993 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:56.140939 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-30029b41-6489-4ced-918a-f044ca1d5993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:56.158627 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30029b41-6489-4ced-918a-f044ca1d5993 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:56.173092 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba421cc-86e0-4186-b627-d09e01f1b313 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b7213b7111456a93e294ce40b95b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:56.174085 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba421cc-86e0-4186-b627-d09e01f1b313 service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:56.174368 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba421cc-86e0-4186-b627-d09e01f1b313 service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:56.174644 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba421cc-86e0-4186-b627-d09e01f1b313 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:56.176794 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-fba421cc-86e0-4186-b627-d09e01f1b313 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:56.196979 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba421cc-86e0-4186-b627-d09e01f1b313 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:56.198749 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba421cc-86e0-4186-b627-d09e01f1b313 service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:56.213325 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1428/2836] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:38:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:39:05.039306 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59308395-a309-4f37-b815-e6456c1d543f service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:05.040798 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-59308395-a309-4f37-b815-e6456c1d543f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:05.055854 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59308395-a309-4f37-b815-e6456c1d543f service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:05.061007 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff53f7-7f39-4b40-9ab0-5338eaa0980c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce3d9397cca4ae58e14c8a5ae844f8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:05.061614 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff53f7-7f39-4b40-9ab0-5338eaa0980c service placement] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:05.061892 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff53f7-7f39-4b40-9ab0-5338eaa0980c service placement] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:05.062160 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff53f7-7f39-4b40-9ab0-5338eaa0980c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:05.063877 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-5fff53f7-7f39-4b40-9ab0-5338eaa0980c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:05.075964 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fff53f7-7f39-4b40-9ab0-5338eaa0980c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:05.077389 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fff53f7-7f39-4b40-9ab0-5338eaa0980c service placement] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:05.088094 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1409/2837] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:39:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:39:05.104670 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba421cc-86e0-4186-b627-d09e01f1b313 service nova] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:05.105706 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-fba421cc-86e0-4186-b627-d09e01f1b313 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:05.209521 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba421cc-86e0-4186-b627-d09e01f1b313 service nova] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:05.215285 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f7fac-8277-4d30-a2ec-977aa62b175a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:05.215925 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f7fac-8277-4d30-a2ec-977aa62b175a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:05.216207 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f7fac-8277-4d30-a2ec-977aa62b175a admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:05.216511 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f7fac-8277-4d30-a2ec-977aa62b175a admin admin] PATH_INFO: `/v3/users/808097b77fed4f08b443cc11fe73570f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:05.217705 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f7fac-8277-4d30-a2ec-977aa62b175a admin admin] RBAC: Authorizing `identity:delete_user(user_id=808097b77fed4f08b443cc11fe73570f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:05.219645 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f7fac-8277-4d30-a2ec-977aa62b175a admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:05.271647 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-5b1f7fac-8277-4d30-a2ec-977aa62b175a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '808097b77fed4f08b443cc11fe73570f'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:05.280501 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-5b1f7fac-8277-4d30-a2ec-977aa62b175a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '808097b77fed4f08b443cc11fe73570f'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:05.288248 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-5b1f7fac-8277-4d30-a2ec-977aa62b175a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '808097b77fed4f08b443cc11fe73570f'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:05.288979 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-5b1f7fac-8277-4d30-a2ec-977aa62b175a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '808097b77fed4f08b443cc11fe73570f'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:05.302374 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-5b1f7fac-8277-4d30-a2ec-977aa62b175a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '808097b77fed4f08b443cc11fe73570f'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:05.308863 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1429/2838] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:39:05 2022] DELETE /identity/v3/users/808097b77fed4f08b443cc11fe73570f => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:39:05.503394 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff53f7-7f39-4b40-9ab0-5338eaa0980c service placement] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:05.523572 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff53f7-7f39-4b40-9ab0-5338eaa0980c service placement] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:05.586285 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e458e2c9-e1e7-49e6-8337-5aceb8af7687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:05.586937 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458e2c9-e1e7-49e6-8337-5aceb8af7687 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:05.587217 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458e2c9-e1e7-49e6-8337-5aceb8af7687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:05.587520 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458e2c9-e1e7-49e6-8337-5aceb8af7687 admin admin] PATH_INFO: `/v3/projects/6848f7bf36994bcf99cbb061bfbdbd23` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:05.589690 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e458e2c9-e1e7-49e6-8337-5aceb8af7687 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6848f7bf36994bcf99cbb061bfbdbd23)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:05.591446 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e458e2c9-e1e7-49e6-8337-5aceb8af7687 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:05.642277 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e458e2c9-e1e7-49e6-8337-5aceb8af7687 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6848f7bf36994bcf99cbb061bfbdbd23', 'request_id': 'req-e458e2c9-e1e7-49e6-8337-5aceb8af7687'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:05.649820 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e458e2c9-e1e7-49e6-8337-5aceb8af7687 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6848f7bf36994bcf99cbb061bfbdbd23', 'request_id': 'req-e458e2c9-e1e7-49e6-8337-5aceb8af7687'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:05.658335 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e458e2c9-e1e7-49e6-8337-5aceb8af7687 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6848f7bf36994bcf99cbb061bfbdbd23', 'request_id': 'req-e458e2c9-e1e7-49e6-8337-5aceb8af7687'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:05.669496 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e458e2c9-e1e7-49e6-8337-5aceb8af7687 admin admin] The token cache is being invalidate because project 6848f7bf36994bcf99cbb061bfbdbd23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:39:05.669786 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e458e2c9-e1e7-49e6-8337-5aceb8af7687 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:05.670449 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e458e2c9-e1e7-49e6-8337-5aceb8af7687 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:05.671970 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1410/2839] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:39:05 2022] DELETE /identity/v3/projects/6848f7bf36994bcf99cbb061bfbdbd23 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:39:05.678203 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd488da-6b9e-4f00-8b2c-3ba760b0e86b None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:05.678519 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd488da-6b9e-4f00-8b2c-3ba760b0e86b None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:05.678781 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd488da-6b9e-4f00-8b2c-3ba760b0e86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:05.742601 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:05.747800 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-7dd488da-6b9e-4f00-8b2c-3ba760b0e86b None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:05.750419 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-7dd488da-6b9e-4f00-8b2c-3ba760b0e86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:05.819674 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1430/2840] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:39:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:39:05.829394 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75172059-65e1-4a43-84dc-98060fc1e388 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:05.829711 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75172059-65e1-4a43-84dc-98060fc1e388 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:05.830012 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75172059-65e1-4a43-84dc-98060fc1e388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:05.857048 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-75172059-65e1-4a43-84dc-98060fc1e388 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:05.858285 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-75172059-65e1-4a43-84dc-98060fc1e388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:05.867781 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1411/2841] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:39:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:39:05.872556 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd488da-6b9e-4f00-8b2c-3ba760b0e86b None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:05.882796 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd488da-6b9e-4f00-8b2c-3ba760b0e86b None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:05.888760 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdfb99f-5e6a-43c0-9037-9849ab3c8129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:05.889402 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdfb99f-5e6a-43c0-9037-9849ab3c8129 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:05.889678 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdfb99f-5e6a-43c0-9037-9849ab3c8129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:05.889960 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdfb99f-5e6a-43c0-9037-9849ab3c8129 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:05.890631 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdfb99f-5e6a-43c0-9037-9849ab3c8129 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:05.890936 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdfb99f-5e6a-43c0-9037-9849ab3c8129 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:05.892582 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdfb99f-5e6a-43c0-9037-9849ab3c8129 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:05.905447 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1431/2842] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:39:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:05.912476 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75172059-65e1-4a43-84dc-98060fc1e388 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:05.924069 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75172059-65e1-4a43-84dc-98060fc1e388 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:05.929848 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964738f8-bf1c-4d95-b42a-90af26f014bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:05.930492 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964738f8-bf1c-4d95-b42a-90af26f014bc admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:05.930764 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964738f8-bf1c-4d95-b42a-90af26f014bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:05.931029 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964738f8-bf1c-4d95-b42a-90af26f014bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:05.931704 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964738f8-bf1c-4d95-b42a-90af26f014bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:05.933721 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964738f8-bf1c-4d95-b42a-90af26f014bc admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:05.981315 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1412/2843] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:39:05 2022] POST /identity/v3/projects => generated 377 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:39:05.985848 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdfb99f-5e6a-43c0-9037-9849ab3c8129 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:05.996421 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdfb99f-5e6a-43c0-9037-9849ab3c8129 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:06.056780 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34def6a4-ce5f-40b5-be8a-95314125d067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:06.057479 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34def6a4-ce5f-40b5-be8a-95314125d067 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:06.057778 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34def6a4-ce5f-40b5-be8a-95314125d067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:06.058055 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34def6a4-ce5f-40b5-be8a-95314125d067 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:06.058687 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34def6a4-ce5f-40b5-be8a-95314125d067 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:06.060658 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34def6a4-ce5f-40b5-be8a-95314125d067 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:06.086926 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1432/2844] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:39:05 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:39:06.091378 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964738f8-bf1c-4d95-b42a-90af26f014bc admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:06.102364 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964738f8-bf1c-4d95-b42a-90af26f014bc admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:06.107598 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c237c-ef33-494c-a1cc-3a10e4b4c0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:06.108238 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c237c-ef33-494c-a1cc-3a10e4b4c0fb admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:06.108542 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c237c-ef33-494c-a1cc-3a10e4b4c0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:06.108809 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c237c-ef33-494c-a1cc-3a10e4b4c0fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:06.109472 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4c237c-ef33-494c-a1cc-3a10e4b4c0fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:06.111098 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4c237c-ef33-494c-a1cc-3a10e4b4c0fb admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:06.121520 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1413/2845] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:39:06.125891 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34def6a4-ce5f-40b5-be8a-95314125d067 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:06.137231 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34def6a4-ce5f-40b5-be8a-95314125d067 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:06.143131 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4c8e4-73e8-497f-b4f6-a0b55a992bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:06.143747 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4c8e4-73e8-497f-b4f6-a0b55a992bb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:06.144033 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4c8e4-73e8-497f-b4f6-a0b55a992bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:06.144302 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4c8e4-73e8-497f-b4f6-a0b55a992bb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:06.144983 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad4c8e4-73e8-497f-b4f6-a0b55a992bb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:06.146604 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad4c8e4-73e8-497f-b4f6-a0b55a992bb1 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:06.158743 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1433/2846] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:39:06.163452 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c237c-ef33-494c-a1cc-3a10e4b4c0fb admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:06.174538 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c237c-ef33-494c-a1cc-3a10e4b4c0fb admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:06.180638 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a847ff5-a26d-4f96-be2d-1643de219b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:06.181318 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a847ff5-a26d-4f96-be2d-1643de219b1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:06.181681 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a847ff5-a26d-4f96-be2d-1643de219b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:06.182163 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a847ff5-a26d-4f96-be2d-1643de219b1d admin admin] PATH_INFO: `/v3/projects/be50f1a83191455f819c5173a6a65356/users/7fb3307faeff49b89a7fcfe1d4d69167/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:06.198235 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a847ff5-a26d-4f96-be2d-1643de219b1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=be50f1a83191455f819c5173a6a65356, user_id=7fb3307faeff49b89a7fcfe1d4d69167, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:06.201213 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a847ff5-a26d-4f96-be2d-1643de219b1d admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:06.219779 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1414/2847] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:39:06 2022] PUT /identity/v3/projects/be50f1a83191455f819c5173a6a65356/users/7fb3307faeff49b89a7fcfe1d4d69167/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:39:06.236398 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06714acf-d8be-4539-a264-7f065b132f04 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:06.236734 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06714acf-d8be-4539-a264-7f065b132f04 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:06.237025 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06714acf-d8be-4539-a264-7f065b132f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:06.274119 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-06714acf-d8be-4539-a264-7f065b132f04 None None] MFA Rules not processed for user `7fb3307faeff49b89a7fcfe1d4d69167`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:06.275734 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-06714acf-d8be-4539-a264-7f065b132f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:06.352007 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1434/2848] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:39:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:39:06.357555 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a847ff5-a26d-4f96-be2d-1643de219b1d admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:06.363634 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:06.431764 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a847ff5-a26d-4f96-be2d-1643de219b1d admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:06.437398 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3834f4f6-6299-431e-b2e1-6cbda60b377b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:06.438087 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834f4f6-6299-431e-b2e1-6cbda60b377b admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:06.438370 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834f4f6-6299-431e-b2e1-6cbda60b377b admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:06.438638 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834f4f6-6299-431e-b2e1-6cbda60b377b admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:06.439260 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3834f4f6-6299-431e-b2e1-6cbda60b377b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:06.441219 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3834f4f6-6299-431e-b2e1-6cbda60b377b admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:06.472998 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1415/2849] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:39:06 2022] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:39:06.477704 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06714acf-d8be-4539-a264-7f065b132f04 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:06.485481 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:06.493917 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06714acf-d8be-4539-a264-7f065b132f04 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:06.559440 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86979655-6bec-4d8f-8030-33e62b509448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:06.560060 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86979655-6bec-4d8f-8030-33e62b509448 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:06.560337 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86979655-6bec-4d8f-8030-33e62b509448 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:06.560639 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86979655-6bec-4d8f-8030-33e62b509448 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:06.561304 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86979655-6bec-4d8f-8030-33e62b509448 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:06.563294 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86979655-6bec-4d8f-8030-33e62b509448 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:06.588089 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1435/2850] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:39:06 2022] POST /identity/v3/users => generated 290 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:39:06.589594 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3834f4f6-6299-431e-b2e1-6cbda60b377b admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:06.600227 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3834f4f6-6299-431e-b2e1-6cbda60b377b admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:06.605448 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c72689-138d-448d-a6fd-fd317ad01c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:06.605987 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c72689-138d-448d-a6fd-fd317ad01c05 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:06.606261 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c72689-138d-448d-a6fd-fd317ad01c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:06.606526 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c72689-138d-448d-a6fd-fd317ad01c05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:06.607166 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c72689-138d-448d-a6fd-fd317ad01c05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:06.608779 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c72689-138d-448d-a6fd-fd317ad01c05 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:06.620646 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1416/2851] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:39:06.624862 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86979655-6bec-4d8f-8030-33e62b509448 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:06.636623 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86979655-6bec-4d8f-8030-33e62b509448 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:06.641681 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02e9bdb-b46e-4dd9-a5f0-af9ebba0fefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:06.642284 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e9bdb-b46e-4dd9-a5f0-af9ebba0fefa admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:06.642568 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e9bdb-b46e-4dd9-a5f0-af9ebba0fefa admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:06.642837 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e9bdb-b46e-4dd9-a5f0-af9ebba0fefa admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:06.643485 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02e9bdb-b46e-4dd9-a5f0-af9ebba0fefa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:06.645207 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02e9bdb-b46e-4dd9-a5f0-af9ebba0fefa admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:06.658383 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1436/2852] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:39:06.663999 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c72689-138d-448d-a6fd-fd317ad01c05 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:06.675480 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c72689-138d-448d-a6fd-fd317ad01c05 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:06.680292 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44db17c-8cce-40f9-9ccc-72327e03926d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:06.680999 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44db17c-8cce-40f9-9ccc-72327e03926d admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:06.681278 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44db17c-8cce-40f9-9ccc-72327e03926d admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:06.681604 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44db17c-8cce-40f9-9ccc-72327e03926d admin admin] PATH_INFO: `/v3/projects/f1e267ac57934b9f941e88ca4856c619/users/cf068607c30743d7aa7510c53aa0f45a/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:06.698526 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44db17c-8cce-40f9-9ccc-72327e03926d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1e267ac57934b9f941e88ca4856c619, user_id=cf068607c30743d7aa7510c53aa0f45a, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:06.701475 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44db17c-8cce-40f9-9ccc-72327e03926d admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:06.719897 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1417/2853] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:39:06 2022] PUT /identity/v3/projects/f1e267ac57934b9f941e88ca4856c619/users/cf068607c30743d7aa7510c53aa0f45a/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:39:06.730942 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e59385-9971-4ecd-bf38-d19d12e5b375 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:06.731239 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e59385-9971-4ecd-bf38-d19d12e5b375 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:06.731533 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e59385-9971-4ecd-bf38-d19d12e5b375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:06.762511 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-80e59385-9971-4ecd-bf38-d19d12e5b375 None None] MFA Rules not processed for user `cf068607c30743d7aa7510c53aa0f45a`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:06.763752 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-80e59385-9971-4ecd-bf38-d19d12e5b375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:06.849254 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1437/2854] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:39:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:39:06.856233 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44db17c-8cce-40f9-9ccc-72327e03926d admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:06.928612 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44db17c-8cce-40f9-9ccc-72327e03926d admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:06.935022 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04866481-7eb8-4829-8246-eedaa84c0561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:06.935654 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04866481-7eb8-4829-8246-eedaa84c0561 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:06.935925 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04866481-7eb8-4829-8246-eedaa84c0561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:06.936191 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04866481-7eb8-4829-8246-eedaa84c0561 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:06.936865 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04866481-7eb8-4829-8246-eedaa84c0561 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:06.938793 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04866481-7eb8-4829-8246-eedaa84c0561 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:06.972638 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1418/2855] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:39:06 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:39:06.976203 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e59385-9971-4ecd-bf38-d19d12e5b375 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:06.989956 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e59385-9971-4ecd-bf38-d19d12e5b375 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:07.052726 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1529fb66-4174-4268-8b7d-e69b745060f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:07.053353 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529fb66-4174-4268-8b7d-e69b745060f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:07.053634 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529fb66-4174-4268-8b7d-e69b745060f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:07.053907 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529fb66-4174-4268-8b7d-e69b745060f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:07.054560 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1529fb66-4174-4268-8b7d-e69b745060f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:07.056596 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1529fb66-4174-4268-8b7d-e69b745060f0 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:07.073768 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:07.082074 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1438/2856] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:39:06 2022] POST /identity/v3/users => generated 295 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:39:07.083388 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04866481-7eb8-4829-8246-eedaa84c0561 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:07.094765 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04866481-7eb8-4829-8246-eedaa84c0561 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:07.100414 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18ea3b-9c12-446a-8796-4f3e5b61870d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:07.101051 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18ea3b-9c12-446a-8796-4f3e5b61870d admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:07.101331 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18ea3b-9c12-446a-8796-4f3e5b61870d admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:07.101604 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18ea3b-9c12-446a-8796-4f3e5b61870d admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:07.102303 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e18ea3b-9c12-446a-8796-4f3e5b61870d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:07.103967 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e18ea3b-9c12-446a-8796-4f3e5b61870d admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:07.115952 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1419/2857] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:39:07.120326 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1529fb66-4174-4268-8b7d-e69b745060f0 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:07.131151 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1529fb66-4174-4268-8b7d-e69b745060f0 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:07.137647 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac99295-09d9-4932-846d-7e9e7f7bcb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:07.138323 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac99295-09d9-4932-846d-7e9e7f7bcb8f admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:07.138605 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac99295-09d9-4932-846d-7e9e7f7bcb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:07.138879 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac99295-09d9-4932-846d-7e9e7f7bcb8f admin admin] PATH_INFO: `/v3/projects/2025702d090f44f788938443a5557c50/users/88faa1a326724458a1fc242959acaec1/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:07.155526 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac99295-09d9-4932-846d-7e9e7f7bcb8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2025702d090f44f788938443a5557c50, user_id=88faa1a326724458a1fc242959acaec1, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:07.158309 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac99295-09d9-4932-846d-7e9e7f7bcb8f admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:07.174676 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1439/2858] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:39:07 2022] PUT /identity/v3/projects/2025702d090f44f788938443a5557c50/users/88faa1a326724458a1fc242959acaec1/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:39:07.178834 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18ea3b-9c12-446a-8796-4f3e5b61870d admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:07.189695 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18ea3b-9c12-446a-8796-4f3e5b61870d admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:07.217417 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:07.252689 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40863103-65d2-46b4-9be2-3f9b7f71ca8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:07.253308 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40863103-65d2-46b4-9be2-3f9b7f71ca8c admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:07.253587 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40863103-65d2-46b4-9be2-3f9b7f71ca8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:07.253862 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40863103-65d2-46b4-9be2-3f9b7f71ca8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:07.254533 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40863103-65d2-46b4-9be2-3f9b7f71ca8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:07.256173 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40863103-65d2-46b4-9be2-3f9b7f71ca8c admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:07.267548 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1420/2859] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:39:07.272512 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac99295-09d9-4932-846d-7e9e7f7bcb8f admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:07.284488 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac99295-09d9-4932-846d-7e9e7f7bcb8f admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:07.289539 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a589a98-5dfe-46da-9a2b-43ef377f336f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:07.290197 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a589a98-5dfe-46da-9a2b-43ef377f336f admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:07.290481 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a589a98-5dfe-46da-9a2b-43ef377f336f admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:07.290757 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a589a98-5dfe-46da-9a2b-43ef377f336f admin admin] PATH_INFO: `/v3/projects/2025702d090f44f788938443a5557c50/users/88faa1a326724458a1fc242959acaec1/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:07.292921 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a589a98-5dfe-46da-9a2b-43ef377f336f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2025702d090f44f788938443a5557c50, user_id=88faa1a326724458a1fc242959acaec1, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:07.295575 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a589a98-5dfe-46da-9a2b-43ef377f336f admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:07.306736 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1440/2860] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:39:07 2022] PUT /identity/v3/projects/2025702d090f44f788938443a5557c50/users/88faa1a326724458a1fc242959acaec1/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:39:07.322277 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d18a80-c708-4a80-bcbb-68be96fa80ba None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:07.322707 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d18a80-c708-4a80-bcbb-68be96fa80ba None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:07.323011 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d18a80-c708-4a80-bcbb-68be96fa80ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:07.353865 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-79d18a80-c708-4a80-bcbb-68be96fa80ba None None] MFA Rules not processed for user `88faa1a326724458a1fc242959acaec1`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:07.355312 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-79d18a80-c708-4a80-bcbb-68be96fa80ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:07.430725 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1421/2861] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:39:07 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:39:07.445346 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a589a98-5dfe-46da-9a2b-43ef377f336f admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:07.448381 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-6a589a98-5dfe-46da-9a2b-43ef377f336f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:07.509002 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a589a98-5dfe-46da-9a2b-43ef377f336f admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:07.513780 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c2d96-9eca-40f3-a426-d117a57eb2d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:07.514386 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c2d96-9eca-40f3-a426-d117a57eb2d1 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:07.514673 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c2d96-9eca-40f3-a426-d117a57eb2d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:07.514941 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c2d96-9eca-40f3-a426-d117a57eb2d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:07.526405 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3c2d96-9eca-40f3-a426-d117a57eb2d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:07.527748 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3c2d96-9eca-40f3-a426-d117a57eb2d1 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:07.541557 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1441/2862] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:39:07 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:39:07.595221 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d18a80-c708-4a80-bcbb-68be96fa80ba None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:07.596839 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-79d18a80-c708-4a80-bcbb-68be96fa80ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:07.610182 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d18a80-c708-4a80-bcbb-68be96fa80ba None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:07.614600 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c0088-111b-4178-af1d-1e9fea7ce54f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:07.615199 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c0088-111b-4178-af1d-1e9fea7ce54f service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:07.615475 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c0088-111b-4178-af1d-1e9fea7ce54f service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:07.615746 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c0088-111b-4178-af1d-1e9fea7ce54f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:07.682184 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7c0088-111b-4178-af1d-1e9fea7ce54f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:07.683574 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7c0088-111b-4178-af1d-1e9fea7ce54f service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:07.693056 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1422/2863] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:39:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:39:10.700180 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c2d96-9eca-40f3-a426-d117a57eb2d1 service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:10.780733 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c2d96-9eca-40f3-a426-d117a57eb2d1 service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:10.786363 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e9a6d-a82b-4f48-9a4a-60aaae0e9e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:10.787013 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e9a6d-a82b-4f48-9a4a-60aaae0e9e4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:10.787293 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e9a6d-a82b-4f48-9a4a-60aaae0e9e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:10.787564 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e9a6d-a82b-4f48-9a4a-60aaae0e9e4d admin admin] PATH_INFO: `/v3/users/7fb3307faeff49b89a7fcfe1d4d69167` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:10.788857 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0e9a6d-a82b-4f48-9a4a-60aaae0e9e4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fb3307faeff49b89a7fcfe1d4d69167)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:10.790830 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0e9a6d-a82b-4f48-9a4a-60aaae0e9e4d admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:10.844072 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2f0e9a6d-a82b-4f48-9a4a-60aaae0e9e4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fb3307faeff49b89a7fcfe1d4d69167'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:10.852645 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2f0e9a6d-a82b-4f48-9a4a-60aaae0e9e4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fb3307faeff49b89a7fcfe1d4d69167'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:10.860898 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2f0e9a6d-a82b-4f48-9a4a-60aaae0e9e4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fb3307faeff49b89a7fcfe1d4d69167'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:10.861643 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2f0e9a6d-a82b-4f48-9a4a-60aaae0e9e4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fb3307faeff49b89a7fcfe1d4d69167'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:10.866205 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:10.878581 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2f0e9a6d-a82b-4f48-9a4a-60aaae0e9e4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fb3307faeff49b89a7fcfe1d4d69167'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:10.888764 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1442/2864] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:39:10 2022] DELETE /identity/v3/users/7fb3307faeff49b89a7fcfe1d4d69167 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:39:10.893342 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28c83f-abb1-4a87-8919-7abc3c1e13c6 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:10.893862 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28c83f-abb1-4a87-8919-7abc3c1e13c6 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:10.893862 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28c83f-abb1-4a87-8919-7abc3c1e13c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:10.919427 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-3a28c83f-abb1-4a87-8919-7abc3c1e13c6 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:10.920673 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-3a28c83f-abb1-4a87-8919-7abc3c1e13c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:10.979984 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:10.997014 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1423/2865] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:39:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:39:11.008915 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e9a6d-a82b-4f48-9a4a-60aaae0e9e4d admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:11.011125 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-2f0e9a6d-a82b-4f48-9a4a-60aaae0e9e4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:11.074730 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e9a6d-a82b-4f48-9a4a-60aaae0e9e4d admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:11.078447 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e664b-175d-44f4-9f34-d6b05052d337 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:11.079069 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e664b-175d-44f4-9f34-d6b05052d337 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:11.079348 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e664b-175d-44f4-9f34-d6b05052d337 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:11.079620 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e664b-175d-44f4-9f34-d6b05052d337 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:11.089263 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34e664b-175d-44f4-9f34-d6b05052d337 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:11.090727 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34e664b-175d-44f4-9f34-d6b05052d337 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:11.100816 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1443/2866] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:39:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:39:11.404458 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a28c83f-abb1-4a87-8919-7abc3c1e13c6 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:11.406106 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-3a28c83f-abb1-4a87-8919-7abc3c1e13c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:11.422261 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a28c83f-abb1-4a87-8919-7abc3c1e13c6 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:11.427245 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cceb19f-1a13-4018-8c55-e2a38fbfeca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:11.427902 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cceb19f-1a13-4018-8c55-e2a38fbfeca9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:11.428183 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cceb19f-1a13-4018-8c55-e2a38fbfeca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:11.428491 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cceb19f-1a13-4018-8c55-e2a38fbfeca9 admin admin] PATH_INFO: `/v3/projects/be50f1a83191455f819c5173a6a65356` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:11.429632 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cceb19f-1a13-4018-8c55-e2a38fbfeca9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be50f1a83191455f819c5173a6a65356)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:11.431599 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cceb19f-1a13-4018-8c55-e2a38fbfeca9 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:11.480062 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5cceb19f-1a13-4018-8c55-e2a38fbfeca9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be50f1a83191455f819c5173a6a65356', 'request_id': 'req-5cceb19f-1a13-4018-8c55-e2a38fbfeca9'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:11.487839 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5cceb19f-1a13-4018-8c55-e2a38fbfeca9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be50f1a83191455f819c5173a6a65356', 'request_id': 'req-5cceb19f-1a13-4018-8c55-e2a38fbfeca9'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:11.498942 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5cceb19f-1a13-4018-8c55-e2a38fbfeca9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be50f1a83191455f819c5173a6a65356', 'request_id': 'req-5cceb19f-1a13-4018-8c55-e2a38fbfeca9'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:11.510774 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5cceb19f-1a13-4018-8c55-e2a38fbfeca9 admin admin] The token cache is being invalidate because project be50f1a83191455f819c5173a6a65356 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:39:11.511090 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5cceb19f-1a13-4018-8c55-e2a38fbfeca9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:11.511835 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5cceb19f-1a13-4018-8c55-e2a38fbfeca9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:11.513462 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1424/2867] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:39:11 2022] DELETE /identity/v3/projects/be50f1a83191455f819c5173a6a65356 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:39:11.517738 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e664b-175d-44f4-9f34-d6b05052d337 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:11.529083 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e664b-175d-44f4-9f34-d6b05052d337 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:11.599094 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2925df9-2406-4795-877f-3c06f7aa461b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:11.599762 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2925df9-2406-4795-877f-3c06f7aa461b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:11.600049 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2925df9-2406-4795-877f-3c06f7aa461b admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:11.600330 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2925df9-2406-4795-877f-3c06f7aa461b admin admin] PATH_INFO: `/v3/users/cf068607c30743d7aa7510c53aa0f45a` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:11.601522 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2925df9-2406-4795-877f-3c06f7aa461b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf068607c30743d7aa7510c53aa0f45a)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:11.603483 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2925df9-2406-4795-877f-3c06f7aa461b admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:11.653808 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-d2925df9-2406-4795-877f-3c06f7aa461b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf068607c30743d7aa7510c53aa0f45a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:11.663399 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-d2925df9-2406-4795-877f-3c06f7aa461b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf068607c30743d7aa7510c53aa0f45a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:11.671991 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-d2925df9-2406-4795-877f-3c06f7aa461b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf068607c30743d7aa7510c53aa0f45a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:11.672662 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-d2925df9-2406-4795-877f-3c06f7aa461b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf068607c30743d7aa7510c53aa0f45a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:11.686581 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-d2925df9-2406-4795-877f-3c06f7aa461b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf068607c30743d7aa7510c53aa0f45a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:11.693010 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1444/2868] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:39:11 2022] DELETE /identity/v3/users/cf068607c30743d7aa7510c53aa0f45a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:39:12.003366 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cceb19f-1a13-4018-8c55-e2a38fbfeca9 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:12.005120 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-5cceb19f-1a13-4018-8c55-e2a38fbfeca9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:12.019792 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cceb19f-1a13-4018-8c55-e2a38fbfeca9 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:12.082928 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71441b1e-7274-476b-893e-2f917ba254b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:12.083690 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71441b1e-7274-476b-893e-2f917ba254b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:12.084039 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71441b1e-7274-476b-893e-2f917ba254b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:12.084390 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71441b1e-7274-476b-893e-2f917ba254b0 admin admin] PATH_INFO: `/v3/projects/f1e267ac57934b9f941e88ca4856c619` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:12.085796 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71441b1e-7274-476b-893e-2f917ba254b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1e267ac57934b9f941e88ca4856c619)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:12.087786 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71441b1e-7274-476b-893e-2f917ba254b0 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:12.139666 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-71441b1e-7274-476b-893e-2f917ba254b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1e267ac57934b9f941e88ca4856c619', 'request_id': 'req-71441b1e-7274-476b-893e-2f917ba254b0'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:12.147915 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-71441b1e-7274-476b-893e-2f917ba254b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1e267ac57934b9f941e88ca4856c619', 'request_id': 'req-71441b1e-7274-476b-893e-2f917ba254b0'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:12.158688 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-71441b1e-7274-476b-893e-2f917ba254b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1e267ac57934b9f941e88ca4856c619', 'request_id': 'req-71441b1e-7274-476b-893e-2f917ba254b0'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:12.171561 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-71441b1e-7274-476b-893e-2f917ba254b0 admin admin] The token cache is being invalidate because project f1e267ac57934b9f941e88ca4856c619 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:39:12.171773 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-71441b1e-7274-476b-893e-2f917ba254b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:12.172492 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-71441b1e-7274-476b-893e-2f917ba254b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:12.174059 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1425/2869] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:39:12 2022] DELETE /identity/v3/projects/f1e267ac57934b9f941e88ca4856c619 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:39:12.178562 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2925df9-2406-4795-877f-3c06f7aa461b admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:12.180274 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-d2925df9-2406-4795-877f-3c06f7aa461b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:12.195415 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2925df9-2406-4795-877f-3c06f7aa461b admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:12.199774 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:12.271654 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cd5539-c555-4238-9a44-4f65c2d38cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:12.272517 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd5539-c555-4238-9a44-4f65c2d38cdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:12.272808 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd5539-c555-4238-9a44-4f65c2d38cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:12.273084 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd5539-c555-4238-9a44-4f65c2d38cdb admin admin] PATH_INFO: `/v3/users/88faa1a326724458a1fc242959acaec1` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:12.274306 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cd5539-c555-4238-9a44-4f65c2d38cdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=88faa1a326724458a1fc242959acaec1)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:12.276491 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cd5539-c555-4238-9a44-4f65c2d38cdb admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:12.342497 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-c8cd5539-c555-4238-9a44-4f65c2d38cdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88faa1a326724458a1fc242959acaec1'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:12.356838 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-c8cd5539-c555-4238-9a44-4f65c2d38cdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88faa1a326724458a1fc242959acaec1'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:12.365439 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-c8cd5539-c555-4238-9a44-4f65c2d38cdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88faa1a326724458a1fc242959acaec1'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:12.366203 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-c8cd5539-c555-4238-9a44-4f65c2d38cdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88faa1a326724458a1fc242959acaec1'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:12.379768 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-c8cd5539-c555-4238-9a44-4f65c2d38cdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88faa1a326724458a1fc242959acaec1'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:12.386973 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1445/2870] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:39:12 2022] DELETE /identity/v3/users/88faa1a326724458a1fc242959acaec1 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:39:12.688719 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71441b1e-7274-476b-893e-2f917ba254b0 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:12.690336 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-71441b1e-7274-476b-893e-2f917ba254b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:12.701272 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:12.708700 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71441b1e-7274-476b-893e-2f917ba254b0 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:12.774291 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a33208-3f77-4119-9679-b1b17051b6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:12.774873 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a33208-3f77-4119-9679-b1b17051b6df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:12.775151 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a33208-3f77-4119-9679-b1b17051b6df admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:12.775427 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a33208-3f77-4119-9679-b1b17051b6df admin admin] PATH_INFO: `/v3/projects/2025702d090f44f788938443a5557c50` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:12.776663 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a33208-3f77-4119-9679-b1b17051b6df admin admin] RBAC: Authorizing `identity:delete_project(project_id=2025702d090f44f788938443a5557c50)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:12.778618 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a33208-3f77-4119-9679-b1b17051b6df admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:12.827638 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f9a33208-3f77-4119-9679-b1b17051b6df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2025702d090f44f788938443a5557c50', 'request_id': 'req-f9a33208-3f77-4119-9679-b1b17051b6df'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:12.834382 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f9a33208-3f77-4119-9679-b1b17051b6df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2025702d090f44f788938443a5557c50', 'request_id': 'req-f9a33208-3f77-4119-9679-b1b17051b6df'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:12.845780 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f9a33208-3f77-4119-9679-b1b17051b6df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2025702d090f44f788938443a5557c50', 'request_id': 'req-f9a33208-3f77-4119-9679-b1b17051b6df'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:12.859033 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f9a33208-3f77-4119-9679-b1b17051b6df admin admin] The token cache is being invalidate because project 2025702d090f44f788938443a5557c50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:39:12.859320 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f9a33208-3f77-4119-9679-b1b17051b6df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:12.859966 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f9a33208-3f77-4119-9679-b1b17051b6df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:12.861573 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1426/2871] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:39:12 2022] DELETE /identity/v3/projects/2025702d090f44f788938443a5557c50 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:39:12.868217 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b6b12-79a5-41fc-95c2-b2cd872b7a36 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:12.868547 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b6b12-79a5-41fc-95c2-b2cd872b7a36 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:12.868850 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b6b12-79a5-41fc-95c2-b2cd872b7a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:12.892038 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-c23b6b12-79a5-41fc-95c2-b2cd872b7a36 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:12.893385 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c23b6b12-79a5-41fc-95c2-b2cd872b7a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:12.968639 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1446/2872] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:39:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:39:12.977308 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fce25b-5786-4830-830b-6c75f48d013d None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:12.977594 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fce25b-5786-4830-830b-6c75f48d013d None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:12.977867 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fce25b-5786-4830-830b-6c75f48d013d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:12.999358 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-d4fce25b-5786-4830-830b-6c75f48d013d None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:13.000578 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d4fce25b-5786-4830-830b-6c75f48d013d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:13.009530 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1427/2873] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:39:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:39:13.016156 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23b6b12-79a5-41fc-95c2-b2cd872b7a36 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:13.030231 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23b6b12-79a5-41fc-95c2-b2cd872b7a36 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:13.035659 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41674af0-a6f3-4029-80bb-9ed67b0933d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:13.036271 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41674af0-a6f3-4029-80bb-9ed67b0933d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:13.036600 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41674af0-a6f3-4029-80bb-9ed67b0933d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:13.036880 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41674af0-a6f3-4029-80bb-9ed67b0933d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:13.037538 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41674af0-a6f3-4029-80bb-9ed67b0933d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:13.037841 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41674af0-a6f3-4029-80bb-9ed67b0933d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:13.039459 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41674af0-a6f3-4029-80bb-9ed67b0933d3 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:13.052128 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1447/2874] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:39:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:13.056946 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fce25b-5786-4830-830b-6c75f48d013d None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:13.066615 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fce25b-5786-4830-830b-6c75f48d013d None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:13.071737 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b4cf0-d393-4366-9b9e-ba156f8a9892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:13.072364 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b4cf0-d393-4366-9b9e-ba156f8a9892 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:13.072698 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b4cf0-d393-4366-9b9e-ba156f8a9892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:13.072992 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b4cf0-d393-4366-9b9e-ba156f8a9892 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:13.073657 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671b4cf0-d393-4366-9b9e-ba156f8a9892 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:13.075647 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671b4cf0-d393-4366-9b9e-ba156f8a9892 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:13.108138 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1428/2875] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:39:13 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:39:13.112460 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41674af0-a6f3-4029-80bb-9ed67b0933d3 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:13.124177 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41674af0-a6f3-4029-80bb-9ed67b0933d3 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:13.133823 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:13.184692 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3cc2a-a890-4540-907a-f2e261bf7710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:13.185405 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3cc2a-a890-4540-907a-f2e261bf7710 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:13.185574 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3cc2a-a890-4540-907a-f2e261bf7710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:13.185844 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3cc2a-a890-4540-907a-f2e261bf7710 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:13.186495 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb3cc2a-a890-4540-907a-f2e261bf7710 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:13.188419 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb3cc2a-a890-4540-907a-f2e261bf7710 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:13.215533 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1448/2876] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:39:13 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:39:13.219829 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b4cf0-d393-4366-9b9e-ba156f8a9892 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:13.230402 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b4cf0-d393-4366-9b9e-ba156f8a9892 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:13.235101 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7a970-1495-4c03-ad69-de3470ec58c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:13.235719 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7a970-1495-4c03-ad69-de3470ec58c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:13.235993 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7a970-1495-4c03-ad69-de3470ec58c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:13.236261 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7a970-1495-4c03-ad69-de3470ec58c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:13.236954 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a7a970-1495-4c03-ad69-de3470ec58c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:13.238544 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a7a970-1495-4c03-ad69-de3470ec58c1 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:13.248769 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1429/2877] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:39:13.252795 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3cc2a-a890-4540-907a-f2e261bf7710 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:13.263293 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3cc2a-a890-4540-907a-f2e261bf7710 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:13.267930 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9deceb-7672-41fc-917b-ce0021cdfcda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:13.268559 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9deceb-7672-41fc-917b-ce0021cdfcda admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:13.268839 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9deceb-7672-41fc-917b-ce0021cdfcda admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:13.269106 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9deceb-7672-41fc-917b-ce0021cdfcda admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:13.269748 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9deceb-7672-41fc-917b-ce0021cdfcda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:13.271340 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9deceb-7672-41fc-917b-ce0021cdfcda admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:13.282253 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1449/2878] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:39:13.286430 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7a970-1495-4c03-ad69-de3470ec58c1 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:13.297519 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7a970-1495-4c03-ad69-de3470ec58c1 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:13.302585 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33254af0-aaf1-4caf-874d-40bcdd2f5125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:13.303238 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33254af0-aaf1-4caf-874d-40bcdd2f5125 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:13.303503 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33254af0-aaf1-4caf-874d-40bcdd2f5125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:13.303776 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33254af0-aaf1-4caf-874d-40bcdd2f5125 admin admin] PATH_INFO: `/v3/projects/8b1f7ed813db41488915945f758bea94/users/6c8aaac8ddcd4202b5a7039264aaae35/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:13.320261 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33254af0-aaf1-4caf-874d-40bcdd2f5125 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b1f7ed813db41488915945f758bea94, user_id=6c8aaac8ddcd4202b5a7039264aaae35, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:13.323156 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33254af0-aaf1-4caf-874d-40bcdd2f5125 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:13.338739 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1430/2879] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:39:13 2022] PUT /identity/v3/projects/8b1f7ed813db41488915945f758bea94/users/6c8aaac8ddcd4202b5a7039264aaae35/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:39:13.406272 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b40f7-ba66-4eee-bac7-0f7d5133cb2f None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:13.406565 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b40f7-ba66-4eee-bac7-0f7d5133cb2f None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:13.406806 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b40f7-ba66-4eee-bac7-0f7d5133cb2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:13.436818 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-317b40f7-ba66-4eee-bac7-0f7d5133cb2f None None] MFA Rules not processed for user `6c8aaac8ddcd4202b5a7039264aaae35`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:13.438016 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-317b40f7-ba66-4eee-bac7-0f7d5133cb2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:13.515346 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1450/2880] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:39:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:39:13.521704 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33254af0-aaf1-4caf-874d-40bcdd2f5125 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:13.555142 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:13.592422 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33254af0-aaf1-4caf-874d-40bcdd2f5125 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:13.597747 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23d05a-a4b8-42e0-96fc-7a5bb30d2208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:13.598364 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23d05a-a4b8-42e0-96fc-7a5bb30d2208 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:13.598636 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23d05a-a4b8-42e0-96fc-7a5bb30d2208 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:13.598904 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23d05a-a4b8-42e0-96fc-7a5bb30d2208 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:13.599543 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea23d05a-a4b8-42e0-96fc-7a5bb30d2208 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:13.601507 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea23d05a-a4b8-42e0-96fc-7a5bb30d2208 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:13.633031 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1431/2881] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:39:13 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:39:13.639276 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b40f7-ba66-4eee-bac7-0f7d5133cb2f None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:13.650190 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b40f7-ba66-4eee-bac7-0f7d5133cb2f None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:13.706477 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3252367-4055-4118-9bd4-cd69a6861649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:13.707091 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3252367-4055-4118-9bd4-cd69a6861649 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:13.707369 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3252367-4055-4118-9bd4-cd69a6861649 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:13.707645 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3252367-4055-4118-9bd4-cd69a6861649 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:13.708277 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3252367-4055-4118-9bd4-cd69a6861649 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:13.710234 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3252367-4055-4118-9bd4-cd69a6861649 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:13.741042 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1451/2882] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:39:13 2022] POST /identity/v3/users => generated 298 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:39:13.745603 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23d05a-a4b8-42e0-96fc-7a5bb30d2208 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:13.756841 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23d05a-a4b8-42e0-96fc-7a5bb30d2208 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:13.762590 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f2cde-a97c-4df8-bdb9-607812053419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:13.763209 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f2cde-a97c-4df8-bdb9-607812053419 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:13.763486 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f2cde-a97c-4df8-bdb9-607812053419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:13.763759 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f2cde-a97c-4df8-bdb9-607812053419 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:13.764431 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f2cde-a97c-4df8-bdb9-607812053419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:13.766105 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f2cde-a97c-4df8-bdb9-607812053419 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:13.777457 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1432/2883] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:39:13.782507 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3252367-4055-4118-9bd4-cd69a6861649 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:13.796254 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3252367-4055-4118-9bd4-cd69a6861649 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:13.803788 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe9962e-4a52-4dcb-b786-a0f55fabe7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:13.804802 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9962e-4a52-4dcb-b786-a0f55fabe7dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:13.805230 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9962e-4a52-4dcb-b786-a0f55fabe7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:13.805497 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9962e-4a52-4dcb-b786-a0f55fabe7dd admin admin] PATH_INFO: `/v3/projects/cdfe328362f4415baed9c99e8fcf888f/users/7f7db0d35afe40c899e98398e65079c3/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:13.815326 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:13.823619 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe9962e-4a52-4dcb-b786-a0f55fabe7dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdfe328362f4415baed9c99e8fcf888f, user_id=7f7db0d35afe40c899e98398e65079c3, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:13.826537 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe9962e-4a52-4dcb-b786-a0f55fabe7dd admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:13.840916 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1452/2884] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:39:13 2022] PUT /identity/v3/projects/cdfe328362f4415baed9c99e8fcf888f/users/7f7db0d35afe40c899e98398e65079c3/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:39:13.845139 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f2cde-a97c-4df8-bdb9-607812053419 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:13.856552 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f2cde-a97c-4df8-bdb9-607812053419 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:13.914239 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824f163e-5930-4b1a-bdb1-f0219ad7323d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:13.914855 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f163e-5930-4b1a-bdb1-f0219ad7323d admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:13.915136 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f163e-5930-4b1a-bdb1-f0219ad7323d admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:13.915405 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f163e-5930-4b1a-bdb1-f0219ad7323d admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:13.916066 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824f163e-5930-4b1a-bdb1-f0219ad7323d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:13.917901 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824f163e-5930-4b1a-bdb1-f0219ad7323d admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:13.928679 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1433/2885] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:39:13.934084 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe9962e-4a52-4dcb-b786-a0f55fabe7dd admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:13.945878 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe9962e-4a52-4dcb-b786-a0f55fabe7dd admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:13.952110 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ad557-b980-4742-843c-c4c8c3178f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:13.952868 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ad557-b980-4742-843c-c4c8c3178f0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:13.953145 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ad557-b980-4742-843c-c4c8c3178f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:13.953413 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ad557-b980-4742-843c-c4c8c3178f0f admin admin] PATH_INFO: `/v3/projects/cdfe328362f4415baed9c99e8fcf888f/users/7f7db0d35afe40c899e98398e65079c3/roles/ff59a239a50b4bd899a83bf3c3fd1f63` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:13.955540 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331ad557-b980-4742-843c-c4c8c3178f0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdfe328362f4415baed9c99e8fcf888f, user_id=7f7db0d35afe40c899e98398e65079c3, role_id=ff59a239a50b4bd899a83bf3c3fd1f63)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:13.958346 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331ad557-b980-4742-843c-c4c8c3178f0f admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:13.970299 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1453/2886] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:39:13 2022] PUT /identity/v3/projects/cdfe328362f4415baed9c99e8fcf888f/users/7f7db0d35afe40c899e98398e65079c3/roles/ff59a239a50b4bd899a83bf3c3fd1f63 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:39:13.980753 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a0d10-f543-4f5b-9ae0-f5ddbe8d14b2 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:13.981047 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a0d10-f543-4f5b-9ae0-f5ddbe8d14b2 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:13.981327 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a0d10-f543-4f5b-9ae0-f5ddbe8d14b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:14.012853 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-292a0d10-f543-4f5b-9ae0-f5ddbe8d14b2 None None] MFA Rules not processed for user `7f7db0d35afe40c899e98398e65079c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:14.014065 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-292a0d10-f543-4f5b-9ae0-f5ddbe8d14b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:14.091409 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1434/2887] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:39:13 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:39:14.104359 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ad557-b980-4742-843c-c4c8c3178f0f admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:14.106658 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-331ad557-b980-4742-843c-c4c8c3178f0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:14.166777 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ad557-b980-4742-843c-c4c8c3178f0f admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:14.172597 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f1301-3c4b-4cb4-b9c8-4828b19da1af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:14.173539 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f1301-3c4b-4cb4-b9c8-4828b19da1af service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:14.173899 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f1301-3c4b-4cb4-b9c8-4828b19da1af service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:14.174272 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f1301-3c4b-4cb4-b9c8-4828b19da1af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:14.188360 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6f1301-3c4b-4cb4-b9c8-4828b19da1af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:14.189851 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6f1301-3c4b-4cb4-b9c8-4828b19da1af service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:14.200072 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1454/2888] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:39:14 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:39:14.289609 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a0d10-f543-4f5b-9ae0-f5ddbe8d14b2 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:14.301080 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a0d10-f543-4f5b-9ae0-f5ddbe8d14b2 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:14.305602 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74bd6af-38a2-4aeb-ab60-7c56fec93e99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:14.306241 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74bd6af-38a2-4aeb-ab60-7c56fec93e99 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:14.306522 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74bd6af-38a2-4aeb-ab60-7c56fec93e99 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:14.306825 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74bd6af-38a2-4aeb-ab60-7c56fec93e99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:14.328554 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:14.367410 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74bd6af-38a2-4aeb-ab60-7c56fec93e99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:14.368792 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74bd6af-38a2-4aeb-ab60-7c56fec93e99 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:14.378483 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1435/2889] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:39:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:39:14.704542 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f1301-3c4b-4cb4-b9c8-4828b19da1af service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:14.776430 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f1301-3c4b-4cb4-b9c8-4828b19da1af service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:14.781931 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af860e-48f7-4e4b-8cf7-888b429dd656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:14.782716 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af860e-48f7-4e4b-8cf7-888b429dd656 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:14.783004 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af860e-48f7-4e4b-8cf7-888b429dd656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:14.783256 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af860e-48f7-4e4b-8cf7-888b429dd656 admin admin] PATH_INFO: `/v3/users/6c8aaac8ddcd4202b5a7039264aaae35` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:14.784520 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55af860e-48f7-4e4b-8cf7-888b429dd656 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c8aaac8ddcd4202b5a7039264aaae35)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:14.786524 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55af860e-48f7-4e4b-8cf7-888b429dd656 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:14.837397 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-55af860e-48f7-4e4b-8cf7-888b429dd656 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c8aaac8ddcd4202b5a7039264aaae35'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:14.847082 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-55af860e-48f7-4e4b-8cf7-888b429dd656 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c8aaac8ddcd4202b5a7039264aaae35'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:14.857775 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-55af860e-48f7-4e4b-8cf7-888b429dd656 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c8aaac8ddcd4202b5a7039264aaae35'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:14.858524 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-55af860e-48f7-4e4b-8cf7-888b429dd656 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c8aaac8ddcd4202b5a7039264aaae35'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:14.870610 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:14.872440 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-55af860e-48f7-4e4b-8cf7-888b429dd656 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c8aaac8ddcd4202b5a7039264aaae35'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:14.880813 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1455/2890] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:39:14 2022] DELETE /identity/v3/users/6c8aaac8ddcd4202b5a7039264aaae35 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:39:14.885917 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7542d-ed02-418c-9608-849dfe07e374 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:14.886337 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7542d-ed02-418c-9608-849dfe07e374 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:14.886621 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7542d-ed02-418c-9608-849dfe07e374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:14.909191 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-e1c7542d-ed02-418c-9608-849dfe07e374 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:14.910478 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-e1c7542d-ed02-418c-9608-849dfe07e374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:14.982170 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1436/2891] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:39:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:39:14.993030 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af860e-48f7-4e4b-8cf7-888b429dd656 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:14.995911 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-55af860e-48f7-4e4b-8cf7-888b429dd656 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:15.064217 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af860e-48f7-4e4b-8cf7-888b429dd656 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:15.069066 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ec9102-cce8-4994-b47a-2f4e977fdd3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:15.069230 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec9102-cce8-4994-b47a-2f4e977fdd3e service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:15.069445 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec9102-cce8-4994-b47a-2f4e977fdd3e service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:15.069721 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec9102-cce8-4994-b47a-2f4e977fdd3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:15.079857 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ec9102-cce8-4994-b47a-2f4e977fdd3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:15.081340 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ec9102-cce8-4994-b47a-2f4e977fdd3e service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:15.092947 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1456/2892] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:39:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:39:15.405911 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c7542d-ed02-418c-9608-849dfe07e374 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:15.407365 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-e1c7542d-ed02-418c-9608-849dfe07e374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:15.421638 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c7542d-ed02-418c-9608-849dfe07e374 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:15.426720 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515365e5-c448-4fc4-b26f-9b4688420e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:15.427406 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515365e5-c448-4fc4-b26f-9b4688420e2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:15.427677 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515365e5-c448-4fc4-b26f-9b4688420e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:15.427945 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515365e5-c448-4fc4-b26f-9b4688420e2d admin admin] PATH_INFO: `/v3/projects/8b1f7ed813db41488915945f758bea94` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:15.429120 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515365e5-c448-4fc4-b26f-9b4688420e2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b1f7ed813db41488915945f758bea94)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:15.431111 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515365e5-c448-4fc4-b26f-9b4688420e2d admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:15.480879 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-515365e5-c448-4fc4-b26f-9b4688420e2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b1f7ed813db41488915945f758bea94', 'request_id': 'req-515365e5-c448-4fc4-b26f-9b4688420e2d'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:15.487174 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-515365e5-c448-4fc4-b26f-9b4688420e2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b1f7ed813db41488915945f758bea94', 'request_id': 'req-515365e5-c448-4fc4-b26f-9b4688420e2d'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:15.495949 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-515365e5-c448-4fc4-b26f-9b4688420e2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b1f7ed813db41488915945f758bea94', 'request_id': 'req-515365e5-c448-4fc4-b26f-9b4688420e2d'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:15.507199 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-515365e5-c448-4fc4-b26f-9b4688420e2d admin admin] The token cache is being invalidate because project 8b1f7ed813db41488915945f758bea94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:39:15.507509 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-515365e5-c448-4fc4-b26f-9b4688420e2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:15.508133 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-515365e5-c448-4fc4-b26f-9b4688420e2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:15.510108 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1437/2893] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:39:15 2022] DELETE /identity/v3/projects/8b1f7ed813db41488915945f758bea94 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:39:15.514422 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ec9102-cce8-4994-b47a-2f4e977fdd3e service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:15.524630 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ec9102-cce8-4994-b47a-2f4e977fdd3e service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:15.587970 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e483c95c-1e1b-43f0-a192-c190a90bd1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:15.589172 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483c95c-1e1b-43f0-a192-c190a90bd1f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:15.589476 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483c95c-1e1b-43f0-a192-c190a90bd1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:15.589766 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483c95c-1e1b-43f0-a192-c190a90bd1f5 admin admin] PATH_INFO: `/v3/users/7f7db0d35afe40c899e98398e65079c3` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:15.591010 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e483c95c-1e1b-43f0-a192-c190a90bd1f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f7db0d35afe40c899e98398e65079c3)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:15.593013 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e483c95c-1e1b-43f0-a192-c190a90bd1f5 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:15.655194 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e483c95c-1e1b-43f0-a192-c190a90bd1f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f7db0d35afe40c899e98398e65079c3'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:15.666002 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e483c95c-1e1b-43f0-a192-c190a90bd1f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f7db0d35afe40c899e98398e65079c3'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:15.674028 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e483c95c-1e1b-43f0-a192-c190a90bd1f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f7db0d35afe40c899e98398e65079c3'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:15.674699 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e483c95c-1e1b-43f0-a192-c190a90bd1f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f7db0d35afe40c899e98398e65079c3'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:15.687274 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e483c95c-1e1b-43f0-a192-c190a90bd1f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f7db0d35afe40c899e98398e65079c3'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:15.693197 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1457/2894] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:39:15 2022] DELETE /identity/v3/users/7f7db0d35afe40c899e98398e65079c3 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:39:15.987013 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515365e5-c448-4fc4-b26f-9b4688420e2d admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:15.988515 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-515365e5-c448-4fc4-b26f-9b4688420e2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:16.006871 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515365e5-c448-4fc4-b26f-9b4688420e2d admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:16.052394 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:16.066968 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c73d469-539f-4483-b488-d4c1dff1ae0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:16.067604 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73d469-539f-4483-b488-d4c1dff1ae0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:16.067878 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73d469-539f-4483-b488-d4c1dff1ae0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:16.068148 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73d469-539f-4483-b488-d4c1dff1ae0c admin admin] PATH_INFO: `/v3/projects/cdfe328362f4415baed9c99e8fcf888f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:16.069316 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c73d469-539f-4483-b488-d4c1dff1ae0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdfe328362f4415baed9c99e8fcf888f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:16.071242 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c73d469-539f-4483-b488-d4c1dff1ae0c admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:16.116958 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-1c73d469-539f-4483-b488-d4c1dff1ae0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdfe328362f4415baed9c99e8fcf888f', 'request_id': 'req-1c73d469-539f-4483-b488-d4c1dff1ae0c'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:16.123344 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-1c73d469-539f-4483-b488-d4c1dff1ae0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdfe328362f4415baed9c99e8fcf888f', 'request_id': 'req-1c73d469-539f-4483-b488-d4c1dff1ae0c'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:16.132187 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-1c73d469-539f-4483-b488-d4c1dff1ae0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdfe328362f4415baed9c99e8fcf888f', 'request_id': 'req-1c73d469-539f-4483-b488-d4c1dff1ae0c'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:16.142751 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-1c73d469-539f-4483-b488-d4c1dff1ae0c admin admin] The token cache is being invalidate because project cdfe328362f4415baed9c99e8fcf888f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:39:16.143031 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-1c73d469-539f-4483-b488-d4c1dff1ae0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:16.143677 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-1c73d469-539f-4483-b488-d4c1dff1ae0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:16.145276 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1438/2895] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:39:15 2022] DELETE /identity/v3/projects/cdfe328362f4415baed9c99e8fcf888f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:39:16.151653 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9f979-b0d0-4ea0-83a8-e9dbfd0cd057 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:16.151975 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9f979-b0d0-4ea0-83a8-e9dbfd0cd057 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:16.152275 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9f979-b0d0-4ea0-83a8-e9dbfd0cd057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:16.173414 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-3ad9f979-b0d0-4ea0-83a8-e9dbfd0cd057 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:16.174548 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3ad9f979-b0d0-4ea0-83a8-e9dbfd0cd057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:16.187637 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:16.240505 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1458/2896] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:39:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:39:16.248812 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9cbaf5-f562-4eba-8750-5e0708562ae9 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:16.249100 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9cbaf5-f562-4eba-8750-5e0708562ae9 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:16.249372 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9cbaf5-f562-4eba-8750-5e0708562ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:16.271339 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-3d9cbaf5-f562-4eba-8750-5e0708562ae9 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:16.272627 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-3d9cbaf5-f562-4eba-8750-5e0708562ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:16.281924 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1439/2897] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:39:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:39:16.287316 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9f979-b0d0-4ea0-83a8-e9dbfd0cd057 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:16.299669 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9f979-b0d0-4ea0-83a8-e9dbfd0cd057 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:16.305924 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f220bd-b282-4ccf-a7d6-13f8e7ed11df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:16.306545 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f220bd-b282-4ccf-a7d6-13f8e7ed11df admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:16.306826 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f220bd-b282-4ccf-a7d6-13f8e7ed11df admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:16.307159 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f220bd-b282-4ccf-a7d6-13f8e7ed11df admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:16.307890 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f220bd-b282-4ccf-a7d6-13f8e7ed11df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:16.308220 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f220bd-b282-4ccf-a7d6-13f8e7ed11df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:16.309849 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f220bd-b282-4ccf-a7d6-13f8e7ed11df admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:16.323409 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1459/2898] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:39:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:16.328124 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9cbaf5-f562-4eba-8750-5e0708562ae9 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:16.338254 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9cbaf5-f562-4eba-8750-5e0708562ae9 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:16.345548 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ff970-b208-4916-8b6e-09d9ada2cce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:16.346469 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ff970-b208-4916-8b6e-09d9ada2cce0 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:16.346910 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ff970-b208-4916-8b6e-09d9ada2cce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:16.347332 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ff970-b208-4916-8b6e-09d9ada2cce0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:16.348434 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72ff970-b208-4916-8b6e-09d9ada2cce0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:16.351488 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72ff970-b208-4916-8b6e-09d9ada2cce0 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:16.385478 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1440/2899] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:39:16 2022] POST /identity/v3/projects => generated 369 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:39:16.391270 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f220bd-b282-4ccf-a7d6-13f8e7ed11df admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:16.406250 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f220bd-b282-4ccf-a7d6-13f8e7ed11df admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:16.474075 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf4650-2b70-46ca-a23f-b97edc9e4d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:16.474592 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf4650-2b70-46ca-a23f-b97edc9e4d83 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:16.474870 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf4650-2b70-46ca-a23f-b97edc9e4d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:16.475157 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf4650-2b70-46ca-a23f-b97edc9e4d83 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:16.475798 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bf4650-2b70-46ca-a23f-b97edc9e4d83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:16.477764 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bf4650-2b70-46ca-a23f-b97edc9e4d83 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:16.500127 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1460/2900] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:39:16 2022] POST /identity/v3/users => generated 285 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:39:16.506356 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ff970-b208-4916-8b6e-09d9ada2cce0 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:16.519145 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ff970-b208-4916-8b6e-09d9ada2cce0 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:16.525201 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9211e86b-c6d1-451b-9855-f563f0ccf1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:16.525880 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211e86b-c6d1-451b-9855-f563f0ccf1ed admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:16.526092 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211e86b-c6d1-451b-9855-f563f0ccf1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:16.526381 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211e86b-c6d1-451b-9855-f563f0ccf1ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:16.527008 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9211e86b-c6d1-451b-9855-f563f0ccf1ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:16.528706 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9211e86b-c6d1-451b-9855-f563f0ccf1ed admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:16.539490 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1441/2901] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:39:16.543878 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf4650-2b70-46ca-a23f-b97edc9e4d83 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:16.557121 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf4650-2b70-46ca-a23f-b97edc9e4d83 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:16.562790 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbdcd23-e438-437d-8f76-d4168cdfa8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:16.563409 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbdcd23-e438-437d-8f76-d4168cdfa8be admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:16.563688 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbdcd23-e438-437d-8f76-d4168cdfa8be admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:16.563956 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbdcd23-e438-437d-8f76-d4168cdfa8be admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:16.564654 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbdcd23-e438-437d-8f76-d4168cdfa8be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:16.566348 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbdcd23-e438-437d-8f76-d4168cdfa8be admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:16.579362 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1461/2902] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:39:16.583900 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9211e86b-c6d1-451b-9855-f563f0ccf1ed admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:16.594723 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9211e86b-c6d1-451b-9855-f563f0ccf1ed admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:16.600778 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a734ab-5e1d-4266-a605-c936e0cfb9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:16.601485 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a734ab-5e1d-4266-a605-c936e0cfb9ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:16.601793 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a734ab-5e1d-4266-a605-c936e0cfb9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:16.602067 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a734ab-5e1d-4266-a605-c936e0cfb9ed admin admin] PATH_INFO: `/v3/projects/39696d70284a4ae0b78d2695fe8e19af/users/f884496569264f9b9e45ca5cc199626f/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:16.623759 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a734ab-5e1d-4266-a605-c936e0cfb9ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=39696d70284a4ae0b78d2695fe8e19af, user_id=f884496569264f9b9e45ca5cc199626f, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:16.626660 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a734ab-5e1d-4266-a605-c936e0cfb9ed admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:16.644192 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1442/2903] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:39:16 2022] PUT /identity/v3/projects/39696d70284a4ae0b78d2695fe8e19af/users/f884496569264f9b9e45ca5cc199626f/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:39:16.658427 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9863a6-4884-4101-b42f-eff7b8397386 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:16.658726 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9863a6-4884-4101-b42f-eff7b8397386 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:16.659003 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9863a6-4884-4101-b42f-eff7b8397386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:16.689561 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-3c9863a6-4884-4101-b42f-eff7b8397386 None None] MFA Rules not processed for user `f884496569264f9b9e45ca5cc199626f`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:16.690781 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3c9863a6-4884-4101-b42f-eff7b8397386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:16.756549 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1462/2904] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:39:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:39:16.769345 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a734ab-5e1d-4266-a605-c936e0cfb9ed admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:16.771292 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-69a734ab-5e1d-4266-a605-c936e0cfb9ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:16.871425 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a734ab-5e1d-4266-a605-c936e0cfb9ed admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:16.875777 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443cdff9-1033-4523-bc12-b80d79f7dfaa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a399ee5db44100a88a4ffb451512aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:16.876487 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443cdff9-1033-4523-bc12-b80d79f7dfaa service glance] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:16.876785 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443cdff9-1033-4523-bc12-b80d79f7dfaa service glance] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:16.877062 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443cdff9-1033-4523-bc12-b80d79f7dfaa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:16.884594 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:16.887742 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443cdff9-1033-4523-bc12-b80d79f7dfaa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:16.889216 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443cdff9-1033-4523-bc12-b80d79f7dfaa service glance] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:16.899494 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1443/2905] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:39:16 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:39:26.753430 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=91,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:26.902909 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:37.823611 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9863a6-4884-4101-b42f-eff7b8397386 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:37.895838 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9863a6-4884-4101-b42f-eff7b8397386 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:37.900480 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3431c5c9-2871-4186-b162-11de8a183764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:37.901123 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431c5c9-2871-4186-b162-11de8a183764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:37.901406 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431c5c9-2871-4186-b162-11de8a183764 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:37.901707 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431c5c9-2871-4186-b162-11de8a183764 admin admin] PATH_INFO: `/v3/users/f884496569264f9b9e45ca5cc199626f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:37.902918 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3431c5c9-2871-4186-b162-11de8a183764 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f884496569264f9b9e45ca5cc199626f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:37.904917 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3431c5c9-2871-4186-b162-11de8a183764 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:37.951678 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-3431c5c9-2871-4186-b162-11de8a183764 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f884496569264f9b9e45ca5cc199626f'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:37.963536 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-3431c5c9-2871-4186-b162-11de8a183764 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f884496569264f9b9e45ca5cc199626f'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:37.970707 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-3431c5c9-2871-4186-b162-11de8a183764 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f884496569264f9b9e45ca5cc199626f'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:37.971328 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-3431c5c9-2871-4186-b162-11de8a183764 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f884496569264f9b9e45ca5cc199626f'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:37.983107 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-3431c5c9-2871-4186-b162-11de8a183764 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f884496569264f9b9e45ca5cc199626f'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:37.989395 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1463/2906] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:39:37 2022] DELETE /identity/v3/users/f884496569264f9b9e45ca5cc199626f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:39:37.994276 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79409841-1360-4a08-ae02-70b1ec94613e None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:37.994794 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79409841-1360-4a08-ae02-70b1ec94613e None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:37.994915 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79409841-1360-4a08-ae02-70b1ec94613e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:38.014823 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-79409841-1360-4a08-ae02-70b1ec94613e None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:38.016025 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-79409841-1360-4a08-ae02-70b1ec94613e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:38.081981 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1444/2907] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:39:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:39:38.092100 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3431c5c9-2871-4186-b162-11de8a183764 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:38.093646 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3431c5c9-2871-4186-b162-11de8a183764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:38.165819 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3431c5c9-2871-4186-b162-11de8a183764 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:38.170246 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb53c3f-c00a-466a-8f67-a95e26ab0733 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:38.170872 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb53c3f-c00a-466a-8f67-a95e26ab0733 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:38.171155 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb53c3f-c00a-466a-8f67-a95e26ab0733 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:38.171430 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb53c3f-c00a-466a-8f67-a95e26ab0733 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:38.182186 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb53c3f-c00a-466a-8f67-a95e26ab0733 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:38.183724 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb53c3f-c00a-466a-8f67-a95e26ab0733 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:38.196046 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1464/2908] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:39:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:39:38.500915 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79409841-1360-4a08-ae02-70b1ec94613e None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:38.505879 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-79409841-1360-4a08-ae02-70b1ec94613e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:38.520998 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79409841-1360-4a08-ae02-70b1ec94613e None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:38.535075 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1557ba-57a6-419d-860a-11ec52012541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:38.535075 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1557ba-57a6-419d-860a-11ec52012541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:38.535075 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1557ba-57a6-419d-860a-11ec52012541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:38.535075 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1557ba-57a6-419d-860a-11ec52012541 admin admin] PATH_INFO: `/v3/projects/39696d70284a4ae0b78d2695fe8e19af` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:38.536080 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1557ba-57a6-419d-860a-11ec52012541 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39696d70284a4ae0b78d2695fe8e19af)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:38.538145 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1557ba-57a6-419d-860a-11ec52012541 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:38.591957 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-de1557ba-57a6-419d-860a-11ec52012541 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39696d70284a4ae0b78d2695fe8e19af', 'request_id': 'req-de1557ba-57a6-419d-860a-11ec52012541'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:38.599451 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-de1557ba-57a6-419d-860a-11ec52012541 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39696d70284a4ae0b78d2695fe8e19af', 'request_id': 'req-de1557ba-57a6-419d-860a-11ec52012541'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:38.607215 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-de1557ba-57a6-419d-860a-11ec52012541 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39696d70284a4ae0b78d2695fe8e19af', 'request_id': 'req-de1557ba-57a6-419d-860a-11ec52012541'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:38.623914 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-de1557ba-57a6-419d-860a-11ec52012541 admin admin] The token cache is being invalidate because project 39696d70284a4ae0b78d2695fe8e19af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:39:38.624362 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-de1557ba-57a6-419d-860a-11ec52012541 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:38.625486 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-de1557ba-57a6-419d-860a-11ec52012541 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:39:38.629127 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1445/2909] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:39:38 2022] DELETE /identity/v3/projects/39696d70284a4ae0b78d2695fe8e19af => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:39:38.636612 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb9535-d616-4113-9086-0c878c3a478e None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:38.636984 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb9535-d616-4113-9086-0c878c3a478e None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:38.637462 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb9535-d616-4113-9086-0c878c3a478e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:38.660001 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-87bb9535-d616-4113-9086-0c878c3a478e None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:38.661285 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-87bb9535-d616-4113-9086-0c878c3a478e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:38.680498 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:38.729117 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1465/2910] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:39:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:39:38.739895 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab252442-75ab-4284-8873-0f804961093a None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:38.740178 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab252442-75ab-4284-8873-0f804961093a None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:38.740471 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab252442-75ab-4284-8873-0f804961093a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:38.762866 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-ab252442-75ab-4284-8873-0f804961093a None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:38.764102 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ab252442-75ab-4284-8873-0f804961093a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:38.773732 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1446/2911] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:39:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:39:38.778422 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb9535-d616-4113-9086-0c878c3a478e None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:38.789028 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb9535-d616-4113-9086-0c878c3a478e None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:38.794599 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e1029-fe52-4621-afe2-cb731a6a90d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:38.795270 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e1029-fe52-4621-afe2-cb731a6a90d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:38.795551 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e1029-fe52-4621-afe2-cb731a6a90d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:38.795829 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e1029-fe52-4621-afe2-cb731a6a90d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:38.796515 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e1029-fe52-4621-afe2-cb731a6a90d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:38.796875 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e1029-fe52-4621-afe2-cb731a6a90d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:38.798742 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e1029-fe52-4621-afe2-cb731a6a90d2 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:38.812109 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1466/2912] 10.222.0.36 () {58 vars in 1153 bytes} [Mon Aug 29 22:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:38.817125 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab252442-75ab-4284-8873-0f804961093a None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:38.826774 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab252442-75ab-4284-8873-0f804961093a None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:38.832596 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555d021-647b-4777-9acf-7d2f07d37dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:38.833260 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555d021-647b-4777-9acf-7d2f07d37dc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:38.833515 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555d021-647b-4777-9acf-7d2f07d37dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:38.833775 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555d021-647b-4777-9acf-7d2f07d37dc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:38.834446 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b555d021-647b-4777-9acf-7d2f07d37dc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:38.836369 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b555d021-647b-4777-9acf-7d2f07d37dc4 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:38.871436 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1447/2913] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Aug 29 22:39:38 2022] POST /identity/v3/projects => generated 381 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:39:38.875965 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e1029-fe52-4621-afe2-cb731a6a90d2 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:38.890692 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e1029-fe52-4621-afe2-cb731a6a90d2 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:38.951717 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f21846-fe16-431c-a707-a6d62c6d86f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:38.952334 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f21846-fe16-431c-a707-a6d62c6d86f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:38.952647 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f21846-fe16-431c-a707-a6d62c6d86f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:38.952923 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f21846-fe16-431c-a707-a6d62c6d86f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:38.953565 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f21846-fe16-431c-a707-a6d62c6d86f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:38.955599 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f21846-fe16-431c-a707-a6d62c6d86f1 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:38.979535 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1467/2914] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Aug 29 22:39:38 2022] POST /identity/v3/users => generated 291 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:39:38.983779 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555d021-647b-4777-9acf-7d2f07d37dc4 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:38.994645 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555d021-647b-4777-9acf-7d2f07d37dc4 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:39.000515 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bb1cc-79bc-446f-9273-807f4db924fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:39.001204 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bb1cc-79bc-446f-9273-807f4db924fe admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:39.001486 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bb1cc-79bc-446f-9273-807f4db924fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:39.001754 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bb1cc-79bc-446f-9273-807f4db924fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:39.002411 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439bb1cc-79bc-446f-9273-807f4db924fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:39.004025 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439bb1cc-79bc-446f-9273-807f4db924fe admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:39.015180 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1448/2915] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:39:39.019501 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f21846-fe16-431c-a707-a6d62c6d86f1 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:39.030098 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f21846-fe16-431c-a707-a6d62c6d86f1 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:39.035560 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e0d79c-09eb-4f54-bd70-ba8f110aa741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:39.036167 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0d79c-09eb-4f54-bd70-ba8f110aa741 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:39.036506 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0d79c-09eb-4f54-bd70-ba8f110aa741 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:39.036787 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0d79c-09eb-4f54-bd70-ba8f110aa741 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:39.037471 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e0d79c-09eb-4f54-bd70-ba8f110aa741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:39.039075 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e0d79c-09eb-4f54-bd70-ba8f110aa741 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:39.050672 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1468/2916] 10.222.0.36 () {58 vars in 1122 bytes} [Mon Aug 29 22:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:39:39.055137 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bb1cc-79bc-446f-9273-807f4db924fe admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:39.068548 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bb1cc-79bc-446f-9273-807f4db924fe admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:39.074302 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f57222-bd7d-4f96-9199-8386e157ca49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:39.074971 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f57222-bd7d-4f96-9199-8386e157ca49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:39.075290 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f57222-bd7d-4f96-9199-8386e157ca49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:39.075571 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f57222-bd7d-4f96-9199-8386e157ca49 admin admin] PATH_INFO: `/v3/projects/03bf9fa715be4364a6fbe476ef5437e4/users/b8b384111a3442cc9b8ca8f6b67c4161/roles/c358a37c24fe42bca4a93331f2c99d90` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:39.094900 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f57222-bd7d-4f96-9199-8386e157ca49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03bf9fa715be4364a6fbe476ef5437e4, user_id=b8b384111a3442cc9b8ca8f6b67c4161, role_id=c358a37c24fe42bca4a93331f2c99d90)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:39.097659 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f57222-bd7d-4f96-9199-8386e157ca49 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:39.113601 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1449/2917] 10.222.0.36 () {60 vars in 1483 bytes} [Mon Aug 29 22:39:39 2022] PUT /identity/v3/projects/03bf9fa715be4364a6fbe476ef5437e4/users/b8b384111a3442cc9b8ca8f6b67c4161/roles/c358a37c24fe42bca4a93331f2c99d90 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:39:39.118930 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce78a8-4235-4a82-bfd2-6bd79b943283 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:39.119218 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce78a8-4235-4a82-bfd2-6bd79b943283 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:39.119491 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce78a8-4235-4a82-bfd2-6bd79b943283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:39.142113 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-fbce78a8-4235-4a82-bfd2-6bd79b943283 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:39.143228 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-fbce78a8-4235-4a82-bfd2-6bd79b943283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:39.213414 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1469/2918] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:39:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:39:39.223994 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f57222-bd7d-4f96-9199-8386e157ca49 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:39.225953 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-e2f57222-bd7d-4f96-9199-8386e157ca49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:39.249395 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:39.291814 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f57222-bd7d-4f96-9199-8386e157ca49 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:39.296343 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c92f7-9b4c-4dde-b466-a5d9299f9522 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:39.296991 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c92f7-9b4c-4dde-b466-a5d9299f9522 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:39.297273 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c92f7-9b4c-4dde-b466-a5d9299f9522 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:39.297548 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c92f7-9b4c-4dde-b466-a5d9299f9522 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:39.307122 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34c92f7-9b4c-4dde-b466-a5d9299f9522 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:39.308595 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34c92f7-9b4c-4dde-b466-a5d9299f9522 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:39.318872 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1450/2919] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:39:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:39:40.009558 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca70dd-2d08-41fe-8579-f5ca23441771 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:40.010168 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca70dd-2d08-41fe-8579-f5ca23441771 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:40.010168 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca70dd-2d08-41fe-8579-f5ca23441771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:40.040411 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-e5ca70dd-2d08-41fe-8579-f5ca23441771 None None] MFA Rules not processed for user `b8b384111a3442cc9b8ca8f6b67c4161`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:40.041833 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e5ca70dd-2d08-41fe-8579-f5ca23441771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:40.060197 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:40.120845 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1470/2920] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:39:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:39:40.135275 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c92f7-9b4c-4dde-b466-a5d9299f9522 service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:40.137343 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d34c92f7-9b4c-4dde-b466-a5d9299f9522 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:40.212275 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c92f7-9b4c-4dde-b466-a5d9299f9522 service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:40.216602 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d5bbc-73f6-4889-83f5-f84d4d4d4543 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14db90aa108495e9c48584cdc2f7206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:40.217241 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d5bbc-73f6-4889-83f5-f84d4d4d4543 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:40.217521 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d5bbc-73f6-4889-83f5-f84d4d4d4543 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:40.217788 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d5bbc-73f6-4889-83f5-f84d4d4d4543 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:40.227100 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d5bbc-73f6-4889-83f5-f84d4d4d4543 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:40.228585 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d5bbc-73f6-4889-83f5-f84d4d4d4543 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:40.237650 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1451/2921] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:39:40 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:39:41.630838 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3798e8f-ae18-44bf-babd-2d14a3e5ce43 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:41.631454 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3798e8f-ae18-44bf-babd-2d14a3e5ce43 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:41.631454 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3798e8f-ae18-44bf-babd-2d14a3e5ce43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:41.652138 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-c3798e8f-ae18-44bf-babd-2d14a3e5ce43 None None] MFA Rules not processed for user `b8b384111a3442cc9b8ca8f6b67c4161`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:41.653433 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c3798e8f-ae18-44bf-babd-2d14a3e5ce43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:41.660849 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1471/2922] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:39:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:39:41.918593 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d5bbc-73f6-4889-83f5-f84d4d4d4543 service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:41.929072 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d5bbc-73f6-4889-83f5-f84d4d4d4543 service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:41.933071 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2084026-9276-4d39-bb53-29f0d9fac3ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '204c597d751c420796bd972f10a3d149', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:41.933678 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2084026-9276-4d39-bb53-29f0d9fac3ec service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:41.934053 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2084026-9276-4d39-bb53-29f0d9fac3ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:41.934234 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2084026-9276-4d39-bb53-29f0d9fac3ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:41.936188 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b2084026-9276-4d39-bb53-29f0d9fac3ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:41.947150 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2084026-9276-4d39-bb53-29f0d9fac3ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:41.948630 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2084026-9276-4d39-bb53-29f0d9fac3ec service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:41.957814 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1452/2923] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:39:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:39:42.317319 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3798e8f-ae18-44bf-babd-2d14a3e5ce43 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:42.318953 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c3798e8f-ae18-44bf-babd-2d14a3e5ce43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:42.416053 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3798e8f-ae18-44bf-babd-2d14a3e5ce43 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:42.422762 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9236d5a9-ff09-4c8f-8324-ea8c6fd9c10d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce3d9397cca4ae58e14c8a5ae844f8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:42.423687 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236d5a9-ff09-4c8f-8324-ea8c6fd9c10d service placement] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:42.423981 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236d5a9-ff09-4c8f-8324-ea8c6fd9c10d service placement] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:42.424261 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236d5a9-ff09-4c8f-8324-ea8c6fd9c10d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:42.426248 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-9236d5a9-ff09-4c8f-8324-ea8c6fd9c10d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:42.442838 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9236d5a9-ff09-4c8f-8324-ea8c6fd9c10d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:42.444495 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9236d5a9-ff09-4c8f-8324-ea8c6fd9c10d service placement] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:42.455921 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1472/2924] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:39:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:39:49.837237 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2084026-9276-4d39-bb53-29f0d9fac3ec service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:49.840128 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b2084026-9276-4d39-bb53-29f0d9fac3ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:49.945361 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2084026-9276-4d39-bb53-29f0d9fac3ec service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:49.950935 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e312592-6c9a-4959-b4a7-1a7008165fe9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b7213b7111456a93e294ce40b95b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:49.951627 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e312592-6c9a-4959-b4a7-1a7008165fe9 service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:49.951924 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e312592-6c9a-4959-b4a7-1a7008165fe9 service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:49.952286 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e312592-6c9a-4959-b4a7-1a7008165fe9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:49.954215 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-4e312592-6c9a-4959-b4a7-1a7008165fe9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:49.968927 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e312592-6c9a-4959-b4a7-1a7008165fe9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:49.970567 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e312592-6c9a-4959-b4a7-1a7008165fe9 service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:49.984418 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1453/2925] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:39:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:39:52.450548 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=54 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:59.977459 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=83 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:40:09.157894 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1da26-4cab-420e-9c7b-f4219c2d2bf0 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:09.158841 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1da26-4cab-420e-9c7b-f4219c2d2bf0 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:09.158841 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1da26-4cab-420e-9c7b-f4219c2d2bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:09.183822 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-afd1da26-4cab-420e-9c7b-f4219c2d2bf0 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:40:09.185066 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-afd1da26-4cab-420e-9c7b-f4219c2d2bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:40:09.194518 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1473/2926] 10.222.0.48 () {58 vars in 1016 bytes} [Mon Aug 29 22:40:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:40:09.212764 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e312592-6c9a-4959-b4a7-1a7008165fe9 service nova] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:40:09.224483 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e312592-6c9a-4959-b4a7-1a7008165fe9 service nova] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:40:09.230627 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f4752-a5df-40d8-a088-fd9b8f981145 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b7213b7111456a93e294ce40b95b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:40:09.231241 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f4752-a5df-40d8-a088-fd9b8f981145 service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:09.231519 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f4752-a5df-40d8-a088-fd9b8f981145 service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:09.231789 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f4752-a5df-40d8-a088-fd9b8f981145 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:09.240703 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9f4752-a5df-40d8-a088-fd9b8f981145 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:40:09.242275 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9f4752-a5df-40d8-a088-fd9b8f981145 service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:40:09.256619 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1454/2927] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:40:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:40:12.231883 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe85e5-6236-4b3c-8647-1e64847c52a2 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:12.232777 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe85e5-6236-4b3c-8647-1e64847c52a2 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:12.232777 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe85e5-6236-4b3c-8647-1e64847c52a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:12.262024 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-ccfe85e5-6236-4b3c-8647-1e64847c52a2 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:40:12.263280 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-ccfe85e5-6236-4b3c-8647-1e64847c52a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:40:12.273286 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1474/2928] 10.222.0.48 () {58 vars in 1016 bytes} [Mon Aug 29 22:40:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:40:12.289340 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f4752-a5df-40d8-a088-fd9b8f981145 service nova] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:40:12.290901 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-bf9f4752-a5df-40d8-a088-fd9b8f981145 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:40:12.306172 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f4752-a5df-40d8-a088-fd9b8f981145 service nova] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:40:12.312273 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce60c6-ce9c-470a-901f-b3bd8f572163 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b7213b7111456a93e294ce40b95b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:40:12.312915 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce60c6-ce9c-470a-901f-b3bd8f572163 service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:12.313194 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce60c6-ce9c-470a-901f-b3bd8f572163 service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:12.313469 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce60c6-ce9c-470a-901f-b3bd8f572163 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:12.322510 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ce60c6-ce9c-470a-901f-b3bd8f572163 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:40:12.324127 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ce60c6-ce9c-470a-901f-b3bd8f572163 service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:40:12.334311 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1455/2929] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:40:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:40:15.507713 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b6989-249b-437f-8a57-9a9acdc180f5 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:15.508297 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b6989-249b-437f-8a57-9a9acdc180f5 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:15.508297 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b6989-249b-437f-8a57-9a9acdc180f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:15.529270 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-869b6989-249b-437f-8a57-9a9acdc180f5 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:40:15.530469 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-869b6989-249b-437f-8a57-9a9acdc180f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:40:15.539561 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1475/2930] 10.222.0.48 () {58 vars in 1016 bytes} [Mon Aug 29 22:40:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:40:15.555091 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce60c6-ce9c-470a-901f-b3bd8f572163 service nova] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:40:15.567679 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce60c6-ce9c-470a-901f-b3bd8f572163 service nova] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:40:15.574642 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba665a6-30c7-485f-82ae-1f74a9a487c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b7213b7111456a93e294ce40b95b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:40:15.575251 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba665a6-30c7-485f-82ae-1f74a9a487c9 service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:15.575534 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba665a6-30c7-485f-82ae-1f74a9a487c9 service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:15.575810 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba665a6-30c7-485f-82ae-1f74a9a487c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:15.584835 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba665a6-30c7-485f-82ae-1f74a9a487c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:40:15.586434 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba665a6-30c7-485f-82ae-1f74a9a487c9 service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:40:15.596568 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1456/2931] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:40:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:40:18.607732 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fdeecd-9a5b-404f-8fe9-3e077d6e0eb7 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:18.608281 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fdeecd-9a5b-404f-8fe9-3e077d6e0eb7 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:18.608281 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fdeecd-9a5b-404f-8fe9-3e077d6e0eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:18.634786 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-c0fdeecd-9a5b-404f-8fe9-3e077d6e0eb7 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:40:18.636039 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c0fdeecd-9a5b-404f-8fe9-3e077d6e0eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:40:18.646203 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1476/2932] 10.222.0.48 () {58 vars in 1016 bytes} [Mon Aug 29 22:40:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:40:18.663681 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba665a6-30c7-485f-82ae-1f74a9a487c9 service nova] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:40:18.676136 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba665a6-30c7-485f-82ae-1f74a9a487c9 service nova] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:40:18.683860 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c4b82-8b1f-4f89-b30a-ecd69bb1d856 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b7213b7111456a93e294ce40b95b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:40:18.684486 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c4b82-8b1f-4f89-b30a-ecd69bb1d856 service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:18.684793 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c4b82-8b1f-4f89-b30a-ecd69bb1d856 service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:18.685069 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c4b82-8b1f-4f89-b30a-ecd69bb1d856 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:18.694527 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7c4b82-8b1f-4f89-b30a-ecd69bb1d856 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:40:18.696146 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7c4b82-8b1f-4f89-b30a-ecd69bb1d856 service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:40:18.709588 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1457/2933] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:40:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:40:21.816252 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344740c-7031-4f03-acf4-293248c7d4b6 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:21.816838 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344740c-7031-4f03-acf4-293248c7d4b6 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:21.816965 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344740c-7031-4f03-acf4-293248c7d4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:21.842472 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-1344740c-7031-4f03-acf4-293248c7d4b6 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:40:21.843815 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-1344740c-7031-4f03-acf4-293248c7d4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:40:21.858313 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1477/2934] 10.222.0.48 () {58 vars in 1016 bytes} [Mon Aug 29 22:40:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:40:21.887307 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c4b82-8b1f-4f89-b30a-ecd69bb1d856 service nova] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:40:21.901104 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c4b82-8b1f-4f89-b30a-ecd69bb1d856 service nova] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:40:21.908399 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0226be0-5b06-4898-8874-1bed1a30bdde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b7213b7111456a93e294ce40b95b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:40:21.909103 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0226be0-5b06-4898-8874-1bed1a30bdde service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:21.909380 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0226be0-5b06-4898-8874-1bed1a30bdde service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:21.909659 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0226be0-5b06-4898-8874-1bed1a30bdde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:21.921634 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0226be0-5b06-4898-8874-1bed1a30bdde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:40:21.923435 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0226be0-5b06-4898-8874-1bed1a30bdde service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:40:21.933876 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1458/2935] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:40:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:40:25.000857 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57b1be-0db4-4ab7-b9c9-cb0e8aa2bc67 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:25.001367 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57b1be-0db4-4ab7-b9c9-cb0e8aa2bc67 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:25.001462 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57b1be-0db4-4ab7-b9c9-cb0e8aa2bc67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:25.023279 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-4a57b1be-0db4-4ab7-b9c9-cb0e8aa2bc67 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:40:25.024605 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-4a57b1be-0db4-4ab7-b9c9-cb0e8aa2bc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:40:25.033543 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1478/2936] 10.222.0.48 () {58 vars in 1016 bytes} [Mon Aug 29 22:40:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:40:25.051339 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0226be0-5b06-4898-8874-1bed1a30bdde service nova] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:40:25.062708 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0226be0-5b06-4898-8874-1bed1a30bdde service nova] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:40:25.068877 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e9603a-dc54-4e24-bfdd-176af06aafdb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b7213b7111456a93e294ce40b95b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:40:25.069490 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e9603a-dc54-4e24-bfdd-176af06aafdb service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:25.069783 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e9603a-dc54-4e24-bfdd-176af06aafdb service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:25.070112 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e9603a-dc54-4e24-bfdd-176af06aafdb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:25.078990 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e9603a-dc54-4e24-bfdd-176af06aafdb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:40:25.080649 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e9603a-dc54-4e24-bfdd-176af06aafdb service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:40:25.090243 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1459/2937] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:40:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:40:35.018104 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=18 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:40:35.086031 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=36 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:40:39.279835 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d07729-19b8-40fe-917a-aaaf3eb8e791 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:39.280392 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d07729-19b8-40fe-917a-aaaf3eb8e791 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:39.280392 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d07729-19b8-40fe-917a-aaaf3eb8e791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:39.308871 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-32d07729-19b8-40fe-917a-aaaf3eb8e791 None None] MFA Rules not processed for user `b8b384111a3442cc9b8ca8f6b67c4161`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:40:39.310095 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-32d07729-19b8-40fe-917a-aaaf3eb8e791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:40:39.318739 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1479/2938] 10.222.0.36 () {58 vars in 958 bytes} [Mon Aug 29 22:40:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:40:49.303470 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:40:53.453234 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c90251-9abd-492d-824a-d72bec2c8432 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:53.453805 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c90251-9abd-492d-824a-d72bec2c8432 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:53.453978 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c90251-9abd-492d-824a-d72bec2c8432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:53.481364 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-54c90251-9abd-492d-824a-d72bec2c8432 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:40:53.482784 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-54c90251-9abd-492d-824a-d72bec2c8432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:40:53.492646 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1460/2939] 10.222.0.48 () {58 vars in 1016 bytes} [Mon Aug 29 22:40:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:40:53.536121 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d07729-19b8-40fe-917a-aaaf3eb8e791 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:40:53.550461 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d07729-19b8-40fe-917a-aaaf3eb8e791 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:40:53.557001 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d49b11-bf12-4bca-9351-d6e619586102 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b7213b7111456a93e294ce40b95b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:40:53.557615 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d49b11-bf12-4bca-9351-d6e619586102 service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:53.557894 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d49b11-bf12-4bca-9351-d6e619586102 service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:53.558172 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d49b11-bf12-4bca-9351-d6e619586102 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:53.567136 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d49b11-bf12-4bca-9351-d6e619586102 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:40:53.568765 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d49b11-bf12-4bca-9351-d6e619586102 service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:40:53.579156 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1480/2940] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:40:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:40:56.767764 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b82db-2a55-435f-97f1-9ddf7aaa7dab None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:56.768323 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b82db-2a55-435f-97f1-9ddf7aaa7dab None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:56.768323 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b82db-2a55-435f-97f1-9ddf7aaa7dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:56.791658 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-4d4b82db-2a55-435f-97f1-9ddf7aaa7dab None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:40:56.792953 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-4d4b82db-2a55-435f-97f1-9ddf7aaa7dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:40:56.804663 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1461/2941] 10.222.0.48 () {58 vars in 1016 bytes} [Mon Aug 29 22:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:40:56.820839 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d49b11-bf12-4bca-9351-d6e619586102 service nova] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:40:56.832698 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d49b11-bf12-4bca-9351-d6e619586102 service nova] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:40:56.838996 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a2c894-49df-43b9-b2da-77f07ac01f98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b7213b7111456a93e294ce40b95b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:40:56.839604 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2c894-49df-43b9-b2da-77f07ac01f98 service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:56.839881 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2c894-49df-43b9-b2da-77f07ac01f98 service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:56.840155 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2c894-49df-43b9-b2da-77f07ac01f98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:56.848678 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a2c894-49df-43b9-b2da-77f07ac01f98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:40:56.850248 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a2c894-49df-43b9-b2da-77f07ac01f98 service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:40:56.860189 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1481/2942] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:40:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:40:59.873972 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0ee30-2f3d-480c-add9-657f30a02854 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:59.874596 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0ee30-2f3d-480c-add9-657f30a02854 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:59.874596 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0ee30-2f3d-480c-add9-657f30a02854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:59.897391 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-ede0ee30-2f3d-480c-add9-657f30a02854 None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:40:59.898635 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ede0ee30-2f3d-480c-add9-657f30a02854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:40:59.908614 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1462/2943] 10.222.0.48 () {58 vars in 1016 bytes} [Mon Aug 29 22:40:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:40:59.929474 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a2c894-49df-43b9-b2da-77f07ac01f98 service nova] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:40:59.941783 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a2c894-49df-43b9-b2da-77f07ac01f98 service nova] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:40:59.949750 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29c5a3-b98e-462b-8586-13ed63df045b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b7213b7111456a93e294ce40b95b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:40:59.950351 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29c5a3-b98e-462b-8586-13ed63df045b service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:59.950627 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29c5a3-b98e-462b-8586-13ed63df045b service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:59.950892 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29c5a3-b98e-462b-8586-13ed63df045b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:59.960222 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e29c5a3-b98e-462b-8586-13ed63df045b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:40:59.961856 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e29c5a3-b98e-462b-8586-13ed63df045b service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:40:59.972376 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1482/2944] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:40:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:41:03.040387 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb8b604-dc2e-4560-baed-5e1587ca312b None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:03.041103 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb8b604-dc2e-4560-baed-5e1587ca312b None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:03.041103 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb8b604-dc2e-4560-baed-5e1587ca312b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:03.062198 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-0fb8b604-dc2e-4560-baed-5e1587ca312b None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:41:03.063386 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-0fb8b604-dc2e-4560-baed-5e1587ca312b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:03.072017 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1463/2945] 10.222.0.48 () {58 vars in 1016 bytes} [Mon Aug 29 22:41:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:41:03.091824 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29c5a3-b98e-462b-8586-13ed63df045b service nova] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:03.104000 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29c5a3-b98e-462b-8586-13ed63df045b service nova] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:03.110331 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f883894b-dcef-44ae-960c-579c8ab8a170 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b7213b7111456a93e294ce40b95b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:03.110947 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883894b-dcef-44ae-960c-579c8ab8a170 service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:03.111225 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883894b-dcef-44ae-960c-579c8ab8a170 service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:03.111492 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883894b-dcef-44ae-960c-579c8ab8a170 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:03.119833 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f883894b-dcef-44ae-960c-579c8ab8a170 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:03.121450 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f883894b-dcef-44ae-960c-579c8ab8a170 service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:03.131943 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1483/2946] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:41:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:41:06.255111 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52b4a0-c872-4d25-aa37-2ea6ea9370af None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:06.255669 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52b4a0-c872-4d25-aa37-2ea6ea9370af None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:06.255669 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52b4a0-c872-4d25-aa37-2ea6ea9370af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:06.276760 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-cb52b4a0-c872-4d25-aa37-2ea6ea9370af None None] MFA Rules not processed for user `6b5654a5750846779dda7b1bf48a68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:41:06.277979 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-cb52b4a0-c872-4d25-aa37-2ea6ea9370af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:06.286861 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1464/2947] 10.222.0.48 () {58 vars in 1016 bytes} [Mon Aug 29 22:41:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:41:06.309676 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f883894b-dcef-44ae-960c-579c8ab8a170 service nova] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:06.321572 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f883894b-dcef-44ae-960c-579c8ab8a170 service nova] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:06.328343 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d51da-5078-45ed-9f99-7febdd04b7bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b7213b7111456a93e294ce40b95b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:06.329030 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d51da-5078-45ed-9f99-7febdd04b7bb service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:06.329307 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d51da-5078-45ed-9f99-7febdd04b7bb service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:06.329573 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d51da-5078-45ed-9f99-7febdd04b7bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:06.338691 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0d51da-5078-45ed-9f99-7febdd04b7bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:06.340283 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0d51da-5078-45ed-9f99-7febdd04b7bb service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:06.350280 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1484/2948] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:41:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:41:16.271223 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=15 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:16.346010 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=30 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:17.161371 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb52b4a0-c872-4d25-aa37-2ea6ea9370af None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:17.173986 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb52b4a0-c872-4d25-aa37-2ea6ea9370af None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:17.179350 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a36b37-1ced-4cea-a936-78a8171d52ad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce3d9397cca4ae58e14c8a5ae844f8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:17.179968 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a36b37-1ced-4cea-a936-78a8171d52ad service placement] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:17.180256 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a36b37-1ced-4cea-a936-78a8171d52ad service placement] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:17.180563 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a36b37-1ced-4cea-a936-78a8171d52ad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:17.182407 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-50a36b37-1ced-4cea-a936-78a8171d52ad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:17.194358 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a36b37-1ced-4cea-a936-78a8171d52ad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:17.195965 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a36b37-1ced-4cea-a936-78a8171d52ad service placement] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:17.206149 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1465/2949] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:41:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:41:27.201597 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=6 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:35.945369 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d51da-5078-45ed-9f99-7febdd04b7bb service nova] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:35.955966 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d51da-5078-45ed-9f99-7febdd04b7bb service nova] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:35.961771 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4543061f-40f1-46e2-8a3b-4ba36c08fb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:35.962404 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543061f-40f1-46e2-8a3b-4ba36c08fb2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:35.962820 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543061f-40f1-46e2-8a3b-4ba36c08fb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:35.962820 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543061f-40f1-46e2-8a3b-4ba36c08fb2b admin admin] PATH_INFO: `/v3/users/b8b384111a3442cc9b8ca8f6b67c4161` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:35.963990 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4543061f-40f1-46e2-8a3b-4ba36c08fb2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8b384111a3442cc9b8ca8f6b67c4161)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:35.966262 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4543061f-40f1-46e2-8a3b-4ba36c08fb2b admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:36.017816 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-4543061f-40f1-46e2-8a3b-4ba36c08fb2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8b384111a3442cc9b8ca8f6b67c4161'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:41:36.025736 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-4543061f-40f1-46e2-8a3b-4ba36c08fb2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8b384111a3442cc9b8ca8f6b67c4161'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:41:36.032578 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-4543061f-40f1-46e2-8a3b-4ba36c08fb2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8b384111a3442cc9b8ca8f6b67c4161'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:41:36.033197 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-4543061f-40f1-46e2-8a3b-4ba36c08fb2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8b384111a3442cc9b8ca8f6b67c4161'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:41:36.045320 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-4543061f-40f1-46e2-8a3b-4ba36c08fb2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8b384111a3442cc9b8ca8f6b67c4161'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:41:36.051390 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1485/2950] 10.222.0.36 () {58 vars in 1224 bytes} [Mon Aug 29 22:41:35 2022] DELETE /identity/v3/users/b8b384111a3442cc9b8ca8f6b67c4161 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:41:36.230218 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a36b37-1ced-4cea-a936-78a8171d52ad service placement] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:36.241299 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a36b37-1ced-4cea-a936-78a8171d52ad service placement] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:36.302749 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d6a85-8829-402e-ae56-f59617df9f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5654a5750846779dda7b1bf48a68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174c552d34394032ba6a5f46a315abf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:36.303385 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d6a85-8829-402e-ae56-f59617df9f3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:36.303683 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d6a85-8829-402e-ae56-f59617df9f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:36.303960 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d6a85-8829-402e-ae56-f59617df9f3e admin admin] PATH_INFO: `/v3/projects/03bf9fa715be4364a6fbe476ef5437e4` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:36.305196 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d6a85-8829-402e-ae56-f59617df9f3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=03bf9fa715be4364a6fbe476ef5437e4)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:36.307343 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d6a85-8829-402e-ae56-f59617df9f3e admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:36.357242 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-b31d6a85-8829-402e-ae56-f59617df9f3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03bf9fa715be4364a6fbe476ef5437e4', 'request_id': 'req-b31d6a85-8829-402e-ae56-f59617df9f3e'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:41:36.363999 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-b31d6a85-8829-402e-ae56-f59617df9f3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03bf9fa715be4364a6fbe476ef5437e4', 'request_id': 'req-b31d6a85-8829-402e-ae56-f59617df9f3e'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:41:36.372302 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-b31d6a85-8829-402e-ae56-f59617df9f3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03bf9fa715be4364a6fbe476ef5437e4', 'request_id': 'req-b31d6a85-8829-402e-ae56-f59617df9f3e'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:41:36.383743 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-b31d6a85-8829-402e-ae56-f59617df9f3e admin admin] The token cache is being invalidate because project 03bf9fa715be4364a6fbe476ef5437e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:41:36.384059 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-b31d6a85-8829-402e-ae56-f59617df9f3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:41:36.384801 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-b31d6a85-8829-402e-ae56-f59617df9f3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:41:36.386734 dv-cinder-854268-3-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1466/2951] 10.222.0.36 () {58 vars in 1233 bytes} [Mon Aug 29 22:41:36 2022] DELETE /identity/v3/projects/03bf9fa715be4364a6fbe476ef5437e4 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:41:46.047558 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:46.380658 dv-cinder-854268-3-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:46.174723 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4543061f-40f1-46e2-8a3b-4ba36c08fb2b admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:46.176549 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-4543061f-40f1-46e2-8a3b-4ba36c08fb2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:46.332245 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4543061f-40f1-46e2-8a3b-4ba36c08fb2b admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:46.400640 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0108ec-dc53-4f73-b74a-4d24f1f630a1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce3d9397cca4ae58e14c8a5ae844f8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696ed25cc0cb43fab4bfaf762a90da54', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:46.401264 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0108ec-dc53-4f73-b74a-4d24f1f630a1 service placement] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:46.401546 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0108ec-dc53-4f73-b74a-4d24f1f630a1 service placement] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:46.401820 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0108ec-dc53-4f73-b74a-4d24f1f630a1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:46.404268 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-5f0108ec-dc53-4f73-b74a-4d24f1f630a1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:46.416429 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0108ec-dc53-4f73-b74a-4d24f1f630a1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:46.418026 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0108ec-dc53-4f73-b74a-4d24f1f630a1 service placement] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:46.427989 dv-cinder-854268-3-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1486/2952] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Aug 29 22:46:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:46:56.423788 dv-cinder-854268-3-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}